A

Anaplan

Cloud-based SaaS planning and performance management

Engineer 3 - Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeGurugram, Haryana, IndiaNo salary listedIn-person

About the Job

Requirements

  • At least 6 years of software or data engineering experience, including at least 3 years building and maintaining production data pipelines.
  • Strong Python development skills and commitment to writing clean, tested code using pytest, nox, or tox.
  • Deep experience with workflow orchestration, including Airflow DAG design, operators, scheduling, and failure handling, or alternatives such as Dagster and Prefect.
  • Hands-on experience with distributed compute using Spark and cloud data ecosystems such as AWS EMR, Athena, S3, Databricks, Snowflake, and GCP.
  • Solid SQL and data-modeling skills, with practical experience with NoSQL databases, caching layers, and message queues such as MongoDB, Redis, Kafka, and RabbitMQ.
  • Comfort deploying and managing containerized workloads on Kubernetes using Docker and Helm.
  • A proven track record of owning production pipelines, including participation in on-call rotations, incident response, and root-cause analysis.
  • Clear written technical communication and a history of documenting architectural decisions.

Responsibilities

  • Design, build, and run batch and scheduled data pipelines using Airflow, Dagster, or Prefect, and lead orchestrator upgrades.
  • Own and extend data collectors and engines, including web/API ingestion, large-scale web scraping with Playwright, Selenium, and Scrapy, parsing, normalization, and file merging.
  • Build scalable distributed processing architectures using Spark on EMR, Databricks, or Dataproc, and analytical query layers using Athena, Snowflake, or BigQuery, including cross-cloud ingestion pipelines.
  • Improve entity matching and caching services using Redis, MemoryDB, and DynamoDB to optimize accuracy, latency, and operational cost.
  • Develop and maintain high-performance Python data access layers and APIs for downstream machine learning and product teams.
  • Own data quality initiatives, including validation frameworks, retention policies, backfills, monitoring, and OpenTelemetry-based observability.
  • Partner with data science, forecasting, and platform teams to ship features safely behind feature flags such as LaunchDarkly and Unleash.
  • Raise engineering standards across the team through rigorous code reviews, technical design documents, and mentoring.

Desired Qualifications

  • Experience managing large-scale web data collection and distributed crawler infrastructure.
  • Familiarity with record linkage, entity resolution, fuzzy matching, and NLP preprocessing using spaCy or NLTK.
  • Hands-on experience building multi-cloud data pipelines, such as bridging GCP/BigQuery and AWS.
  • Experience designing data pipelines that directly feed machine learning or forecasting systems.

About the Company

Anaplan

Cloud-based SaaS planning and performance management

Anaplan provides a cloud-based SaaS platform for enterprise-wide planning and performance management that helps finance, supply chain, sales, marketing, and HR teams improve planning and decision making. Users connect data sources, build models and scenarios, run forecasts, and collaborate in real time within a scalable subscription model, with optional professional services for training and implementation. Unlike tools that tackle planning in silos, Anaplan offers a single connected platform that links data, people, and plans across multiple business functions. Its goal is to help organizations optimize operations and make data-driven decisions at scale.

Company size
1,001-5,000
Company stage
IPO
Headquarters
San Francisco, CA
Founded
2006

Recently Posted Jobs

Explore more opportunities at Anaplan

See more jobs