W

Walmart

Sells groceries and essentials in stores and online

Staff Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeChennai, Tamil Nadu, IndiaNo salary listed

About the Job

Requirements

  • At least 8 years of professional software engineering experience with significant hands-on data engineering at scale; strong proficiency in Java and Python and working knowledge of Spark for distributed data processing are required.
  • Operational Excellence and Engineering Excellence practices, including SLO/SLA ownership, incident management, blameless post-incident reviews, proactive reliability and quality metrics, and continuous improvement.
  • A Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
  • Deep experience with the Big Data ecosystem, including Spark, Hadoop/HDFS, Hive, Kafka, workflow orchestration such as Airflow or equivalent, batch and streaming processing, and large-scale data transformation.
  • Data platform fundamentals, including data modeling, ETL/ELT pipeline design, data quality and observability, data governance, and integration with lakehouse architectures such as Delta Lake, BigQuery, or Databricks.
  • Hands-on experience integrating model APIs and GenAI/LLM tooling, building or operating agentic workflows, working with embeddings/vector search, and applying MLOps practices such as feature stores, model lifecycle, and retraining pipelines.
  • Working knowledge of platform engineering, including microservices, API design, Kubernetes or equivalent orchestration, CI/CD, and cloud-native practices.
  • Distributed systems fundamentals, including event-driven patterns, service contracts, asynchronous processing, and fault tolerance at scale, combined with system design, domain-oriented design, and low-level design skills and the ability to evaluate trade-offs, failure modes, scalability, and cost when owning production code.
  • Software engineering craftsmanship, including testing strategy, code review standards, design patterns, and system design for high-throughput data systems.
  • Ability to translate ambiguous data or business problems into clear technical execution plans, particularly within a newly formed team without fully established processes.
  • Strong ownership mindset and technical judgment, with the ability to operate autonomously in a 0-to-1 environment.
  • Minimum-qualification alternatives: a Bachelor's degree in Computer Science and 4 years of software engineering or related-field experience; or 6 years of software engineering or related-field experience; or a Master's degree in Computer Science and 2 years of software engineering or related-field experience. Also requires 3 years of experience in data engineering, database engineering, business intelligence, or business analytics.

Responsibilities

  • Design, build, and operate large-scale batch and streaming data pipelines using Spark, Java, and Python.
  • Apply software engineering fundamentals, including clean architecture, automated testing, CI/CD, and code review discipline, to data engineering work.
  • Apply domain-oriented design, system design, and low-level design rigor to data and platform problems by evaluating dependencies, trade-offs, failure modes, scalability, cost, and long-term durability before implementation.
  • Build and maintain services, APIs, and distributed systems that data pipelines depend on, contributing to the broader platform codebase as needed.
  • Integrate AI, GenAI, and agentic capabilities into the data platform, including embeddings/vector search for data discovery, LLM-assisted data quality and anomaly detection, agentic pipeline monitoring and self-healing, and AI-assisted schema and lineage documentation.
  • Partner with data scientists and ML engineers to build feature pipelines, model-serving data paths, and data infrastructure for MLOps.
  • Own data quality, observability, and governance for the pipelines and datasets developed.
  • Participate in and lead architecture and design reviews across data engineering and platform engineering.
  • Set technical direction and best practices within the team and technical domain, mentor engineers, and influence broader data engineering standards.
  • Evaluate emerging Big Data, cloud, and AI/agentic technologies and adopt them where they improve reliability, productivity, or business value.

Desired Qualifications

  • Experience with Go, C++, or Scala.

About the Company

Walmart

Sells groceries and essentials in stores and online

Walmart sells groceries, household essentials, clothing, and electronics through stores and online marketplaces for consumers around the world. Its everyday low price model combines large purchasing volumes with distribution networks that move goods to stores and customer homes. Shoppers can browse online, collect orders at a nearby store, or request delivery, while third-party merchants use its marketplace and fulfillment services to reach customers. The group earns revenue from merchandise sales, memberships, advertising, and services, and also operates pharmacies, optical centers, and digital payments businesses. Walmart opened its first discount store in 1962 and is headquartered in Bentonville, Arkansas.

Company size
10,001+
Company stage
IPO
Headquarters
Bentonville, AR
Founded
1962

Recently Posted Jobs

Explore more opportunities at Walmart

See more jobs