Distinguished Big Data Engineer

Position Summary...

What you'll do...

The Big Data team within Data Services, Global Technology Platform at Walmart is responsible for building and managing large-scale data processing and analytics platforms that power the company’s data-driven initiatives. We empower a unified ecosystem for developing data products, ML/Ops, and AI/Ops, unlocking actionable insights from Walmart’s data at scale across multiple cloud platforms.

What makes our team unique is our focus on both scale and speed. We leverage cutting-edge technologies, distributed computing frameworks and query engines to provide deliver real-time and batch analytics, delivering data-driven solutions that impact millions of customers and associates every day. Our collaborative culture encourages innovation, continuous learning, and cross-functional partnerships, allowing us to solve some of the most complex data challenges in retail at a global scale.

Distinguished Engineer — Big Data will define and drive the technical vision for Big Data platforms at a massive scale. This is a senior technical leadership role for an engineer with deep expertise in Big Data to define and drive the technical vision for Data Platforms at massive scale. You will shape the architecture and evolution of Big Data capabilities across the organization, with a strong focus on Spark, Airflow, Metastore, Gluten, Velox and Query Engines.

You will work on some of the most complex Big Data challenges in the industry, including high availability, scalability, reliability, performance engineering, automation, and operational excellence.As a Distinguished Engineer, you will operate as a hands-on technical leader, influencing platform strategy, guiding architectural decisions, mentoring senior engineers, and partnering closely with application teams to design and operate complex, high-scale systems. You will help build sophisticated tooling and platforms on top of open-source and commercial Big Data technologies, tailoring them to Walmart’s scale, reliability, security, and developer productivity needs.

What You’ll Do 

• Define and drive the long-term technical vision, architecture, and roadmap for Big Data platforms within Data Services. 

• Lead the design and evolution of highly available, scalable, secure, and operationally efficient Big Dats Platforms that support mission-critical workloads at enterprise scale. 

• Provide deep technical leadership across Big Data processing frameworks — including Spark, Gluten, and Velox — orchestration engines such as Airflow, and query engines including BigQuery, Trino, Druid, and Pinot — serving as the definitive technical authority across this ecosystem

• Build and influence sophisticated tooling, automation, and platform capabilities that improve platform reliability, performance, observability, developer productivity, and operational simplicity. 

• Partner with application engineering teams to design, review, and optimize database architectures for complex distributed systems and high-throughput workloads. 

• Establish technical standards, best practices, reference architectures, and operational patterns for relational database usage across the organization. 

• Influence senior engineering leaders, architects, product teams, and business stakeholders by clearly communicating technical strategy, trade-offs, risks, and execution plans. 

• Mentor principal and senior engineers, raising the technical bar across database engineering, distributed systems, performance engineering, and production operations. 

What You’ll Bring 

• 15+ years of software engineering experience, with significant depth in Big Data area

• Strong programming experience in one or more systems or platform languages such as Java, Python, C++, Go. 

• Hands on experience working with, Big Data technologies like Spark, Hive, Airflow, Gluten, Velox, BigQuery, Trino, Druid and Pinot etc.

• Deep working knowledge of all aspects of Cloud native distributed system development: GCP/Azure

• Experience in building Agentic AI solutions using LLM models, Langraph, Langchain frameworks, using Gen AI productivity tools like Github Copilot, Codium

• Experience designing and operating Big Data Platforms with strong reliability, availability, backup and restore, disaster recovery, observability, security, and compliance characteristics. 

• Strong systems engineering background, with the ability to reason deeply about distributed systems, concurrency, networking, storage, failure modes, and capacity planning. 

• Experience building automation, tooling, or platform capabilities around open-source or commercial database systems. 

• Proven ability to define technical strategy, drive architecture across teams, and influence large-scale engineering direction without relying solely on formal authority. 

• Excellent written and verbal communication skills, including the ability to explain complex database and platform concepts to senior technical and non-technical stakeholders. 

• Strong track record of mentoring engineers, reviewing architecture, and raising engineering standards across a large organization. 

About Walmart Global Tech
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people.  That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world’s leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered.

We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.

Work
Walmart’s culture sets us apart, and we know being together helps us innovate, learn and grow great careers. This role is based in our Bangalore office for daily work, with the flexibility for associates to manage their personal lives.

Benefits

Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best-in-class benefits maternity and parental leave, PTO, health benefits, and much more.

Belonging

We aim to create a culture where every associate feels valued for who they are, rooted in respect for the individual. Our goal is to foster a sense of belonging, to create opportunities for all our associates, customers and suppliers, and to be a Walmart for everyone.

At Walmart, our vision is "everyone included." By fostering a workplace culture where everyone is—and feels—included, everyone wins. Our associates and customers reflect the makeup of all 19 countries where we operate. By making Walmart a welcoming place where all people feel like they belong, we’re able to engage associates, strengthen our business, improve our ability to serve customers, and support the communities where we operate.

Equal Opportunity Employer

Walmart, Inc., is an Equal Opportunities Employer – By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing unique styles, experiences, identities, ideas and opinions – while being inclusive of all people

Minimum Qualifications...

Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.

Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 6 years’ experience in software engineering or related area.
Option 2: 8 years’ experience in software engineering or related area.

Preferred Qualifications...

Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.

Master’s degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years' experience in software engineering or related area, We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture.

Primary Location...

Building 10 (sez), Cessna Business Park, Kadubeesanahalli Village, Varthur Hobli , India