M

Mastercard

Processes payments across a global network

Principal Data Engineer - Multiple Teams

Full-TimeDeadline 12/31/26
No salary listed
Expert
Bachelor's
Pune, Maharashtra, India
In Person
Data & AnalyticsData Engineering

About the job

Requirements
  • Typically 12–18 years of overall career-relevant experience, including significant ownership of complex enterprise data engineering solutions.
  • Extensive experience designing, building, and operating large-scale production data platforms.
  • Expert programming skills in Python, PySpark, and modern software engineering practices.
  • Advanced SQL expertise, including data modeling, performance tuning, query optimization, and large-scale analytical processing.
  • Strong hands-on experience with distributed data processing technologies such as Apache Spark and modern lakehouse platforms.
  • Experience building and operating cloud-native data platforms in AWS, Azure, or other enterprise cloud environments.
  • Strong knowledge of modern data architecture patterns, including data lakes, lakehouses, data meshes, data products, and event-driven architectures.
  • Experience with cloud storage, data integration, streaming, serverless, observability, and security services across public cloud platforms.
  • Experience building scalable batch and real-time data pipelines.
  • Experience with workflow orchestration platforms such as Apache Airflow, Databricks Workflows, AWS Step Functions, Azure Data Factory, or similar technologies.
  • Experience implementing CI/CD, automated testing, version control, Infrastructure as Code, and platform automation.
  • Strong understanding of data governance, metadata management, lineage, quality frameworks, privacy controls, and access management.
  • Experience diagnosing and resolving complex performance, reliability, scalability, and operational challenges.
  • Ability to make sound architectural decisions while balancing delivery speed, innovation, maintainability, security, and cost.
  • Proven ability to thrive in R&D and innovation-focused environments where priorities and requirements may evolve through experimentation.
  • Strong communication, collaboration, technical leadership, and mentoring skills.
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or a related technical discipline, or equivalent practical experience.
Responsibilities
  • Lead the architecture, design, and engineering of scalable batch, streaming, and event-driven data platforms.
  • Design and build reliable data ingestion, transformation, enrichment, processing, and consumption pipelines.
  • Develop governed lakehouse and modern data platform architectures using cloud-native technologies and distributed data processing frameworks.
  • Build and operate platforms that support analytics, machine learning, generative AI, and agentic AI workloads.
  • Create reusable data products, services, APIs, and self-service capabilities that accelerate experimentation and production delivery.
  • Enable the full AI and machine learning lifecycle through robust feature engineering, training, evaluation, deployment, and inference pipelines.
  • Optimize data workloads for performance, scalability, reliability, resiliency, and cost efficiency.
  • Define engineering standards for data modeling, software development, testing, CI/CD, observability, and operational excellence.
  • Implement data governance capabilities including quality controls, lineage, metadata management, cataloging, access control, retention, and compliance.
  • Apply security and privacy-by-design principles for sensitive and regulated data environments.
  • Evaluate emerging data and AI technologies through prototypes, proof-of-concepts, and technical assessments.
  • Translate loosely defined research, innovation, or product requirements into practical architectures and incremental delivery plans.
  • Provide hands-on technical leadership through architecture reviews, code reviews, troubleshooting, and engineering mentorship.
  • Partner with cross-functional teams to mature successful R&D initiatives into enterprise-grade production solutions.
  • Communicate technical decisions, trade-offs, risks, dependencies, and roadmap recommendations to technical and business stakeholders.
  • Drive adoption of modern data engineering practices, platform automation, and platform reliability disciplines.
  • Abide by Mastercard's security policies and practices; ensure the confidentiality and integrity of accessed information; report suspected information security violations or breaches; and complete periodic mandatory security trainings.
  • Remain strongly hands-on while providing technical direction; build production-quality systems without unnecessary platform complexity; convert experimentation into reusable engineering capabilities; design for security, governance, reliability, and observability; challenge assumptions and validate architectural choices through evidence and prototypes; enable AI and product teams without taking ownership of data science or model research; and influence across teams without formal people-management authority.
Desired Qualifications
  • Experience supporting machine learning, generative AI, or agentic AI systems.
  • Experience with MLflow or comparable ML lifecycle tooling.
  • Experience with Azure Machine Learning, Azure AI Foundry, or Microsoft Fabric.
  • Experience with Unity Catalog, Microsoft Purview, or comparable catalog and governance platforms.
  • Experience with Kafka or other event-streaming technologies.
  • Experience with containerized and cloud-native platforms, including Docker and Kubernetes.
  • Experience with Terraform or another Infrastructure as Code framework.
  • Experience integrating structured, semi-structured, unstructured, and streaming data.
  • Knowledge of responsible AI, model evaluation, and AI platform observability.
  • Experience in payments, financial services, or another regulated industry.

About the company

Mastercard operates a global payment network connecting financial institutions, merchants, businesses and consumers. It authorizes, clears and settles transactions between participating institutions, while banks issue Mastercard-branded cards and extend credit to their customers. Its services also include fraud detection, identity verification, payment tokenization, data analysis and consulting for organizations managing commerce and financial operations. The company earns network fees linked to payment volumes and processed transactions, along with fees for its services and solutions. Founded by a group of banks in 1966, Mastercard is headquartered in Purchase, within Harrison, New York.

Company Size

10,001+

Company Stage

IPO

Headquarters

Town of Harrison, New York

Founded

1966

Get referred to Mastercard

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • Revenue is growing: July 2026 Mastercard reported $9.3 billion Q2 net revenue, up 14% year over year.
  • Services broaden growth: July 2026 Mastercard reported Q2 value-added services and solutions net revenue growth of 20%.
  • Parent support has a published floor: Mastercard lists at least 16 weeks of new parent leave, with regional variations.

What critics are saying

  • Customer incentives complicate revenue: Mastercard adjusts rebates when actual client transaction volumes differ from estimates.
  • Legal costs remain material: February 2026 Mastercard reported $504 million in pre-tax litigation provisions for 2025.
  • Remote work is program based: Mastercard lists a hybrid policy and four-week work-from-elsewhere benefit, with regional variations.

What makes Mastercard unique

  • Acceptance spans currencies: Mastercard's network processes payments in over 210 markets and 150 currencies.
  • Tokens connect payment participants: Mastercard's APIs enable issuers, merchants and service providers to use tokens at scale.
  • Fraud scoring extends beyond Mastercard cards: Decision Intelligence assesses transactions processed by any payment network.

Help us improve and share your feedback! Did you find this helpful?

Benefits

  • New Parent Leave
  • Inclusive Family Building Benefit
  • Employee Family Resource Program
  • Bereavement Leave
  • Dependent Scholarship
  • Employee Assitance Fund
  • Business Resource Groups
  • Employee Recognition
  • Flexible Work
  • Tuition Assistance
  • Travel Assistance
  • Matching Charitable Gifts

Company News

Yahoo Finance
Oct 28th, 2026
Mastercard stock up 20.5% in six months: key dates, from Q3 results on October 29

Mastercard stock returned 20.5% in the six months to October 27, 2026, ahead of the S&P 500's 8.8%. The company reports fiscal third-quarter results on October 29, before the market opens, its first since Ling Hai became chief financial officer on August 3. Management guided 2026 net revenue growth to the high end of the low double digits on a currency-neutral basis. Growth was 12% in the second quarter, and the comparison is $8.6 billion of revenue a year earlier. Two risks stand out: rebates and incentives taking a slightly larger share of network fees, and Middle East conflict weighing on cross-border travel. Fourth-quarter results are due in January 2027.

FinanceFeeds
Oct 27th, 2026
UK businesses seek compensation from Visa and Mastercard over card fees.

UK businesses seek compensation from Visa and Mastercard over card fees. Visa and Mastercard face a potential multibillion-pound compensation claim in the UK after law firms Harcus Parker and Hausfeld filed collective proceedings applications at the Competition Appeal Tribunal (CAT), alleging that businesses were overcharged on consumer card transactions over six years.The claims, filed on October 26, 2026, seek compensation for alleged excessive multilateral interchange fees (MIFs) on Visa and Mastercard consumer debit, credit and prepaid card payments between October 23, 2020, and October 23, 2026. The combined value has been estimated at around £5 billion, although the claims have yet to be authorised and liability has not been established. The proposed proceedings are directed by Stephen Allen, a former travel-sector executive who has pursued earlier card-fee litigation. Litigation funder Bench Walk Advisors is financing the action. Both payment networks dispute the allegations. Why are merchants challenging interchange fees? Multilateral interchange fees are set by card networks and paid through merchants' banks when customers make card payments. They form a substantial component of the merchant service charges businesses pay to accept cards. The claimants argue that Visa and Mastercard face insufficient competitive pressure because merchants have limited practical alternatives when customers want to pay using their cards. The proposed actions allege that this lack of choice allowed the networks to maintain fees at levels that caused businesses financial losses. The proceedings concern consumer card transactions across the UK, rather than only cross-border online payments. They are therefore distinct from the regulatory dispute over post-Brexit interchange fees on UK-to-European Economic Area e-commerce transactions, where the Payments Systems Regulator has sought authority to impose fee caps. FinanceFeeds previously examined how a UK court ruling cleared the way for the regulator to pursue cross-border card fee caps. The new claims add a separate route for merchants to seek compensation for alleged historical overcharging, rather than relying solely on prospective regulatory intervention. Investor takeaway. The claims create potential compensation exposure for Visa and Mastercard, but the outcome will depend on tribunal authorisation, evidence of competition-law infringements and the calculation of merchant losses. How would the proposed collective actions work? The applications use two different participation structures, dividing businesses according to their annual group turnover during 2022-2024. UK-domiciled businesses with annual group turnover below £100 million during that period would be included automatically in the proposed opt-out proceedings, unless they choose to leave the class. Hausfeld is representing the proposed class in this action. Businesses with annual group turnover of £100 million or more may instead qualify for the separate opt-in proceedings represented by Harcus Parker. Those businesses would need to take affirmative steps to participate rather than being included automatically. The proposed classes cover businesses accepting Visa or Mastercard consumer debit, credit and prepaid cards. However, businesses that have previously brought or settled claims against either network concerning consumer card transactions would be excluded from these proceedings. The distinction between opt-in and opt-out matters because it affects how many businesses participate, the administration of the litigation and the potential scale of any compensation award. Neither structure guarantees recovery: the CAT must first authorise the collective proceedings, and the claimants must establish the relevant legal and factual grounds. How have Visa and Mastercard responded? Mastercard has strongly disputed the basis of the claims, describing the application as speculative. The company argues that interchange fees support the functioning of the UK payments ecosystem by helping people and businesses pay and receive payments securely and efficiently. Mastercard has also connected the litigation to the government's proposed changes to opt-out collective actions. The Department for Business and Trade published a consultation in July 2026 proposing reforms to the way collective claims are brought, financed and settled. The consultation also addressed how private competition claims interact with public enforcement. Visa has similarly defended interchange fees as a critical component of a secure digital payments system that benefits consumers, merchants and banks. Neither company's position constitutes a tribunal finding on the allegations. The dispute comes against a backdrop of other litigation over card acceptance costs. In the United States, Visa and Mastercard agreed in December 2025 to a proposed $167.5 million settlement in a separate class action concerning ATM access fees. That case, originally filed in 2011, involved different fees and allegations and should not be confused with the UK merchant interchange claims. FinanceFeeds has also covered the proposed US settlement of long-running merchant litigation over card-processing fees, illustrating the sustained legal and commercial pressure surrounding card-network pricing. The legal risk extends beyond any eventual damages award: prolonged litigation could increase costs and intensify scrutiny of interchange economics, while changes to collective-action rules could affect how future claims are financed. What happens next in the tribunal? The immediate question is whether the CAT will authorise the proposed collective proceedings. The applications do not establish that Visa or Mastercard breached competition law, and the tribunal must consider the legal requirements for the claims to proceed collectively. If authorised, the cases would move into further proceedings examining the allegations, relevant market conditions and the extent of any losses suffered by eligible businesses. Establishing liability would not automatically determine the amount payable to each merchant; the assessment and distribution of damages could require additional legal and economic analysis. The litigation could take years to resolve, particularly given the number of businesses potentially covered and the complexity of calculating interchange-related losses across different transaction types and merchant categories. For Visa and Mastercard, the immediate financial impact remains uncertain. The central issue is whether merchants can demonstrate that the networks' fee-setting arrangements restricted competition and caused compensable losses. Until the tribunal rules on authorisation and the merits are examined, the multibillion-pound estimate represents potential exposure rather than an established liability. Ask this article Answered from FinanceFeeds reporting, with sources Uses FinanceFeeds articles only. Not financial advice.

Shipkevich PLLC
Oct 27th, 2026
Visa and Mastercard face potential UK suit over card fees.

Visa and Mastercard face potential UK suit over card fees. Visa and Mastercard are facing two proposed UK class-action lawsuits seeking billions of pounds for allegedly unlawful consumer card fees.

Yahoo Finance
Oct 27th, 2026
S&P 500 futures ease before Fed decision as Nu Holdings falls 17% and Visa faces $6.4B UK suit

US stock futures look set for a slightly softer open on Tuesday as investors weigh solid economic data against the Federal Reserve's rate decision, due Wednesday. The Chicago Fed National Activity Index came in at +0.07 for September, pointing to modestly above-trend growth. Nu Holdings fell 16.95% after Lula's reelection in Brazil hit Brazilian financial stocks and the currency. MercadoLibre dropped 7.81%, and DoorDash fell 6.10% on reports it is in advanced talks to buy Instacart for about $17 billion. Comfort Systems USA rose 7.18% on strong third-quarter results and a record backlog. Coherent gained 5.83%, and Bloom Energy climbed 5.49%. Visa and Mastercard face a proposed £5 billion collective lawsuit in the UK over card payment fees. The Fed's target rate is 4%, in line with consensus.

CNBC
Oct 27th, 2026
Mastercard warns "stablecoin sandwich" could slow payments without better infrastructure

Stablecoins could make payments faster and cheaper, but only if the supporting infrastructure improves, Mastercard executive Matthew Driver told CNBC. He is executive vice president of services for Asia Pacific. Driver warned against a "stablecoin sandwich": a slow on-ramp into stablecoins, a fast transaction, then a slow off-ramp back into fiat currency. Linking real-time payment systems to stablecoin exchanges at both ends could help. Stablecoins may suit certain remittance corridors and less commonly traded currency pairs. In Singapore, where retail payments are already efficient, corporate payments may offer more opportunity. Mastercard completed its acquisition of stablecoin infrastructure provider BVNK in August. The two have since launched Global Money Platform, which lets banks, fintechs, and businesses manage traditional and stablecoin payments through one API.