Full-Time
Lead Data Engineer
Mastercard
11-50 employees
Global payments network and services provider
No salary listed
Pune, Maharashtra, India
In Person
Bachelor's
 Data & Analytics (1) |
|---|
Get referred to Mastercard
See people who can refer or advise you
- Strong proficiency in object-oriented programming and object-oriented analysis and design using Java and JDK 8 or later; Python and/or Go is a plus.
- Experience building data services and distributed systems.
- Strong understanding of multithreading, scalability, and performance tuning.
- Strong hands-on experience with AWS, Azure, or Google Cloud Platform.
- Experience with cloud-native data services including S3, ADLS, GCS, Databricks, EMR, BigQuery, and Redshift.
- Strong experience with Apache Spark Core, Spark SQL, and Structured Streaming.
- Hands-on experience with Kafka or equivalent messaging platforms.
- Experience with real-time processing frameworks such as Apache Flink or Spark Streaming.
- Strong understanding of ETL/ELT design patterns and pipeline architectures.
- Experience with Parquet, Avro, and ORC data formats.
- Knowledge of dimensional modeling and star or snowflake schemas.
- Proficiency in Infrastructure as Code using Terraform, CloudFormation, or ARM templates.
- Experience with Docker and Kubernetes.
- Solid understanding of cloud networking, IAM, and security best practices.
- Experience with workflow orchestration tools such as Airflow or equivalent.
- Strong SQL skills and experience with data warehouse platforms.
- Understanding of data governance, lineage, and observability frameworks.
- Experience with CI/CD tools such as Jenkins and GitHub Actions.
- Strong testing practices using JUnit or equivalent frameworks.
- Experience with monitoring and observability tools such as Splunk, Dynatrace, and Prometheus.
- Familiarity with performance testing tools such as JMeter and Gatling.
- Understanding of secure development practices, including PCI DSS and GDPR.
- Proven ability to lead and mentor engineering teams.
- Strong problem-solving and system design skills.
- Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field.
- Design and build scalable batch and real-time data pipelines using Spark, Kafka, and Apache Flink.
- Develop robust ETL/ELT frameworks for structured and unstructured data.
- Build and optimize data ingestion and transformation pipelines for data lakes and data warehouses.
- Implement stream-processing solutions for near real-time use cases.
- Ensure data quality, lineage, observability, and governance across pipelines.
- Optimize data jobs for performance, scalability, and cost efficiency.
- Design and operate cloud-native data platforms on AWS, Azure, or Google Cloud Platform.
- Leverage managed services such as S3, ADLS, GCS, EMR, Databricks, BigQuery, Redshift, and Snowflake.
- Implement Infrastructure as Code using Terraform, CloudFormation, or equivalent tools.
- Ensure high availability, fault tolerance, and disaster recovery.
- Drive cost optimization strategies for large-scale data workloads.
- Implement secure data access controls aligned with enterprise standards.
- Build reusable data frameworks, libraries, and pipeline templates.
- Drive adoption of CI/CD, automated testing, and observability.
- Develop and enhance developer tooling and platform capabilities.
- Contribute to cloud-agnostic platform architecture and automation.
- Provide technical leadership, mentorship, and design guidance.
- Conduct code reviews and architecture reviews, and enforce best practices.
- Collaborate with architects, product owners, and cross-functional teams.
- Act as a subject matter expert for data platform initiatives.
- Promote engineering excellence through documentation, design standards, and innovation.
- Work effectively across globally distributed teams.
- Python and/or Go experience.
- Apache Flink experience.
Mastercard operates a global payments network that enables people and businesses to pay with cards and digital methods. Banks issue Mastercard-branded debit and credit cards, and Mastercard’s network authorizes transactions, clears them between banks, and settles funds, allowing merchants to receive payments securely and quickly. The company differentiates itself by leveraging a worldwide alliance of banks and merchants, transitioning from a cooperative of banks to a publicly traded company via its 2006 IPO, and continuously expanding its reach through partnerships and new payment technologies. Mastercard’s goal is to provide fast, secure, and convenient cross-border payment services and to grow its share of the global payments market by enabling merchants and customers to transact smoothly anywhere in the world.
Company Size
11-50
Company Stage
IPO
Headquarters
Town of Harrison, New York
Founded
2007
Get referred to Mastercard
See people who can refer or advise you
Simplify's Take
What believers are saying
- Mastercard reported Q2 2026 net revenue of $9.3 billion, up 14% on July 30.
- Mastercard launched Wallet Pay in Singapore on September 13, 2026, targeting cross-border money movement.
- Agent Pay, Agent Connect, and Anthropic partnerships position Mastercard inside AI commerce workflows.
What critics are saying
- On June 10, 2026, judges advanced a $38 billion swipe-fee settlement against Mastercard.
- Merchant category pricing caps and Honor All Cards changes will compress interchange economics by 2034.
- Visa's BioCatch acquisition and Visa Direct intensify competition in payments, wallets, and identity.
What makes Mastercard unique
- Mastercard processed $2.9 trillion in Q2 2026, proving unmatched global acceptance.
- On September 10, 2026, Mastercard joined Visa and Ant International on Know Your Agent.
- Mastercard Wallet Pay spans 200-plus countries, 150 currencies, and 4.3 billion wallet users.
Help us improve and share your feedback! Did you find this helpful?
Benefits
New Parent Leave
Inclusive Family Building Benefit
Employee Family Resource Program
Bereavement Leave
Dependent Scholarship
Employee Assitance Fund
Business Resource Groups
Employee Recognition
Flexible Work
Tuition Assistance
Travel Assistance
Matching Charitable Gifts
Company News
Mastercard's Dreamonomics research reveals US small and medium-sized businesses are prioritising stability over rapid expansion in today's demanding economy. Entrepreneurs increasingly seek predictable, protected growth that's easier to manage. The research shows major events create significant opportunities. Mastercard Economics Institute analysis found small restaurants and bars along the New York City Marathon route experienced a 22% spending lift on race day, peaking at 40% in early afternoon. To help businesses capitalise on high-traffic moments, Mastercard is launching Race Ready, a small business playbook ahead of the 2026 TCS New York City Marathon. The initiative combines expert guidance, economic insights and practical business considerations to help entrepreneurs prepare operations and maximise opportunities during major events.
Visa, Mastercard, and Ant International launch trust framework for AI agents. Curated by Contributor September 10, 2026 The race for global payment dominance isn't about mobile wallets anymore - it's about who controls the autonomous AI agents spending money on your behalf. In a landmark cross-border alliance, payment giants Visa, Mastercard, and Ant International have officially joined forces to create a unified Know-Your-Agent (KYA) interoperability framework. This initiative brings together the world's primary credit card networks and Asia's largest digital wallet ecosystem to construct a universal security and verification layer for autonomous software transactions. As artificial intelligence shifts from passive conversational bots to autonomous operational agents capable of executing complex purchases, global payment systems face an existential challenge: verifying transactional intent without stifling speed. By establishing shared identity standards, the three payment titans are laying the digital infrastructure for a multi-trillion-dollar agentic commerce economy. The rapid rise of autonomous software is pushing traditional financial compliance past its operational limits. To prevent fragmented payment ecosystems, Visa, Mastercard, and Ant International announced a joint initiative to establish standardized principles for AI agent identification. Central to the collaboration is the Know-Your-Agent (KYA) architecture - a structural evolution of traditional Know-Your-Customer (KYC) regulations. Under this model, an AI agent verified on one participating network can transmit authenticated trust signals across card networks and wallet rails, eliminating duplicate identity checks and onboarding friction for merchants. The transition to autonomous AI transactions represents the largest structural shift in commerce since the digital wallet. According to research from McKinsey & Company, AI agents are projected to orchestrate US$3 trillion to US$5 trillion in global consumer commerce by 2030.However, market growth hinges entirely on trust. A consumer study by Visa revealed that only 23% of US consumers currently trust generative AI tools to manage payments on their behalf. However, consumer confidence increases sharply when established payment networks manage transaction safety. By unifying verification across Visa, Mastercard, and Ant International - which powers over 150 million merchants via Alipay+ alongside billions of payment cards - the industry is erecting a unified defense against agent hijacking, hallucinated orders, and synthetic account fraud. The Visa, Mastercard, and Ant International launch AI agent trust framework initiative is a strategic defense against commoditization. As tech giants like Apple, Amazon, and Microsoft build agentic capabilities into consumer operating systems, payment networks risk being relegated to passive back-end pipes. By taking ownership of the trust layer, payment processors ensure that regardless of which AI model triggers a transaction, execution must pass through their standardized KYA rails. Furthermore, integrating Ant International bridges the gap between Western card rails and Asian mobile wallet ecosystems. As Jiang-Ming Yang, Chief Innovation Officer at Ant International, explained: "If an agent registers with Ant, they don't need to register again with Visa or Mastercard." The battle for the future of commerce won't be fought over user interfaces - it will be decided at the machine verification layer. By establishing the world's first unified trust framework for autonomous AI software, Visa, Mastercard, and Ant International have drawn the blueprint for machine-driven commerce. Which payment provider or enterprise platform do you believe will capture the largest share of the $5 trillion agentic economy over the next decade? Mastercard Ant International Know Your Agent Agentic Commerce Cybersecurity Digital Wallets Artificial Intelligence Financial Technology Community reflections. Be the first to share your technical perspective on this article. No reader reflections yet. Share your reflection. Your email will remain private. Reader insights are reviewed by its team before publication. Verified Publication Minimum 10 characters Share reflection
Mastercard has partnered with Flowcart to enable secure card payments within social-messaging conversations. The service will launch in Kenya before expanding to other East African markets, South Africa, Nigeria, and Côte d'Ivoire. Flowcart allows merchants to accept payments through embedded links, QR codes, or native checkout flows without needing standalone websites or conventional point-of-sale terminals. Tokenised card details support repeat purchases. The partnership's success depends on converting cash sales or winning payments from other networks rather than simply shifting existing card transactions. However, widespread mobile-money use in Kenya may limit card adoption. For Mastercard, which reported second-quarter 2026 net revenue of $9.3 billion, the partnership would need substantial expansion to meaningfully impact finances. Commercial terms and expected payment values were not disclosed.
Ant International, Visa, and Mastercard launched the Know Your Agent framework on 10 September 2026 to verify agent identities in autonomous commerce. However, the system addresses operator traceability and certification but not consumer trust, which remains the binding constraint on the projected $3–5 trillion agentic commerce market. Consumer data reveals the gap. Klaviyo's 2026 report found 64% of consumers worry about AI handling their data, with only 13% trusting it completely. Accenture found 75% uncomfortable with AI making autonomous payments without human approval. Usercentrics reported only 9% would allow AI purchases above $25 without verification. Visa's $2.4 billion BioCatch acquisition in August 2026 signals a market shift towards behavioural verification. The technology monitors user interactions to build continuous profiles, moving beyond static identity to address whether agents behave within consumer authorisation.
Mastercard, Busha bring trusted digital asset transfers to Nigeria. September 10, 2026 Mastercard has partnered with Busha, a pan-African digital asset exchange, to expand Mastercard Crypto Credential across Africa and bring greater trust and simplicity to digital asset transfers. Effective immediately, all eligible Busha users in Nigeria are enabled to use a unique Crypto Credential alias, expanding the network of verified users and making it easier to send and receive cryptocurrency across participating exchanges and wallets in the Crypto Credential ecosystem. The partnership makes Busha among the first digital asset exchanges in Africa to enable Crypto Credential for its users, reinforcing both companies' commitment to making digital asset transactions more trusted, simpler, and more accessible. Mastercard Crypto Credential gives users greater confidence that funds are being directed to a trusted recipient by connecting them to endpoints that have met Mastercard verification standards. It also replaces lengthy blockchain addresses with a simple, verified alias that users can easily share to receive digital assets. Before a transaction is completed, the solution confirms that the recipient can receive the specific digital asset on the intended blockchain, reducing the likelihood of failed or misdirected transfers. Gabriel Swanepoel, division president, Africa at Mastercard, said: "Digital asset transfers should be as intuitive and trusted as other forms of digital payments. Mastercard Crypto Credential gives users and institutions greater confidence that they are sending funds to verified endpoints, while making transactions simpler through easy-to-use aliases. By partnering with Busha, one of Nigeria's leading digital asset platform, every verified Busha user is reachable simply using their email or phone number. Together, we are supporting responsible innovation and advancing secure, trusted digital asset infrastructure across Africa." The aliases work across participating exchanges and wallets within the Crypto Credential ecosystem, enabling Busha users to transact not only with one another but also with users on other supported platforms. As verification happens at the platform level, eligible verified Busha users do not need to complete any additional setup; their Crypto Credential is automatically issued as part of their Busha account. Speaking on the partnership, Michael Adeyeri, co-founder and CEO of Busha, said: "At Busha, we are focused on making digital assets more practical, accessible and trusted for everyday users, and our collaboration with Mastercard helps us achieve this. By enabling eligible users to transact using verified aliases, Mastercard Crypto Credential can make the experience simpler and more intuitive, while reinforcing the security and compliance standards that users expect from Busha. We are proud to help bring this capability to Nigeria and support the responsible growth of the digital asset ecosystem across Africa." As digital assets continue to gain momentum across Africa for investing, remittances, and cross-border commerce, trusted and easy-to-use infrastructure will be critical to accelerating mainstream adoption. The introduction of Mastercard Crypto Credential reflects Busha's broader mission to make digital finance more intuitive, accessible, and secure for everyday users. Enjoying our column? Delivery Preference: