M

Mastercard

Processes payments across a global network

Lead Data Engineer

Data EngineeringUpdated on Nov 11
Full-timeDublin, IrelandNo salary listedIn-person

About the Job

Requirements

  • Strong expertise in designing and implementing large-scale data engineering solutions and distributed data processing systems.
  • Advanced proficiency with Databricks, Apache Spark, Delta Lake, SQL, and Python.
  • Experience building and operating cloud-based data platforms on Azure, AWS, or GCP.
  • Expertise developing enterprise-grade ETL/ELT pipelines, streaming architectures, and data integration frameworks.
  • Strong understanding of data modeling techniques for analytical and operational workloads.
  • Experience implementing data quality frameworks, lineage, metadata management, and governance practices.
  • Experience with data formats including Parquet, Avro, and ORC.
  • Working knowledge of CI/CD pipelines, infrastructure-as-code, automated testing, and DevOps practices.
  • Experience with workflow orchestration tools such as Airflow.
  • Strong understanding of security, privacy, and compliance requirements associated with sensitive financial and customer data.
  • Proven ability to lead technical initiatives across multiple teams and influence engineering direction without direct authority.
  • Knowledge of Java-based application development is a plus.
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or a related STEM discipline, or an alternative minimum of 10 years of experience in a related field.

Responsibilities

  • Lead the design, development, and evolution of enterprise-grade data platforms and pipelines supporting credit risk products, decisioning capabilities, and analytics solutions.
  • Architect and implement scalable ETL/ELT frameworks using Databricks, Spark, Delta Lake, and cloud-native technologies.
  • Establish data quality, lineage, governance, observability, and monitoring capabilities to ensure trusted and compliant data products.
  • Drive the migration and modernization of legacy data assets into cloud-based architectures and Data Lakehouse platforms.
  • Partner with Risk, Product, Architecture, and Engineering teams to translate business requirements into scalable technical solutions.
  • Define and promote engineering standards, coding practices, testing frameworks, data quality frameworks, deployment automation, and operational excellence across the data ecosystem.
  • Lead technical design reviews and influence architectural direction for data-intensive applications and services.
  • Optimize large-scale data processing workloads for performance, reliability, scalability, and cost efficiency.
  • Enable AI and advanced analytics initiatives through creation of high-quality, reusable, governed data products.
  • Mentor, coach, and raise the technical capability of engineers across the organization by fostering ownership, continuous learning, accountability, and engineering excellence.
  • Shape strategic roadmap planning, technology evaluation, and delivery priorities across the ECR portfolio, balancing business outcomes, engineering feasibility, risk, compliance, and long-term platform sustainability.
  • Support regulatory, compliance, security, and audit requirements through robust engineering controls and documentation.
  • Own complex problems with dependencies across multiple services and facilitate cross-functional collaboration to drive resolution.
  • Conduct technical interviews, assess engineering talent, and contribute to raising the overall performance bar of the organization.
  • Lead by influence across engineering, product, risk, analytics, and architecture teams to align priorities and deliver measurable business outcomes.
  • Create clarity in complex, ambiguous environments by translating business needs into actionable technical direction and execution plans.
  • Develop engineering talent through mentoring, knowledge sharing, design guidance, and constructive feedback.
  • Promote a high-accountability culture focused on quality, reliability, security, compliance, and continuous improvement.
  • Communicate effectively with senior stakeholders and clearly articulate trade-offs, risks, dependencies, and delivery progress.

Desired Qualifications

  • Preferred expertise in Databricks, Apache Spark/PySpark, Hadoop, Delta Lake, SQL, and Python.

About the Company

Mastercard

Processes payments across a global network

Mastercard operates a global payment network connecting financial institutions, merchants, businesses and consumers. It authorizes, clears and settles transactions between participating institutions, while banks issue Mastercard-branded cards and extend credit to their customers. Its services also include fraud detection, identity verification, payment tokenization, data analysis and consulting for organizations managing commerce and financial operations. The company earns network fees linked to payment volumes and processed transactions, along with fees for its services and solutions. Founded by a group of banks in 1966, Mastercard is headquartered in Purchase, within Harrison, New York.

Company size
10,001+
Company stage
IPO
Headquarters
Town of Harrison, New York
Founded
1966

Recently Posted Jobs

Explore more opportunities at Mastercard

See more jobs