C

Capgemini

Global consulting, technology services, outsourcing

Senior Data Engineer

Data EngineeringUpdated on Nov 14
Full-timeVila Nova de Gaia, PortugalNo salary listed

About the Job

Requirements

  • Strong experience with Python or Scala, advanced SQL, Spark, Delta Lake, and Databricks for scalable data engineering solutions.
  • Experience with batch, change data capture (CDC), and streaming data pipelines, leveraging Azure Data Factory and related Azure data services.
  • Strong knowledge of data quality, monitoring, observability, alerting, continuous integration and continuous delivery (CI/CD), Git, and Unity Catalog.
  • Strong understanding of source-aligned data engineering, data quality, governance, and producer-consumer data models.
  • Experience working with cross-functional stakeholders in complex data and artificial intelligence environments.
  • Excellent collaboration, communication, and stakeholder management skills.
  • Strong problem-solving, prioritization, and decision-making capabilities in fast-paced environments.

Responsibilities

  • Own and develop end-to-end data ingestion and processing pipelines across multiple sources, including SAP, Kafka, APIs, and databases.
  • Build scalable data solutions using Azure Data Factory, Databricks, Spark, SQL, Delta Lake, and Unity Catalog.
  • Implement and manage data quality, observability, monitoring, alerting, and data contract enforcement.
  • Design performant, cost-efficient, and reusable data engineering frameworks and components.
  • Maintain CI/CD pipelines and collaborate with DataOps, machine learning engineering, artificial intelligence, and analytics teams.
  • Support analytics and artificial intelligence use cases through delivery of trusted, curated data products.
  • Mentor Data Engineers, perform code reviews, and collaborate with cross-functional product teams.
  • Mentor team members, share knowledge, and provide technical leadership.

Desired Qualifications

  • Experience with SAP, high-volume transactional data, and data mesh principles.
  • Experience with Kafka, Spark Structured Streaming, SAP S/4HANA, BW, BDC, and artificial-intelligence-related data technologies such as embeddings, vector databases, and document processing.

About the Company

Capgemini

Global consulting, technology services, outsourcing

Capgemini provides consulting, technology services, and outsourcing to help organizations transform digitally. Its offerings include strategy and transformation consulting, system integration, application development, IT infrastructure management, and managed IT operations. It differentiates itself with a global presence in over 50 countries and a focus on applying AI, cloud, and cybersecurity to real business problems. Its goal is to help clients navigate digital transformation and improve efficiency and innovation through tailored, contract-based or managed services.

Company size
10,001+
Company stage
IPO
Headquarters
Paris, France
Founded
1967

Recently Posted Jobs

Explore more opportunities at Capgemini

See more jobs