C

Capgemini

Global consulting, technology services, outsourcing

Data Engineer

Data EngineeringUpdated on Nov 14
Full-timeVila Nova de Gaia, PortugalNo salary listed

About the Job

Requirements

  • Good understanding of end-to-end data engineering, data quality, and data lifecycle management.
  • Experience working with data contracts, stakeholder collaboration, and analytics-driven use cases.
  • Proficiency in Python or Scala and SQL for production data pipelines.
  • Practical experience with Spark, Delta Lake and Databricks, including basic performance optimisation.
  • Experience with batch pipelines and at least one of change data capture or streaming patterns.
  • Practical experience with Azure data services, including Azure Data Factory.
  • Experience with automated data-quality testing and pipeline monitoring.
  • Working knowledge of Git, CI/CD and code review.
  • Working knowledge of Unity Catalog or comparable data-governance and access-control tooling.

Responsibilities

  • Build and maintain batch, CDC, and streaming data pipelines across SAP, Kafka, APIs, and databases.
  • Develop scalable data solutions using Azure Data Factory, Databricks, Spark, SQL, and Delta Lake.
  • Implement data quality, monitoring, observability, alerting, and data contract controls.
  • Optimize pipeline performance, cost efficiency, and security through Unity Catalog.
  • Contribute reusable frameworks, CI/CD processes, and data engineering best practices.
  • Collaborate with DataOps, ML Engineering, AI, Analytics Engineers, and cross-functional teams.
  • Deliver trusted, curated data to support analytics and AI products.
  • Participate in code reviews and support continuous improvement initiatives.

Desired Qualifications

  • Experience with SAP, high-volume transactional data, and data mesh principles.
  • Confluent Kafka, Spark Structured Streaming or comparable streaming frameworks.
  • SAP S/4HANA, BW and Business Data Cloud extraction and data structures.
  • Document processing, embeddings and vector indexes for AI retrieval.

About the Company

Capgemini

Global consulting, technology services, outsourcing

Capgemini provides consulting, technology services, and outsourcing to help organizations transform digitally. Its offerings include strategy and transformation consulting, system integration, application development, IT infrastructure management, and managed IT operations. It differentiates itself with a global presence in over 50 countries and a focus on applying AI, cloud, and cybersecurity to real business problems. Its goal is to help clients navigate digital transformation and improve efficiency and innovation through tailored, contract-based or managed services.

Company size
10,001+
Company stage
IPO
Headquarters
Paris, France
Founded
1967

Recently Posted Jobs

Explore more opportunities at Capgemini

See more jobs