C

Capgemini

Global consulting, technology services, outsourcing

Data Engineer (Python)

Data EngineeringPosted on Nov 13
Full-timeNo salary listed

About the Job

Requirements

  • Strong hands-on experience with Python, including developing production-grade software, data pipelines, APIs, and automation solutions.
  • Experience designing and implementing ETL/ELT pipelines and scalable data processing solutions.
  • Good knowledge of SQL, data modeling, query optimization, and relational databases.
  • Experience with cloud-based data platforms and modern data architectures such as AWS, Azure, or GCP.
  • Hands-on experience with Apache Airflow or similar workflow orchestration platforms.
  • Experience working with Kafka or other event-driven and streaming technologies.
  • Strong Linux fundamentals and experience supporting production environments.
  • Familiarity with CI/CD practices, automated testing, Git workflows, and modern software delivery processes.
  • Strong debugging, troubleshooting, and problem-solving capabilities.
  • Ability to work independently and collaborate effectively within cross-functional teams.

Responsibilities

  • Design, build, and maintain scalable ETL/ELT pipelines and data workflows.
  • Develop and support batch and real-time streaming data solutions.
  • Improve platform reliability, monitoring, observability, and overall performance.
  • Build integrations between internal systems, cloud services, external platforms, and connected IoT devices.
  • Collaborate with software engineers, analysts, and platform teams to troubleshoot production issues and deliver new data capabilities.
  • Participate in technical design discussions, automation initiatives, CI/CD pipelines, and engineering best practices to ensure high-quality data services.

Desired Qualifications

  • Experience with ClickHouse, Redshift, Snowflake, or other data warehousing technologies.
  • Experience with Spark or PySpark.
  • Experience with Terraform, Infrastructure as Code, and cloud automation.
  • Knowledge of Docker and Kubernetes.
  • Experience supporting large-scale production data platforms.
  • Experience with AI/ML data pipelines, feature stores, or machine learning infrastructure.
  • Knowledge of data governance, data quality frameworks, and metadata management.

About the Company

Capgemini

Global consulting, technology services, outsourcing

Capgemini provides consulting, technology services, and outsourcing to help organizations transform digitally. Its offerings include strategy and transformation consulting, system integration, application development, IT infrastructure management, and managed IT operations. It differentiates itself with a global presence in over 50 countries and a focus on applying AI, cloud, and cybersecurity to real business problems. Its goal is to help clients navigate digital transformation and improve efficiency and innovation through tailored, contract-based or managed services.

Company size
10,001+
Company stage
IPO
Headquarters
Paris, France
Founded
1967

Recently Posted Jobs

Explore more opportunities at Capgemini

See more jobs