C

Capgemini

Global consulting, technology services, outsourcing

Data Engineer - Databricks

Data EngineeringUpdated on Nov 14
Full-timeRemote in MexicoNo salary listed

About the Job

Requirements

  • Strong hands-on experience with Python, Databricks, Apache Spark, and PySpark.
  • Experience building and supporting production-grade ETL/ELT data pipelines.
  • Strong SQL skills and experience with data modeling, data transformation, and data quality practices.
  • Experience working with Delta Lake and Lakehouse architectures.
  • Experience integrating data from databases, APIs, files, and cloud storage, with understanding of Git, CI/CD, testing, and engineering best practices.

Responsibilities

  • Design, develop, and maintain scalable ETL/ELT data pipelines using Python and Databricks.
  • Develop data processing and transformation solutions using Spark and PySpark.
  • Build, optimize, and maintain Databricks notebooks, workflows, and jobs.
  • Integrate data from multiple sources, including databases, APIs, files, and cloud storage, while performing data cleansing, enrichment, and validation activities.
  • Optimize data pipelines and Spark workloads for performance, scalability, reliability, monitoring, logging, and troubleshooting.
  • Collaborate with analysts, developers, architects, and business teams while participating in code reviews, testing, documentation, CI/CD, and production support activities.

About the Company

Capgemini

Global consulting, technology services, outsourcing

Capgemini provides consulting, technology services, and outsourcing to help organizations transform digitally. Its offerings include strategy and transformation consulting, system integration, application development, IT infrastructure management, and managed IT operations. It differentiates itself with a global presence in over 50 countries and a focus on applying AI, cloud, and cybersecurity to real business problems. Its goal is to help clients navigate digital transformation and improve efficiency and innovation through tailored, contract-based or managed services.

Company size
10,001+
Company stage
IPO
Headquarters
Paris, France
Founded
1967

Recently Posted Jobs

Explore more opportunities at Capgemini

See more jobs