C

Capgemini

Global consulting, technology services, outsourcing

Senior Engineer

Data EngineeringUpdated on Nov 14
Full-timeRemote in CanadaRemote

About the Job

Requirements

  • A bachelor's or master's degree in computer science, engineering, or a related technical field.
  • At least 5 years of professional software engineering or data engineering experience.
  • Strong hands-on experience with Apache, SQL, Python, and Scala.
  • Experience building distributed data processing applications.
  • Strong understanding of Hadoop ecosystem technologies, including Hive, Parquet, and HDFS.
  • Experience developing and optimizing ETL pipelines that process large-scale datasets.
  • Strong SQL programming and query optimization skills, and familiarity with Linux environments and shell scripting.
  • Experience using version control systems such as Git.

Responsibilities

  • Design, develop, and maintain scalable data processing applications using Apache and SQL.
  • Build high-performance ETL and data transformation pipelines using Python and Scala.
  • Develop and optimize batch and near-real-time data processing workflows.
  • Work with large-scale datasets stored in Parquet, Hive, and distributed storage systems.
  • Write efficient SQL queries and optimize execution plans for performance and scalability.
  • Design data models, partitioning strategies, and storage layouts to improve processing efficiency.
  • Collaborate with Data Engineers, Software Engineers, Data Scientists, and Product Teams to deliver data-driven solutions.
  • Implement automated testing, monitoring, and deployment processes for data applications.
  • Ensure data quality, reliability, security, and governance standards are met.

Desired Qualifications

  • Experience with AWS cloud platforms, distributed computing and large-scale data architecture, Airflow orchestration, and data lake and lakehouse environments.

About the Company

Capgemini

Global consulting, technology services, outsourcing

Capgemini provides consulting, technology services, and outsourcing to help organizations transform digitally. Its offerings include strategy and transformation consulting, system integration, application development, IT infrastructure management, and managed IT operations. It differentiates itself with a global presence in over 50 countries and a focus on applying AI, cloud, and cybersecurity to real business problems. Its goal is to help clients navigate digital transformation and improve efficiency and innovation through tailored, contract-based or managed services.

Company size
10,001+
Company stage
IPO
Headquarters
Paris, France
Founded
1967

Recently Posted Jobs

Explore more opportunities at Capgemini

See more jobs