C

Capgemini

Global consulting, technology services, outsourcing

Secure Data Engineer

Data EngineeringUpdated on Nov 16
Full-timeNo salary listed

About the Job

Requirements

  • Expert-level Python proficiency and strong software engineering foundations, including object-oriented design, automated testing and version control.
  • Experience building data pipelines with streaming frameworks, distributed processing engines, and relational or analytical storage such as Kafka, Spark and PostgreSQL.
  • Experience defining and running data workflows with orchestration frameworks such as Airflow, Dagster or Prefect.
  • Knowledge of data testing, documentation and lineage tools and techniques such as Great Expectations or dbt.
  • Experience operationalising machine learning in production, including model packaging, monitoring and controlled deployment, and understanding how GenAI and agentic systems serving differs, including evaluation, guardrails and observability for non-deterministic outputs.
  • Confidence deploying applications in containerised environments, including defining services, pods and deployment configurations using tools such as Docker and Kubernetes.
  • Hands-on CI/CD experience and ownership mindset for services built, using tools such as GitLab CI, GitHub Actions or Argo.
  • Hands-on experience delivering data pipelines and data platforms in production environments.
  • Must be eligible to obtain Security Check or Developed Vetting clearance. SC clearance requires continuous UK residence for the last five years, alongside other criteria.
  • Must be able to complete pre-employment checks for identity, nationality or immigration status, employment history covering three continuous years, and unspent criminal record.

Responsibilities

  • Develop modular, maintainable software components that process, transform and expose data for analytical, operational or AI-driven use cases, with testing and observability built in.
  • Design and implement data ingestion and event-driven patterns that support reliable real-time or near-real-time flows under demanding operational conditions.
  • Define data workflows programmatically and manage dependencies, scheduling and error recovery in secure, assured environments.
  • Package, deploy and monitor machine-learning, GenAI and agentic data workloads in assured environments, including self-hosted or open-weight models, retrieval-augmented generation, vector search over governed data, guardrails, evaluation and human oversight.
  • Containerise services and deploy them into secure Kubernetes or cloud environments using CI/CD principles adapted for Defence delivery; own applications in production and contribute to secure deployment patterns.
  • Implement health monitoring, structured logging, metrics and lineage for auditability, security and operational assurance, including observability for non-deterministic and agentic behaviour; design systems to self-heal or fail gracefully.
  • Provision service resources using Infrastructure as Code and work with platform teams to align with accredited Defence architectures.

Desired Qualifications

  • Experience with Infrastructure as Code or configuration management, such as Terraform or Ansible.
  • Experience in secure, restricted or air-gapped environments, including Defence networks or MODCloud-aligned platforms.
  • Familiarity with Google Distributed Cloud or other edge and on-premises platforms used in constrained or disconnected settings.
  • Exposure to GenAI and agentic building blocks such as retrieval-augmented generation, vector search, large language model orchestration, or large language model evaluation and observability.
  • Experience using AI coding assistants within strict data-handling and security boundaries, recognising that connected AI tooling may not be available on secure networks.
  • Depth in the Azure or Databricks track, including Azure Data Lake Storage, Databricks, Apache Spark, Delta Lake, Azure Data Factory, MLflow, Databricks Mosaic AI, Vector Search, Unity Catalog, Azure OpenAI, Azure AI Foundry or Azure AI Search.
  • Depth in the AWS track, including Glue, Lambda, Step Functions, Kinesis, EMR, Athena, Redshift, S3 data lakes, Amazon Bedrock or Knowledge Bases for Bedrock.

About the Company

Capgemini

Global consulting, technology services, outsourcing

Capgemini provides consulting, technology services, and outsourcing to help organizations transform digitally. Its offerings include strategy and transformation consulting, system integration, application development, IT infrastructure management, and managed IT operations. It differentiates itself with a global presence in over 50 countries and a focus on applying AI, cloud, and cybersecurity to real business problems. Its goal is to help clients navigate digital transformation and improve efficiency and innovation through tailored, contract-based or managed services.

Company size
10,001+
Company stage
IPO
Headquarters
Paris, France
Founded
1967

Recently Posted Jobs

Explore more opportunities at Capgemini

See more jobs