C

Capco

Advises banks, insurers and energy companies

GCP Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • At least 8 years of hands-on experience in GCP data engineering, designing, building, and supporting distributed systems and large-scale data processing systems in production.
  • Expertise in GCP data products such as BigQuery, Dataflow, Cloud Storage, Pub/Sub, Cloud Composer, and Apache Kafka.
  • Hands-on experience building batch and streaming data pipelines on Google Cloud.
  • Strong commercial or industry coding and scripting experience in Python, SQL, Java, Scala, or Go, with strong SQL ability to write complex queries.
  • Strong working experience with operational data stores, data warehouses, big data technologies, and data lakes.
  • Experience using distributed frameworks such as Spark, Flink, Beam, and Hadoop.
  • Knowledge of containers such as Docker and Kubernetes, and experience with cloud platforms such as GCP, Azure, or AWS.
  • Experience with real-time streaming technologies such as Kafka.
  • Experience with automation and continuous integration and continuous delivery (CI/CD) tools, including Jenkins, GitHub, and Spinnaker.
  • Understanding of data structures, algorithms, software design, design patterns, and core programming concepts.
  • Competence in client handling and leading a feature team to deliver outcomes.

Responsibilities

  • Design, build, and support distributed systems and large-scale data processing systems in production.
  • Build batch and streaming data pipelines on Google Cloud.
  • Lead the feature team to deliver outcomes.

Desired Qualifications

  • GCP Cloud Architect, Cloud Developer, or Professional Data Engineer certification.
  • Apache Kafka certification (CCDAK).

About the Company

Capco

Advises banks, insurers and energy companies

Capco advises banks, payment companies, insurers, asset managers, and energy firms on strategy, regulation, and technology, and unlike generalist consultancies it sticks to finance and energy. In 2021, Capco became the largest acquisition in the history of Indian IT services company Wipro, which bought it to expand its consulting for banks. Clients hire Capco teams to redesign operations, comply with regulations, modernize payment and trading systems, and adopt AI under strict risk controls, while its engineers build the software behind those changes. Clients pay for consultants' time or a fixed project price, and Capco staff often work on site with client teams. Capco was founded in Belgium in 1998 and is based in London.

Company size
5,001-10,000
Company stage
Acquired
Total funding
$80M
Headquarters
London, United Kingdom
Founded
1998

Recently Posted Jobs

Explore more opportunities at Capco

See more jobs