S

Softeta

Senior Data Engineer

Data EngineeringUpdated on Nov 17
Full-timeKraków, PolandNo salary listedRemote

About the Job

Requirements

  • Deep hands-on experience with Airflow, Spark, dbt, BigQuery, and Python.
  • A proven track record of leading a live pipeline migration technically from conception to completion.
  • Hands-on experience refactoring production pipelines while verifying identical output.
  • Demonstrated success establishing engineering best practices, including testing, code reviews, and incident resolution, within a team.
  • Concrete mentoring or technical leadership experience.

Responsibilities

  • Propose and lead the architecture for user-data workflows across Airflow, Spark, dbt, and BigQuery, including encryption points, derived tables, backfills, and partitions.
  • Sequentially migrate existing pipelines behind a custom regression harness to guarantee identical output.
  • Establish lasting engineering standards post-migration, including code reviews, testing protocols, incident post-mortems, and release checklists.
  • Implement verification jobs to validate end-to-end data lifecycle rules.
  • Participate in pipeline maintenance, incident response, and root-cause resolution.
  • Document design choices using Architecture Decision Records (ADRs).

Desired Qualifications

  • Previous experience with encryption at rest, data retention policies, or regulatory compliance such as GDPR.
  • Experience with envelope encryption using key management services (GCP KMS), BigQuery AEAD functions, or Tink.
  • Experience with BigQuery column-level security, policy tags, and Google Cloud Data Catalog.
  • Experience with event-driven architectures using Apache Kafka.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Softeta

See more jobs