D

DevSavant

Senior Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeNorth AmericaNo salary listed

About the Job

Requirements

  • At least 5 years of software engineering experience, including at least 3 years focused on data infrastructure or platform engineering.
  • Production pipeline experience in a modern cloud warehouse such as BigQuery, Snowflake, or Databricks, using dbt, SQL, or Spark and an orchestrator such as Dagster or Airflow.
  • Expertise with SQL and at least one general-purpose programming language, preferably Python, for building pipelines, custom integrations, automation scripts, and occasional web services.
  • Ability to independently navigate complex, unfamiliar systems to identify and fix difficult problems.
  • Ability to communicate proactively, consistently, and effectively with cross-functional teammates and stakeholders.
  • Understanding of the testability of data systems.
  • Ability to use artificial intelligence tools and automation pragmatically to improve work.

Responsibilities

  • Build, orchestrate, and maintain data pipelines on a Google Cloud Platform stack using BigQuery, dbt, PySpark, Parquet, and Dagster.
  • Develop a deep understanding of the partner's core data models to collaborate effectively with Data Science and Data Operations.
  • Partner with Data Science and Data Operations teams to maintain datasets that are trusted, well-understood, and enable self-service.
  • Work with cross-functional stakeholders to derive and define requirements.
  • Document, simplify, and explain complex problems to different types of audiences.
  • Establish best practices for developing specialized datasets for analytics and modeling.
  • Ensure the accuracy and scalability of Subscriber Metrics.
  • Own the reliability of data delivery and serve as the subject-matter expert for the delivery pipeline.

Desired Qualifications

  • Experience designing and implementing backend web services.
  • Experience managing cloud resources on Google Cloud Platform or Amazon Web Services using infrastructure-as-code tools such as Terraform, Pulumi, or CloudFormation.
  • Experience designing maintainable systems to solve challenging customer problems.
  • Industry experience with receipt, transaction, or viewership data.
  • Experience with data architecture and governance.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at DevSavant

See more jobs