B

Boosters Team

Middle Data Engineer

Data EngineeringPosted on Nov 6
Full-timeNo salary listed

About the Job

Requirements

  • At least 2 years of commercial experience as a Data Engineer.
  • Confident Python skills for developing ETL/ELT processes, consumers, and integrations, and writing maintainable production code.
  • Strong SQL skills, including complex queries, window functions, optimization, and working with large datasets.
  • Experience with data warehouses and data modeling, including structuring data, incremental loads, and building and maintaining production pipelines.
  • Experience with cloud data platforms such as GCP or equivalent solutions.
  • Understanding of orchestration and event-driven pipelines using tools such as Airflow, Prefect, Dagster, Kafka, RabbitMQ, or Pub/Sub.
  • Understanding of data quality and observability, including monitoring, data quality controls, alerts, and troubleshooting.
  • Ownership and independence in identifying problems, proposing solutions, and implementing them.
  • Ability to explain technical solutions in clear language and collaborate with a team.
  • Product mindset focused on improving the reliability, speed, and efficiency of existing solutions.

Responsibilities

  • Maintain and develop data flows from RabbitMQ to the data warehouse and Amplitude or Reteno.
  • Connect new data sources, maintain existing sources, and develop ETL/ELT pipelines.
  • Own BigQuery and Airflow, manage access and service accounts, and maintain data streams and schemas.
  • Develop the Bronze → Silver → Gold architecture; work with partitioning, clustering, and materialized views; optimize schemas and queries.
  • Configure data freshness and completeness checks, SLA monitoring, and anomaly alerts; investigate incidents and identify root causes.
  • Develop pipelines for loading and updating data in Milvus, and work with indexes and data lifecycle for NLP systems.

Desired Qualifications

  • Experience with a vector database such as Milvus, Pinecone, Weaviate, or Qdrant.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Boosters Team

See more jobs