C

Cribl

Data observability platform for logs

Staff Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeCalifornia, USANo salary listed

About the Job

Requirements

  • Deep expertise in Snowflake, including advanced data modeling, query and warehouse performance tuning, cost management, and security and role-based access control design.
  • Experience as a technical lead or staff-level engineer setting direction, driving architecture, and delivering complex systems across a team.
  • Ability to work across data, engineering, and business teams and lead through influence.
  • Track record of growing junior and mid-level engineers through coaching, review, and pairing.
  • Strong Python and SQL fundamentals, with solid extract, load, and transform patterns and data modeling experience.
  • Hands-on experience operating self-hosted or self-managed orchestration; Prefect is strongly preferred, while equivalent experience running Airflow or Dagster on one's own infrastructure is acceptable. Must be comfortable owning upgrades, workers, and operational footprint, not only writing DAGs or flows.
  • Hands-on AWS and infrastructure-as-code experience building cloud infrastructure with Terraform or equivalent using predictable, maintainable patterns.
  • Experience building cloud applications or backend services, including APIs, ingestion services, and event-driven workflows.
  • Production-grade engineering practices including logging, alerting, versioning, and continuous integration and continuous delivery.
  • Fluency building with AI-assisted development platforms such as Claude Code, with demonstrated ability to use them to accelerate delivery.

Responsibilities

  • Serve as technical lead for the Data Engineering team, owning architecture and design decisions for core data systems and driving reliable, production-grade outcomes.
  • Partner with Data Analysts, site reliability engineers, IT Engineers, and business teams to clarify requirements, validate outputs, and proactively communicate risks, tradeoffs, and timelines.
  • Own and operate the self-hosted orchestration platform, including the self-managed Prefect deployment and its build and worker system; manage operational hygiene, upgrades, and cost and footprint tradeoffs of a hybrid, self-hosted model.
  • Own the Snowflake environment as subject-matter expert on data modeling, performance, and cost optimization; own role-based access control and permissions design, permissions tooling, and governance.
  • Build, operate, and monitor data pipelines, ingestion services, integrations, and the warehouse, ensuring data is accurate, timely, and trusted, with logging, alerting, and observability as first-class concerns.
  • Advance the dbt practice, including the in-flight dbt Fusion migration, and own warehouse cost and performance at scale.
  • Develop cloud-native services and infrastructure on AWS, including ingest and API services, event-driven ingestion, upsert patterns, package reuse, and supporting infrastructure-as-code.
  • Advance the infrastructure-as-code practice using Terraform or similar by building reusable modules, clean deployment patterns, continuous integration integration, and strong operational hygiene, including self-hosted and hybrid deployment patterns.
  • Partner with the Data Engineering manager to set technical direction, shape the platform roadmap and engineering standards, and evaluate build-versus-buy and architectural tradeoffs.
  • Mentor and grow data engineers through code review, pairing, design feedback, and coaching to develop junior and mid-level engineers.
  • Support data science and agentic initiatives by preparing model-ready datasets, exposing features, and integrating AI and large language model workflows into production.
  • Contribute to secure, compliance-minded engineering practices in collaboration with IT and Security.

Desired Qualifications

  • Prefect orchestration experience is strongly preferred; equivalent hands-on experience running Airflow or Dagster on one's own infrastructure is acceptable.

About the Company

Cribl

Data observability platform for logs

Cribl helps tech teams manage and understand their data through data observability. Its two main products, Cribl Stream and Cribl Edge, collect, route, transform, and analyze logs, metrics, and other observability data. Edge gathers real-time data from network edge devices, sending it to Stream or other destinations for processing. Stream routes and transforms data on-premises or in the cloud and forwards it to destinations, with integrations like Office 365 and Microsoft Azure to monitor activity and security. The goal is to give teams real-time visibility into data, improve operational efficiency, and strengthen security by managing data flows and observability insights.

Company size
1,001-5,000
Company stage
Private
Total funding
$596.4M
Headquarters
San Francisco, CA
Founded
2018

Recently Posted Jobs

Explore more opportunities at Cribl

See more jobs