A

Astronomer

Runs and monitors Apache Airflow data pipelines

Staff Software Engineer - Platform Infrastructure

Platform EngineeringUpdated on Nov 10
Full-timeNew York, NY, USAHybrid

About the Job

Requirements

  • Production platform systems experience at scale, including designing systems under load, reasoning about failure, and delivering foundational systems.
  • Practical distributed-systems knowledge, including consistency and availability tradeoffs, failure cascades, backpressure, graceful degradation, and non-abstract system design.
  • Kubernetes operator-level knowledge, including the scheduler and control loop, and experience operating clusters under real load.
  • Strong Go proficiency and experience building and shipping production systems in Go.
  • Multi-cloud experience making architectural decisions across AWS, GCP, and/or Azure and evaluating tradeoffs in production.
  • Experience influencing teams without authority by proposing changes, handling pushback, using evidence to change minds, and knowing when to escalate.
  • Hands-on generalist platform experience across several of Kubernetes, CI/CD, builds and releases, observability, networking, and secrets management.
  • Strong written and verbal communication, including writing design documents and postmortems, and experience working effectively in a globally distributed team.

Responsibilities

  • Own and develop the platform infrastructure strategy, map out platform needs, build the case, bring affected teams along, and own outcomes.
  • Participate directly in deciding what the team works on and how it works, and make and fulfill commitments.
  • Make build-versus-buy assessments and advocate for appropriate tools.
  • Create and maintain comprehensive internal documentation and decision records for systems and processes.
  • Participate in architectural forums and make principled, open decisions that the organization can learn from and hold the team accountable to.
  • Build foundational platform systems across the control plane, CI/CD, builds and releases, observability, secrets, and networking.
  • Write strategy documents and implement code to validate them; drive technical decisions and take responsibility for their consequences.

Desired Qualifications

  • Experience with storage primitives at the system level, including choosing between relational stores, object stores, and other options based on practical experience.
  • Experience working on a SaaS/PaaS product across multiple cloud providers.
  • Familiarity with Apache Airflow or workflow orchestration systems.

About the Company

Astronomer

Runs and monitors Apache Airflow data pipelines

Astronomer builds data orchestration software for engineering teams coordinating pipelines across databases, cloud services and business applications. Its Astro platform runs Apache Airflow, the open-source workflow system, as a managed service with tools for deploying and monitoring production workloads. Teams deploy workflow code, inspect pipeline health and trace how failing tasks affect downstream data, while managing projects across multiple teams and cloud environments. The company charges for deployments and worker compute, with enterprise plans and additional fees for observability and AI usage. Astronomer is headquartered in New York City.

Company size
201-500
Company stage
Series D
Total funding
$373.8M
Headquarters
New York City, New York
Founded
2018

Recently Posted Jobs

Explore more opportunities at Astronomer

See more jobs