A

Astronomer

Runs and monitors Apache Airflow data pipelines

Principal Software Engineer

Backend EngineeringConfirmed live in the last 24 hours
Full-timeNew York, NY, USAHybrid

About the Job

Requirements

  • At least 10 years of professional software engineering experience, with a significant track record at Staff, Senior Staff, or Principal level within enterprise infrastructure, database-as-a-service, or private cloud organizations.
  • Proven success building production-grade infrastructure control planes and deep understanding of API design principles for programmatic customer workflows and user interfaces.
  • Practical experience designing and implementing infrastructure observability stacks such as Prometheus, OpenTelemetry, and Grafana for isolated environments.
  • Operational knowledge and architectural understanding of Kubernetes; practical experience building custom Kubernetes Operators and Custom Resource Definitions, managing Helm deployments, and using the Kubernetes API to orchestrate application lifecycles.
  • Hands-on systems design expertise involving isolated environments across multiple public cloud providers (AWS, GCP, Azure), Red Hat OpenShift enterprise deployments, and bare-metal on-premises infrastructure.
  • Expert-level software development skills in languages such as Go, Python, or TypeScript; deep knowledge of distributed state stores such as Etcd, Consul, or PostgreSQL, concurrency, and network security patterns.
  • Ability to author concise technical one-pagers and actionable RFCs, present to executive leadership, and engage strategic enterprise clients to identify infrastructure requirements.

Responsibilities

  • Own the end-to-end definition, design, and implementation of control plane and data plane services, including resilient interconnections for the self-contained infrastructure platform.
  • Drive the design, data modeling, versioning, and long-term backward compatibility of platform APIs such as REST or gRPC that power the customer-facing UI and programmatic integrations.
  • Architect the platform telemetry framework for metrics, logs, and traces, providing visibility into core control plane services and the performance, health, and status of provisioned Airflow instances.
  • Oversee platform architecture so services, images, dependencies, and configurations work in connected private clouds and zero-egress networks.
  • Translate enterprise infrastructure needs into execution roadmaps and align with product management and executive stakeholders.
  • Foster engineering and operational excellence through design reviews, high-leverage code contributions, and career mentorship for senior engineers.

About the Company

Astronomer

Runs and monitors Apache Airflow data pipelines

Astronomer builds data orchestration software for engineering teams coordinating pipelines across databases, cloud services and business applications. Its Astro platform runs Apache Airflow, the open-source workflow system, as a managed service with tools for deploying and monitoring production workloads. Teams deploy workflow code, inspect pipeline health and trace how failing tasks affect downstream data, while managing projects across multiple teams and cloud environments. The company charges for deployments and worker compute, with enterprise plans and additional fees for observability and AI usage. Astronomer is headquartered in New York City.

Company size
201-500
Company stage
Series D
Total funding
$373.8M
Headquarters
New York City, New York
Founded
2018

Recently Posted Jobs

Explore more opportunities at Astronomer

See more jobs