Full-Time
Senior Software Engineer
Observability
Confirmed live in the last 24 hours
Astronomer
201-500 employees
Data orchestration platform for pipeline management
Compensation Overview
$180k - $210kAnnually
Senior
Remote in USA
You match the following Astronomer's candidate preferences
Employers are more likely to interview you if you match these preferences:
- A strong focus on helping customers gain more visibility and actionable insights through our observability offerings.
- Strong written and verbal communication skills, with the ability to find middle ground.
- 5+ years of engineering experience.
- Experience with fast-paced startup environments.
- Experience with Golang.
- Experience with SQL and OLAP databases.
- Experience with distributed systems and stream processing.
- Experience with software development best practices, such as code reviews, testing, CI/CD, version control, automation and debugging.
- Contribute to the design, development and vision of Astro’s data observability platform.
- Collaborate with cross-functional teams to understand user requirements, implement and iterate on the observability and governance features to help our customers gain visibility into their data pipelines and data products.
- Continuously evaluate and improve the architecture and implementation of our observability platform.
- Contribute to the overall platform usability, reliability, and scalability.
- Experience with data observability products.
- Experience with Apache Airflow or related workflow orchestrators
Astronomer.io provides a data orchestration platform that utilizes Apache Airflow to simplify the deployment of data pipelines. Its main product, Astro, helps businesses manage and monitor their data flows, allowing them to focus on delivering essential data pipelines. The platform supports data unification across various clouds and offers over 1500 integrations, making it suitable for data and machine learning teams in industries like finance and e-commerce. Astronomer.io distinguishes itself from competitors by offering enterprise-grade security, tools for monitoring pipeline health, and the ability to upgrade Airflow without downtime. The company's goal is to enhance compute efficiency, minimize delays in task scheduling, and accelerate the development and deployment of data pipelines, ultimately providing a strong return on investment for its clients.
Company Size
201-500
Company Stage
Series C
Total Funding
$272.1M
Headquarters
Cincinnati, Ohio
Founded
2018
Simplify's Take
What believers are saying
- Astronomer's revenue grew over 200% in H1 2023, indicating strong market demand.
- Collaboration with Microsoft Azure enhances Astronomer's cloud-native data orchestration capabilities.
- Integration with Anyscale boosts Astronomer's offering for scalable machine learning workflows.
What critics are saying
- Increased competition from platforms like Prefect and Dagster poses a market challenge.
- Over-reliance on Apache Airflow could be risky if community focus shifts.
- Rapid AI advancements may outpace Astronomer's feature integration, risking client dissatisfaction.
What makes Astronomer unique
- Astronomer offers Astro, a modern data orchestration platform powered by Apache Airflow.
- Astro enables data teams to build, run, and observe data pipelines-as-code efficiently.
- Astronomer provides enterprise-grade security and over 1500 integrations for data unification.
Help us improve and share your feedback! Did you find this helpful?
Benefits
Remote Work Options
Company Equity
Growth & Insights and Company News
6 month growth
↑ 0%1 year growth
↑ 0%2 year growth
↓ -7%This partnership allows organizations to effectively manage and scale their ML workflows by integrating Astronomer's workflow management capabilities with Anyscale's distributed computing power.
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More. Getting data from where it is created to where it can be used effectively for data analytics and AI isn’t always a straight line. It’s the job of data orchestration technology like the open-source Apache Airflow project to help enable a data pipeline that gets data where it needs to be.Today the Apache Airflow project is set to release its 2.10 update, marking the project’s first major update since the Airflow 2.9 release back in April. Airflow 2.10 introduces hybrid execution, allowing organizations to optimize resource allocation across diverse workloads, from simple SQL queries to compute-intensive machine learning (ML) tasks. Enhanced lineage capabilities provide better visibility into data flows, crucial for governance and compliance
To support these new use-cases and to provide a starting point for Airflow users, Astronomer has worked with the Airflow Community to create Ask Astro-as a public reference implementation of RAG with Airflow for conversational AI.
Are you ready to bring more awareness to your brand? Consider becoming a sponsor for The AI Impact Tour. Learn more about the opportunities here. Getting data to and from different systems is often the domain of data orchestration. It is among the most widely used tools in the open-source Apache Airflow technology, originally created by Airbnb.Today Astronomer, the lead commercial sponsor behind the Apache Airflow project is out with its latest Astro platform update, providing enterprise support, security and management enhancements. While Airflow got its start helping with the orchestration of data pipelines for data analytics and business intelligence, the technology is now increasingly being used in support of artificial intelligence (AI) and machine learning (ML) workloads.“Airflow is very good at a couple of things, one is just basically writing and running data pipelines,” Julian LaNeve, CTO at Astronomer told VentureBeat. “Airflow lets you define pipelines as code, so you can do anything that the code will let you do which is essentially boundless.” Why Airflow is critical for modern data orchestrationLaNeve explained that Airflow has become popular in recent years as it enables organizations to define, build and deploy data pipelines more easily
An Azure Native ISV Service, Astro is now seamlessly embedded into the Azure cloud platform, empowering users with cloud-native data orchestration capabilitiesSAN FRANCISCO and CINCINNATI, Nov. 15, 2023 /PRNewswire/ -- Astronomer , a provider of modern data orchestration, today announced that its Astro platform is now available as Apache Airflow™ on Astro – an Azure Native ISV Service. Astro enables companies to place Airflow at the core of their data operations, providing ease of use, scalability, and enterprise-grade security, to ensure the reliable delivery of mission-critical data pipelines. As a first-class managed service in the Azure Portal, developers can create an Airflow instance with just a few clicks, access an extensive library of pre-built integrations, and easily coordinate all data operations from Astro's unified data platform.As organizations transition from siloed data workflows, teams, and tools to unified data orchestration, they encounter challenges in adopting and managing modern data processes. This can impede their ability to keep critical applications running, or harness data to meet business demands. With Astro's streamlined integration on Azure, organizations can effortlessly deploy, monitor, and scale Apache Airflow workflows
It's since been released as a Linux Foundation project seeing strong developer growth over the past year particularly amongst users who rely upon Airflow and as of October 2023 Grai is happy to announce Grai has rolled out alpha support for OpenLineage in Grai!
SAN FRANCISCO and CINCINNATI, Sept. 14, 2023 /PRNewswire/ -- Astronomer, the leader in modern data orchestration, introduces new capabilities to Astro, its Apache Airflow-powered platform.
As platform adoption surges to meet the needs of increasingly complex data workflows, company unveils expanded leadership team with strong hypergrowth track recordSAN FRANCISCO and CINCINNATI, Sept. 7, 2023 /PRNewswire/ -- Astronomer , the leader in modern data orchestration, announced today a 206% year-over-year growth in revenue for 'Astronomer's Astro'. Additionally, in-product usage of its Apache Airflow-powered platform surged by more than 1,400 percent in the first half of 2023. As data pipelines have become pivotal to key business outcomes, companies depend on Airflow and Astro as the backbone of their innovations. Organizations around the world, including Condé Nast, Electronic Arts, FanDuel, and many more, have implemented Astro to power their data pipelines, fueling the analytics and operational platforms that drive revenue for businesses.Over the past year, Apache Airflow has continued to gain immense popularity as a versatile and scalable platform for orchestrating complex data workflows. Its rise is attributed to the increasing demand for big data and data engineering tasks, where businesses require dynamic, extensible, and code-driven solutions to schedule, coordinate, and monitor data pipelines
To date, Astronomer, founded in 2018, has raised over $282 million in financing, according to CrunchBase.