About the role
Astronomer empowers data teams to bring mission-critical software, analytics, and AI to life and is the company behind Astro, the industry-leading unified DataOps platform powered by Apache Airflow®. Astro accelerates building reliable data products that unlock insights, unleash AI value, and powers data-driven applications. Trusted by more than 800 of the world's leading enterprises, Astronomer lets businesses do more with their data. To learn more, visit www.astronomer.io . About this role Apache Airflow is one of the most popular open-source data platform tools. It powers the data platforms at nearly every large company and fast-growing startups: Airbnb, Uber, OpenAI, Anthropic, Nike, Capital One, Disney all use Airflow extensively. At Astronomer, we’re the largest contributors to the project and are building commercial products around Airflow to make it easier to use, run, and scale. We’re in a unique position: as the company behind Apache Airflow, we see data as it moves across entire organizations—from raw ingestion to production dashboards, machine learning models, and AI products. Leveraging this vantage point, our R&D team is developing a global context layer for data—an intelligence layer that powers search and discovery, code generation for data and analytics, and automated root cause analysis. LLMs are already quite good at writing Python and SQL code against data platforms; we think this context layer will give them the metadata necessary for data practitioners everywhere to use LLMs effectively. As a Software Engineer on this team, you’ll help design and build this foundation and the applications around it. You’ll work on some of the hardest and most exciting challenges in data—search, information retrieval, and AI for data pracitioners—while collaborating with a small, highly skilled team that values velocity, creativity, and impact. This role sits at the intersection of applied research, software engineering, and product: we think it takes someone who can work across the stack to build, release, and scale products successfully in this space. Hybrid Work Model: For this role, you will embrace a flexible hybrid work model with at least 3 days per week in our New York City office . What you get to do: Shape the future of AI for data engineering - build intelligent systems that understand, reason about, and optimize the flow of data across entire organizations. Design and engineer the brain of Astronomer’s context layer , crafting components that power data modeling, semantic search, retrieval, and code generation. Push the boundaries of applied AI - experiment with LLMs, embeddings, and cutting-edge retrieval techniques to create developer tools that deliver insights to you and our customers. Turn research into reality - work side by side with R&D and product teams to bring early AI concepts to life in the product experience. Solve high-impact information retrieval and search challenges at a global scale , leveraging Astronomer’s unparalleled visibility into data pipelines across industries. Influence the technical vision and architecture for the next generation of AI-driven data products. Represent Astronomer in the community - through open-source contributions, technical talks, and publications that showcase our leadership in AI and data innovation. What you bring to
