Senior AI Software Engineer

Aleph Alpha Research’s mission is to deliver AI innovation that enables open, accessible, and trustworthy deployment of GenAI in government and enterprise applications. Our organization develops foundational models and next-generation methods that make it easy and affordable for Aleph Alpha’s customers to increase productivity in finance, administration, R&D, logistics, and manufacturing processes. We do this with a flat hierarchy and IC-driven culture: ideas come from the bottom up, and it’s our shared responsibility to deliver impactful research.

The position:

We’re looking for skilled (Senior) Software Engineers to join our research team, headquartered in Heidelberg. While we highly value in-person work, we offer the flexibility to work from Berlin or elsewhere in Germany and with regular travel to onsite events.

This job posting reflects multiple openings across our research teams; during our interview process, we will align your candidacy both in terms of team/focus assignment, but also according to seniority (Mid- --> Staff- level).

As a (Senior) AI Software Engineer in Aleph Alpha Research, you help the research teams train models and iterate on cutting-edge ideas. You own significant portions of the research infrastructure, including data processing pipelines, our model lineage tooling, our testing infrastructure, our cluster management systems and engineering-heavy parts of our distributed training software.

We build and train large-scale models using Python and PyTorch. Our infrastructure runs in our own data centre on Kubernetes, managed by a dedicated team. You'll work on systems that handle petabytes of data and contribute to optimising our distributed training software to run efficiently over entire clusters. This is high-scale, high-impact engineering.

Your responsibilities:

You can expect to contribute to the following areas:

• Design and develop tooling to accelerate research

• Collaborate with researchers to develop, train, persist and evaluate deep learning models

• Deep-dive on performance-critical code to enable efficient training at scale

• Improve our data ingestion and processing pipelines and help curate state-of-the-art datasets

• Set up systems to ensure our codebases are maintainable

• Collaborate with our Product team to bring AI research innovations into real-world applications

• Contribute to papers and technical reports and help present them at top international AI conferences

• Mentor engineers and researchers in your areas of software engineering expertise

• Engage in our hiring process to identify talented engineers to join our team

• Co-own efforts to make code, data and model artefacts available to the broader research community

Your profile

In Aleph Alpha Research, we hire deliberately. We recognise that we need top talent to deliver top research, and we value ability over experience: if you think you would be a good fit for this role, we’d encourage you to apply even if you do not meet all of the following qualifications.

Basic Qualifications

• Bachelor’s degree in computer science, engineering, or a related field

• Willing to work in Germany. Our primary working locations are Heidelberg (preferred) and Berlin, although there is flexibility to work from other locations in Germany, with travel to Heidelberg expected regularly, potentially weekly

• Proficiency in programming and a passion for crafting high-quality, maintainable software while following engineering best-practices (e.g., TDD, DDD)

• Curiosity to dig deep and understand how things work

• Desire to take ownership of problems and collaborate with other teams to solve them

• Motivation to learn AI-related topics and get up-to-speed with the cutting edge.

• Strong communication skills, with the ability to convey technical solutions to diverse audiences.

Preferred Qualifications

• Master’s degree in computer science or related fields.

• Familiarity with systems programming and low-level languages such as Rust, with a focus on performance and reliability.

• Experience building software with a focus on performance and reliability.

• Experience working with distributed systems.

We do not require prior experience in machine learning for this role, but we do value your eagerness to learn. If you have prior experience in ML, we will be particularly excited about:

• Experience bringing AI research innovations into production

• Experience in areas such as large-scale data processing or distributed computation for foundation model training or inference

• Familiarity with popular NLP tools and frameworks such as PyTorch or HF Transformers, with knowledge of transformer architectures

• Experience with cluster management systems, model and data lineage, or other MLOps topics

What you can expect from us

• Become part of an AI revolution!

• 30 days of paid vacation

• Access to a variety of fitness & wellness offerings via Wellhub

• Mental health support through nilo.health

• Substantially subsidized company pension plan for your future security

• Subsidized Germany-wide transportation ticket

• Budget for additional technical equipment

• Flexible working hours for better work-life balance and hybrid working model

• Virtual Stock Option Plan

• JobRad® Bike Lease