Acoustics ML & DSP Engineer

Summary

At Apple, new ideas have a way of quickly becoming extraordinary products, services and customer experiences. Sound is an essential and compelling facet of the customer experience. Apple has assembled a world-class Acoustics team that enables our customers to experience music with delight, communicate with clarity and appreciate our products without disturbance from noise. In Apple Acoustics we work with obsessive attention to detail, directly contributing to products that ship to millions of people around the world. The Audio System Tuning team is looking for an Acoustics ML and DSP Engineer to innovate on and improve the voice processing features and algorithms in Apple devices. This is an applied, product-focused role. You will develop, tune and ship ML and DSP algorithms for the voice audio front end across iOS, macOS and wireless products. Your work will keep phone and video calls clear and natural for everyone on the call, and make Siri and voice recognition reliable in real-world conditions. In this fast-paced, hands-on role, you will take algorithms from prototype through on-device testing into production, where they reach millions of customers. We’re looking for someone who enjoys turning new ideas into real product improvements, and who thrives while balancing several projects at once.

Minimum Qualifications

MS with 3+ years of relevant experience, or PhD, in Acoustics, Audio, Electrical Engineering, Computer Science or a related field. Solid grasp of acoustics and signal processing fundamentals. Experience shipping audio or speech enhancement ML algorithms from prototype to production. Proficiency with PyTorch and Python, including version control, testing and reproducible experiments. Working knowledge of Max/MSP for real-time audio prototyping. Experience with causal, streaming models under real-time latency and compute constraints. Experience using, and where needed building, large-scale data and cloud training pipelines, including preprocessing and data simulation. Working knowledge of speech quality evaluation: objective metrics, telephony quality and echo performance measures, and subjective listening tests. Understanding of the state of the art in speech processing and adjacent fields. Enthusiasm for exploring and testing new ideas, with the ability to prioritize and deliver across several projects in parallel in a fast-paced environment. Team player with strong written and verbal communication, and the ability to work in cross-functional teams.

Preferred Qualifications

Experience with audio DSP, such as echo and double-talk handling, microphone array processing, beam-forming, dynamics processing, EQ and noise suppression. Experience with hybrid systems that combine classical signal processing and machine learning. Familiarity with telephony voice quality requirements. Knowledge of front-end processing for speech recognition and machine listening. Experience with multi-modal machine learning. Strong coding and debugging skills (Python and C/C++), plus MATLAB for analysis. Knowledge of transducers and their acoustic integration. Curious and eager to try new ideas quickly, while keeping multiple product programs on track.

Description

As an Acoustics ML and DSP Engineer, you will develop new speech enhancement algorithms that combine machine learning and DSP, and take them from prototype to production on Apple devices. You will use and extend existing large-scale data preprocessing, simulation and cloud training pipelines, building new ones where needed. You will tune, optimize and listen to algorithms, and debug issues by tracing them to the data, the model or the signal chain. Your work will improve voice quality and intelligibility for telephony and voice calls in challenging conditions such as echo, double talk and noisy environments, and you will measure the effect of front-end processing on telephony quality and machine listening applications. You will also follow the state of the art in speech processing and adjacent fields, and work cross-functionally with tuning, DSP and audio ML colleagues within the team and with partners across the hardware and software organizations.