G

Genentech

Biotech firm creating medicines via R&D

Machine Learning Infrastructure Engineer - Infra, AI for Drug Discovery

Applied Machine LearningConfirmed live in the last 24 hours
Full-time

About the Job

Requirements

  • A Bachelor of Science or Master of Science in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
  • At least 3 years of relevant industry experience in software engineering, infrastructure engineering, platform engineering, DevOps, MLOps, or a related area.
  • Strong Python programming skills and experience building and shipping maintainable production software, services, automation, or developer tooling.
  • A demonstrated interest in hands-on implementation and production software delivery.
  • Experience designing, deploying, or operating cloud systems, preferably on AWS, using services such as EKS, EC2, S3, IAM, SQS, SNS, and CloudWatch.
  • Experience with containers, Kubernetes, Helm, and infrastructure-as-code tools such as Terraform or Pulumi.
  • Experience with CI/CD, Git-based development workflows, automated testing, and software release practices.
  • Ability to troubleshoot complex systems using metrics, logs, traces, events, and observability tools such as Datadog, Prometheus, Grafana, or OpenTelemetry.
  • Understanding of distributed-systems concepts such as concurrency, queuing, retries, timeouts, idempotency, backpressure, and failure recovery.
  • Ability to gather requirements, communicate technical tradeoffs, and document systems for users and engineers with varied infrastructure experience.
  • Demonstrated ability to independently deliver practical, incremental solutions while considering immediate needs and longer-term platform direction.

Responsibilities

  • Design, implement, ship, and operate scalable model-serving infrastructure for machine learning, scientific, large language model, and agentic workloads.
  • Evolve the internal model deployment platform into a reliable, self-service platform for teams across the organization.
  • Improve platform scalability and reliability, including scale-to-zero, faster model startup, workload isolation, traffic management, and reducing request failures and latency bottlenecks.
  • Build observability and operational tooling for model usage, latency, reliability, resource consumption, inference cost, bottlenecks, and service-level indicators.
  • Improve model-deployment usability by developing validated configuration interfaces, reusable deployment patterns, APIs, command-line tools, and documentation.
  • Help converge real-time and batch inference workflows onto shared platform capabilities where appropriate.
  • Contribute to model lifecycle management infrastructure, including model registration and versioning, evaluation, promotion and release gates, monitoring, environment progression, and rollback.
  • Build event-driven integrations connecting model publication, evaluation, promotion, deployment, and retraining workflows.
  • Build consistent metrics and evaluation signals to understand model cost, quality, reliability, and fitness for downstream workflows.
  • Partner with machine learning, data, scientific, and platform teams to translate requirements into maintainable solutions and remove infrastructure bottlenecks.
  • Own workstreams from design through implementation and production support, using software-engineering practices including testing, reviews, documentation, and incremental delivery.

Desired Qualifications

  • Familiarity with model-serving or workflow-orchestration frameworks such as KServe, Triton, vLLM, Ray Serve, Prefect, or Dagster.
  • Experience optimizing model startup time, request throughput, batching, autoscaling, or GPU utilization.
  • Familiarity with model registries, experiment tracking, model evaluation, promotion workflows, or MLOps platforms.
  • Experience building event-driven systems using queues, event buses, or workflow orchestrators.
  • Familiarity with online and offline model evaluation, model-quality monitoring, data drift, or regression analysis.
  • Experience supporting scientific computing, high-performance computing, distributed training, or large-scale data processing.
  • Strong interest in the life sciences and drug discovery.
  • Prior inference-platform experience.
  • Prior experience in biotech or drug discovery.

About the Company

Genentech

Biotech firm creating medicines via R&D

Genentech develops medicines and therapies to address unmet medical needs through extensive biotechnology research and development. Its products include biologic and small-molecule treatments prescribed by healthcare providers and sold through partnerships with suppliers and health systems. It differentiates itself with a large R&D footprint, a vast patent portfolio, and FDA Breakthrough Therapy Designations that accelerate promising therapies. Its goal is to advance medical science and deliver high-quality, effective therapies that improve patient health while supporting the broader medical community.

Company size
10,001+
Company stage
IPO
Headquarters
San Francisco, CA
Founded
1976

Recently Posted Jobs

Explore more opportunities at Genentech

See more jobs