G

Gray Swan

Real-time AI risk detection and protection

Software Engineer - ML Infrastructure

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeRemote

About the Job

Requirements

  • Experience building and maintaining production-grade systems, services, or infrastructure.
  • Experience with Python and comfort working across backend systems, APIs, and infrastructure code.
  • Familiarity with cloud infrastructure, distributed systems, containerization, or platform engineering.
  • Knowledge of ML workflows, including model training, inference, evaluation, or deployment.
  • Ability to collaborate with ML engineers and researchers to translate complex technical requirements into reliable software.

Responsibilities

  • Build and maintain infrastructure, services, and deployment workflows that move ML models from experimentation into reliable production environments.
  • Develop internal tools and automation that improve the developer experience for model training, experimentation, evaluation, and iteration.
  • Design and optimize systems supporting model evaluation pipelines, experiment orchestration, reproducibility, and performance monitoring.
  • Partner with ML engineers and researchers to identify infrastructure bottlenecks and build solutions that accelerate model development and deployment.
  • Support customer-specific technical requirements and policy-driven workflows, translating evolving needs into practical, scalable engineering solutions.
  • Improve the reliability, scalability, and observability of the systems powering ML capabilities.

Desired Qualifications

  • Experience building ML infrastructure, ML platforms, or internal developer tooling.
  • Familiarity with Kubernetes, Docker, and cloud platforms such as AWS or GCP.
  • Experience with ML infrastructure tools such as Ray, Kubeflow, MLflow, or Weights & Biases.
  • Experience with model serving, distributed training, inference infrastructure, or large-scale evaluation pipelines.
  • Exposure to AI safety, AI security, adversarial testing, or model behavior evaluation.
  • Experience translating customer requirements, security constraints, or policy considerations into technical implementations.

About the Company

Gray Swan

Real-time AI risk detection and protection

Gray Swan AI develops security solutions for AI deployments, helping organizations identify, manage, and reduce risks in AI models. It provides real-time monitoring, input/output filtering, and threat analysis to prevent adversarial inputs, prompt injections, and model misuse. Core products are Cygnal (input/output filtering to prevent harmful behavior), Shade (automated attack simulations to uncover weaknesses), and Cygnet (an enterprise-focused, safety-oriented language model). Its goal is to enable reliable, compliant, and safe AI deployment by delivering ongoing protection across the AI lifecycle and focusing on the security layer of AI systems.

Company size
51-200
Company stage
Series A
Total funding
$45.7M
Headquarters
Pittsburgh, PA
Founded
2023

Recently Posted Jobs

Explore more opportunities at Gray Swan

See more jobs