S

SimpliSafe

Makes security systems for homes and businesses

Staff Software Engineer - ML Infrastructure

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeBoston, MA, USA

About the Job

Requirements

  • At least 8 years of software engineering experience and a clear track record of building and operating large-scale distributed systems in production.
  • Deep expertise in high-throughput, low-latency services, including ad serving, recommendations, real-time APIs, online platforms, or similar, and experience operating them at scale.
  • Strong production experience with Kubernetes and AWS (EKS, S3, IAM, and networking), as well as Kafka, containerized deployments, continuous integration and continuous delivery, and infrastructure-as-code.
  • Demonstrated experience with high-scale systems building blocks, including load balancing, autoscaling, batching, caching, multi-tenancy, queuing, and capacity planning.
  • Proficiency in Python is required.
  • Ability to drive ambiguous, cross-cutting initiatives, align senior stakeholders, and elevate engineers without formal authority.
  • Strong written and verbal communication skills, including the ability to explain complex technical tradeoffs to ML scientists, product teams, and other infrastructure teams.

Responsibilities

  • Drive architecture decisions for the Kubernetes-based ML platform, anchored on Ray for inference alongside KServe, Triton, and vLLM, across real-time and batch workloads.
  • Lead technical reviews on system design, capacity planning, and reliability for high-stakes ML systems.
  • Identify and remove systemic bottlenecks in ML deployment infrastructure, including serving reliability, deployment friction, observability gaps, scaling, and cost.
  • Own the design and evolution of cloud-side inference systems that process live video and events from SimpliSafe devices in real time.
  • Improve throughput, latency, and cost for production computer vision models through batching strategies, GPU utilization, autoscaling, and multi-model serving.
  • Build feedback loops between cloud inference, edge devices, and the data flywheel to improve model quality over time.
  • Shape production LLM serving, including model serving patterns, KV-cache and batching strategies, evaluation pipelines, guardrails, and cost controls.
  • Partner with applied ML engineers to take GenAI-powered product features from prototype to scaled deployment.
  • Mentor engineers through design reviews, code reviews, pairing, and written guidance.
  • Establish and promote best practices for model lifecycle management, including registry, deployment, monitoring, rollback, and drift, as well as on-call practices.
  • Write documentation, runbooks, and architectural decision records for the platform.
  • Lead incident response and postmortems for critical ML systems and convert lessons learned into platform-level improvements.
  • Define service-level objectives, observability standards, and on-call practices for production ML services.

Desired Qualifications

  • Experience with a systems language such as Go, C++, or Rust for performance-sensitive components.
  • Experience deploying or operating production ML systems, working closely with ML teams, or building ML-adjacent infrastructure.
  • Hands-on experience with Ray, KServe, Triton, vLLM, or other ML serving stacks.
  • Hands-on experience with production LLM serving, including vLLM, TGI, TensorRT-LLM, or SGLang, and KV-cache management, continuous batching, speculative decoding, or quantization for serving.
  • Experience building real-time video or streaming pipelines at scale using Kafka, Kinesis, Flink, or similar technologies.
  • Experience operating GPU-based inference systems, including GPU-aware scheduling, multi-model serving, and accelerator utilization optimization.
  • Familiarity with ML fundamentals, including how models are trained, evaluated, versioned, deployed, monitored, and rolled back in production.
  • Experience with model lifecycle tooling such as MLflow, Weights & Biases, model registries, drift detection, and shadow deployments.
  • Open-source contributions to distributed systems or ML infrastructure projects.
  • Experience operating in environments with strong security and compliance requirements.

About the Company

SimpliSafe

Makes security systems for homes and businesses

SimpliSafe designs home and small business security systems that customers assemble from wireless sensors, cameras and a central alarm unit. Its product range covers intrusion detection as well as hazards such as water leaks and freezing temperatures, with a mobile app for arming systems and checking cameras. Sensors send alerts to a base station, while optional professional monitoring lets agents assess alarms and request emergency assistance; the business earns money from equipment sales and subscription plans. Customers choose a ready-made package or configure devices for their property, with installation available through self-service or a technician. SimpliSafe was founded in 2006 and is headquartered in Boston, Massachusetts.

Company size
501-1,000
Company stage
Debt Financing
Total funding
$387.7M
Headquarters
Boston, MA
Founded
2006

Recently Posted Jobs

Explore more opportunities at SimpliSafe

See more jobs