Inactive
S

ServiceNow

Builds software that automates business workflows

Senior Staff Machine Learning Engineer - AI Safeguards

Applied Machine LearningPosted on Oct 28
Full-timeMountain View, CA, USANo salary listedIn-person

About the Job

Requirements

  • Typically 8 or more years of production software development, including 3 or more years of applied machine learning training, evaluating, and deploying models in production systems.
  • Hands-on experience developing safeguards for large language models, such as guardrail models, content classifiers, prompt injection or jailbreak detection, or safety evaluations.
  • Strong model-evaluation fundamentals for agent trajectories and text classification, and attention to the quality of training and evaluation data.
  • Working knowledge of how large language model safeguards are bypassed, including indirect prompt injection through tools and documents, and multi-turn jailbreaks.
  • Excellent Python experience.

Responsibilities

  • Design, build, and ship safeguards in the agent harness for prompt injection, single- and multi-turn jailbreaks, toxicity and sensitive topics, and sensitive data exposure.
  • Build evaluations that measure safeguard efficacy on false and true positives, using datasets from customer reports, adversarial testing, and production traffic.
  • Work closely with the Security team to turn adversarial findings into evaluation cases and fixes, and build mitigations that hold when detection misses.
  • Select, integrate, and fine-tune detection models within a stack shared by commercial and government environments.
  • Balance quality, latency, and cost for controls that run in the request path.
  • Build configurable safeguard policies so customers can decide how sensitive topics are handled.
  • Monitor safeguard behavior in production and fix regressions.

About the Company

ServiceNow

Builds software that automates business workflows

ServiceNow builds cloud software that helps large organizations manage work across IT, customer service, human resources, and security. Its applications handle tasks such as resolving support tickets, onboarding employees, and responding to customer requests. Businesses configure forms, approval steps, and automation through visual tools on a common platform, connecting existing systems and using AI to assist workers or carry out tasks. The company sells subscriptions to its applications and platform, with professional services helping customers implement and use the software. Founded in 2004, ServiceNow is headquartered in Santa Clara, California.

Company size
10,001+
Company stage
IPO
Headquarters
Santa Clara, CA
Founded
2004

Recently Posted Jobs

Explore more opportunities at ServiceNow

See more jobs