X

xAI

Generative AI chatbot leveraging real-time data

Senior Analyst - Safety Operations, Child Safety

Risk & ComplianceConfirmed live in the last 24 hours
Full-timePalo Alto, CA, USAIn-person

About the Job

Requirements

  • At least 3 years of professional experience working in online child safety, criminal investigations, Trust & Safety operations, or another safety field.
  • Experience improving large language models, specifically related to child sexual exploitation.
  • Proven expertise in identifying, mitigating, and preventing child sexual abuse material and child sexual exploitation, including grooming behaviors and risks in AI-generated content, with strong knowledge of relevant legal obligations such as NCMEC reporting and industry standards for protecting minors.
  • Proven experience in online safety and reducing harm to protect users and preserve free speech in the global public square.
  • Proficiency in analyzing complex scenarios, with strong skills in ethical reasoning and risk assessment.
  • Ability to use resources, guidelines, and frameworks to take accurate safety-focused actions and escalations.
  • Strong communication, interpersonal, analytical, and ethical decision-making skills.
  • Commitment to continuous process improvement to prioritize safety and risk mitigation.
  • Expertise in data analysis to identify emerging abuse vectors, uncover operational efficiencies, and design automations that strengthen enforcement effectiveness and platform safety.
  • Experience working in Trust & Safety for a social media company, leveraging AI or other automation tools.
  • Experience collaborating with child safety organizations such as NCMEC and utilizing specialized detection tools or developing classifiers for child sexual abuse material or child sexual exploitation in social media or generative AI platforms.
  • Expertise in red-teaming and adversarial testing of large language models to identify novel abuse vectors, jailbreaks, and safety failure modes, and translating findings into improvements for enforcement systems and platform robustness.
  • This role may involve exposure to sensitive or graphic content, including vulgar language, violent threats, pornography, and other graphic images.
  • To conform to U.S. Government export regulations, applicants must be a U.S. citizen or national, U.S. lawful permanent resident, refugee under 8 U.S.C. § 1157, asylee under 8 U.S.C. § 1158, or eligible to obtain the required authorizations from the U.S. Department of State.

Responsibilities

  • Monitor and take action on content and behavior that violates the terms of service, escalating as needed.
  • Apply expertise in online child safety to identify, investigate, and mitigate child safety threats and risks.
  • Investigate complex child safety cases and determine when escalation to internal legal teams or external reporting, such as NCMEC reports, is required.
  • Monitor and take appropriate action on content and user behavior that violates the terms of service, with a primary focus on protecting minors.
  • Respond to time-sensitive escalations in high-impact, often ambiguous situations.
  • Process appeals, audit automations, and label use cases in the system.
  • Provide labels, annotations, and inputs for projects involving safety protocols, risk scenarios, and policy compliance.
  • Support delivery of high-quality curated data that reinforces the rules and ethical alignment.
  • Collaborate with team members to provide feedback on tasks that improve AI defenses against illegal and unethical behavior and align Grok with rules enforcement.
  • Interpret and apply safety policies effectively.
  • Maximize enforcement and support efficiencies and propose solutions to improve platform security and safety.

About the Company

xAI

Generative AI chatbot leveraging real-time data

xAI builds Grok, a generative AI chatbot with a Hitchhiker's Guide-inspired persona that uses real-time data from X to produce current, culturally aware responses. Grok is accessible to premium subscribers on X, via a standalone website, mobile apps, and through an API for developers. The company also develops large-scale AI infrastructure, such as the Colossus supercomputer, to train and run its models. Its goal is to pursue truth-seeking AGI research and grow a capital-intensive platform that could support a major public offering in the future.

Company size
1,001-5,000
Company stage
Series E
Total funding
$42.1B
Headquarters
Palo Alto, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at xAI

See more jobs