X

xAI

Generative AI chatbot leveraging real-time data

Senior Analyst - Safety Operations, Child Safety

Risk & ComplianceConfirmed live in the last 24 hours
Full-timeNo salary listedIn-person

About the Job

Requirements

  • At least 3 years of professional experience working in online child safety, criminal investigations, Trust and Safety operations, or another safety field.
  • Experience improving large language models, specifically related to Child Sexual Exploitation (CSE).
  • The applicant must be a U.S. citizen or national, U.S. lawful permanent resident, refugee, or asylee, or be eligible to obtain the required authorizations from the U.S. Department of State.
  • The role may involve exposure to sensitive or graphic content, including vulgar language, violent threats, pornography, and other graphic images.

Responsibilities

  • Monitor and take action on content and behavior that violates the terms of service, escalating as needed.
  • Apply deep expertise in online child safety to identify, investigate, and mitigate a broad range of child safety threats and risks.
  • Investigate complex child safety cases and recognize when escalation to internal legal teams or external reporting, such as NCMEC reports, is required.
  • Monitor and take appropriate action on content and user behavior that violates the terms of service, with a primary focus on protecting minors.
  • Respond effectively to time-sensitive escalations in high-impact, often ambiguous situations.
  • Process appeals, audit automations, and properly label use cases in the system.
  • Provide labels, annotations, and inputs on projects involving safety protocols, risk scenarios, and policy compliance.
  • Support delivery of high-quality curated data that reinforces the rules and ethical alignment.
  • Collaborate with team members to provide feedback on tasks that improve AI defenses against illegal and unethical behavior and align Grok with rules enforcement.
  • Interpret and apply safety policies effectively.
  • Maximize enforcement and support efficiencies and propose solutions to increase platform security and safety.

Desired Qualifications

  • Demonstrated expertise identifying, mitigating, and preventing Child Sexual Abuse Material (CSAM) and Child Sexual Exploitation (CSE), including grooming behaviors and risks in AI-generated content, with strong knowledge of relevant legal obligations such as NCMEC reporting and industry standards for protecting minors.
  • Experience in online safety and reducing harm to protect users and preserve free speech in the global public square.
  • Proficiency analyzing complex scenarios, with strong ethical reasoning and risk assessment skills.
  • Ability to use resources, guidelines, and frameworks for accurate safety-focused actions and escalations.
  • Strong communication, interpersonal, analytical, and ethical decision-making skills.
  • Commitment to continuous improvement of processes to prioritize safety and risk mitigation.
  • Expertise in data analysis to identify emerging abuse vectors, uncover operational efficiencies, and design automations that strengthen enforcement effectiveness and platform safety.
  • Experience working in Trust and Safety for a social media company, leveraging AI or other automation tools.
  • Experience collaborating with child safety organizations such as NCMEC and using specialized detection tools or developing classifiers for CSAM/CSE in social media or generative AI platforms.
  • Expertise in red-teaming and adversarial testing of large language models to identify novel abuse vectors, jailbreaks, and safety failure modes, and ability to translate findings into concrete improvements for enforcement systems and platform robustness.

About the Company

xAI

Generative AI chatbot leveraging real-time data

xAI builds Grok, a generative AI chatbot with a Hitchhiker's Guide-inspired persona that uses real-time data from X to produce current, culturally aware responses. Grok is accessible to premium subscribers on X, via a standalone website, mobile apps, and through an API for developers. The company also develops large-scale AI infrastructure, such as the Colossus supercomputer, to train and run its models. Its goal is to pursue truth-seeking AGI research and grow a capital-intensive platform that could support a major public offering in the future.

Company size
1,001-5,000
Company stage
Series E
Total funding
$42.1B
Headquarters
Palo Alto, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at xAI

See more jobs