O

OpenAI

Builds AI models and the ChatGPT assistant

Researcher for Cybersecurity Risks - Frontier Cybersecurity Risks

Security Engineering & ArchitectureConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USA$380k - $500k /yrIn-person

About the Job

Requirements

  • Demonstrated experience in deep learning and transformer models.
  • Proficiency with frameworks such as PyTorch or TensorFlow.
  • A strong foundation in data structures, algorithms, and software engineering principles.
  • Familiarity with methods for training and fine-tuning large language models, including distillation, supervised fine-tuning, and policy optimization.
  • Significant experience designing and deploying technical safeguards for abuse prevention, detection, and enforcement at scale.

Responsibilities

  • Design and implement mitigation components for model-enabled cybersecurity misuse, spanning prevention, monitoring, detection, and enforcement, under the guidance of senior technical and risk leadership.
  • Integrate safeguards across product surfaces in partnership with product and engineering teams, helping ensure protections are consistent, low-latency, and scale with usage and new model capabilities.
  • Evaluate technical trade-offs within the cybersecurity risk domain, including coverage, latency, model utility, and user privacy, and propose pragmatic, testable solutions.
  • Collaborate with risk and threat modeling partners to align mitigation design with anticipated attacker behaviors and high-impact misuse scenarios.
  • Execute rigorous testing and red-teaming workflows to stress-test the mitigation stack against evolving threats, including novel exploits, tool-use chains, and automated attack workflows, across different product surfaces, then iterate based on findings.

Desired Qualifications

  • Background knowledge in cybersecurity or adjacent fields.

About the Company

OpenAI

Builds AI models and the ChatGPT assistant

OpenAI researches and builds artificial intelligence models and turns them into products for people, developers, and businesses, with a stated mission of making sure artificial general intelligence benefits all of humanity. Its launch of ChatGPT in 2022 brought generative AI into everyday use. People use ChatGPT to ask questions, write, code, and analyze files, developers build OpenAI's models into their own apps through its API, and its Codex agent works through coding tasks on its own. OpenAI earns money from ChatGPT subscriptions, business plans, and API usage. Sam Altman, Elon Musk, and others co-founded it in 2015; it is based in San Francisco and overseen by a nonprofit, the OpenAI Foundation.

Company size
1,001-5,000
Company stage
Late Stage VC
Total funding
$207.5B
Headquarters
San Francisco, CA
Founded
2015

Recently Posted Jobs

Explore more opportunities at OpenAI

See more jobs