O

OpenAI

Builds AI models and the ChatGPT assistant

Certification Architect

TrainingPosted on Nov 14
Full-timeSan Francisco, CA, USA

About the Job

Requirements

  • Have 10 or more years of experience designing and delivering professional technical IT industry certifications or assessments that support credible claims about what people can do.
  • Have led the design of performance-based assessments for AI, software development, technical architecture, or customer-facing implementation roles.
  • Have built credential frameworks, competency models, or shared assessment standards across multiple roles or programs.
  • Have led job-task analysis, assessment blueprints, performance-based assessment, rubric design, standard setting, and development of evidence supporting valid and fair certification decisions.
  • Be able to translate assessment experience requirements into exam delivery specifications for third parties and learning product teams.
  • Have worked closely with certification specialists, psychometricians, and subject matter experts to validate assessment and scoring standards and improve assessment quality.
  • Be able to communicate complex standards clearly to technical and nontechnical partners and build alignment across teams without formal authority.
  • Be comfortable with hands-on work, including drafting standards, reviewing assessment designs, and resolving practical delivery tradeoffs with a small team.
  • Exercise sound judgment in ambiguous environments, balancing rigor, candidate experience, delivery feasibility, and the pace of technology change.
  • Demonstrate care for accessibility, fairness, and the integrity of credentials relied on by individuals and employers.
  • Build reusable approaches while recognizing where different roles need distinct competency models, tasks, and evidence.

Responsibilities

  • Own the credential framework and shared competency standards, distinguishing completed learning, demonstrated skills, and formal certification, with clear capability claims and evidence requirements for each.
  • Establish reusable assessment standards and guidance for certification pods across job-task analysis, competency models, assessment blueprints, performance tasks, scoring rubrics, and passing standards.
  • Own the validation approach and evidence documentation requirements, and partner with pod leaders to validate certification proposals against job relevance, representative task coverage, scoring consistency, fairness, and appropriate interpretation of results.
  • Define exam delivery architecture and requirements with product, engineering, operations, and third parties, spanning registration, identity verification, monitoring, permitted assistance, evidence capture, scoring, human review, appeals, customer support, and record management.
  • Define expectations for continued competence validation after assessment.
  • Partner with learning, operations, policy, legal, privacy, security, and accessibility teams to align preparation with competencies while protecting assessment integrity and establishing appropriate evidence access, retention, accommodations, and review processes.

Desired Qualifications

  • Experience validating AI-assisted scoring, model evaluations, or other automated approaches to evaluating human performance.
  • Experience with secure assessment delivery, identity verification, credential issuance, learner records, or assessment technology providers.
  • Experience developing innovative approaches to recertification, ongoing competence, or assessment of authentic work.
  • Experience building products that serve both individual users and organizations.

About the Company

OpenAI

Builds AI models and the ChatGPT assistant

OpenAI researches and builds artificial intelligence models and turns them into products for people, developers, and businesses, with a stated mission of making sure artificial general intelligence benefits all of humanity. Its launch of ChatGPT in 2022 brought generative AI into everyday use. People use ChatGPT to ask questions, write, code, and analyze files, developers build OpenAI's models into their own apps through its API, and its Codex agent works through coding tasks on its own. OpenAI earns money from ChatGPT subscriptions, business plans, and API usage. Sam Altman, Elon Musk, and others co-founded it in 2015; it is based in San Francisco and overseen by a nonprofit, the OpenAI Foundation.

Company size
1,001-5,000
Company stage
Late Stage VC
Total funding
$207.5B
Headquarters
San Francisco, CA
Founded
2015

Recently Posted Jobs

Explore more opportunities at OpenAI

See more jobs