O

Okta

Secures digital identities for people and software

Staff Machine Learning Engineer

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeToronto, ON, Canada

About the Job

Requirements

  • At least 8 years of software development experience, with strong programming expertise in Python; familiarity with Go or TypeScript is a plus.
  • Hands-on experience with applied machine learning, including feature engineering, training, and fine-tuning models.
  • Hands-on experience with modern generative AI platforms such as AWS Bedrock, OpenAI, or Anthropic.
  • Deep understanding of retrieval-augmented generation, embeddings, and knowledge-base workflows.
  • Hands-on experience with LiteLLM, LangGraph, LangChain, LlamaIndex, MCP, or related AI agent frameworks.
  • Familiarity with machine learning frameworks such as FastAPI, PyTorch, TensorFlow, or Spark ML, and workflow orchestration tools such as Airflow.
  • Experience defining evaluation metrics, pipelines, and feedback loops for machine learning or generative AI systems.
  • Experience building tools or infrastructure for AI/ML applications, with a deep understanding of the developer lifecycle in an AI-native environment.
  • Bachelor’s or Master’s degree in Computer Science or a related field.

Responsibilities

  • Implement intent-based enforcement to verify that agent runtime requests match their intended purpose.
  • Apply large language model reasoning and prompt parsing to interpret prompts, tool payloads, and intent in real time.
  • Integrate low-latency inference or semantic evaluation engines into the API gateway request path.
  • Use embeddings, vector search, or zero-shot classification to score alignment between agent intent and executed actions.
  • Design confidence-scored decision engines that feed semantic verification results into policy frameworks such as Cedar.
  • Establish evaluation benchmarks, prompt injection defenses, and guardrails to prevent bypasses or false positives.
  • Architect scalable machine learning and generative AI systems integrating retrieval, inference, and evaluation pipelines.
  • Optimize prompting, context retrieval, and retrieval-augmented generation workflows for accuracy, safety, and efficiency in Claude-based systems.
  • Build automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
  • Implement schema validation, structured output enforcement, and guardrails to ensure reliable, compliant AI outputs.

Desired Qualifications

  • Familiarity with Go or TypeScript.
  • Experience integrating AI-driven systems with identity, authentication, or security products.
  • Exposure to ethical AI, model risk, or compliance frameworks.
  • Familiarity with evaluation datasets, synthetic data generation, or large language model-as-a-judge methods.

About the Company

Okta

Secures digital identities for people and software

Okta builds cloud identity software that controls how employees, customers, and automated systems access applications and company resources. Its single sign-on product lets people use one login across their work tools, while passwordless sign-in and additional identity checks protect accounts from stolen credentials. Administrators use its directory, access policies, and lifecycle tools to grant permissions when someone joins an organization and remove them when they leave. Organizations pay subscriptions based on the products they use and the identities they manage, with support included. Okta was founded in 2009 and is headquartered in San Francisco, California, United States.

Company size
5,001-10,000
Company stage
IPO
Headquarters
San Francisco, CA
Founded
2009

Recently Posted Jobs

Explore more opportunities at Okta

See more jobs