S

Salesforce

Builds cloud software for customer relationships

LMTS Lead AI/ML Engineer - LLM Post-Training

Natural Language Processing & LLMsPosted on Nov 13
Full-timeNo salary listed

About the Job

Requirements

  • At least 10 years of software engineering experience, including technical leadership on production systems.
  • Strong Python engineering experience building and maintaining reliable production systems.
  • Hands-on ownership of large language model post-training, including training or materially improving open-weight language models through supervised fine-tuning and LoRA or QLoRA; application programming interface integration alone does not qualify.
  • Hands-on ownership of training-data generation and curation, including producing, filtering, reviewing, and versioning task-specific datasets such as synthetic instruction data, conversations, reasoning traces, tool calls, preference data, or structured outputs.
  • Strong practical understanding of the post-training stack, including chat templates, tokenizer behavior, sequence packing, loss masking, optimizer and learning-rate schedules, checkpointing, distributed or memory-efficient training, and inference tradeoffs.
  • Experience creating and evaluating reasoning, tool-use, or structured-output training data, and understanding how to distinguish plausible traces from correct, useful outcomes and how low-quality traces degrade a model.
  • Experience with model evaluation, including held-out datasets, error taxonomies, task and quality metrics, experiment design, ablation studies, regression analysis, and human-review workflows.
  • Strong software-engineering fundamentals, including application programming interface design, testing, debugging, observability, version control, and clear technical writing.
  • Ability to investigate ambiguous failures across model behavior, data, prompts, retrieval, tools, and backend services.
  • Demonstrated leadership in architecture, design reviews, code reviews, and mentoring engineers.
  • Comfort working across application and machine-learning layers rather than remaining within a narrow specialty.
  • A demonstrated AI-first approach to engineering, using AI to work faster, build fluency across the stack, and contribute beyond the candidate's core specialty.
  • Experience using AI tools such as Claude Code, GitHub Copilot, Codex, or Cursor in development workflows.
  • Advanced prompt-engineering skills, including writing precise, structured prompts and cultivating system context for reliable, secure, production-ready AI outputs.

Responsibilities

  • Train, adapt, and serve capable, reliable open-weight language models for enterprise workflows.
  • Own fine-tuning experiments from baseline through release by choosing training objectives, running supervised fine-tuning and LoRA or QLoRA recipes, comparing checkpoints against rigorous held-out evaluation, and diagnosing failures before subsequent runs.
  • Generate high-quality domain training data at scale, including synthetic instruction data, multi-turn conversations, reasoning and tool-use trajectories, structured outputs, counterexamples, preference pairs, and difficult evaluation cases.
  • Build the data engine behind post-training, including source-grounded authoring, quality filtering, deduplication, contamination controls, dataset versioning, train/validation/test splits, packing, tokenization, and loss masking.
  • Design and run post-training experiments beyond supervised fine-tuning when justified, including DPO, ORPO, GRPO, RLVR, distillation, and other preference or reinforcement-learning methods; match methods to measured capability problems and defensible reward signals.
  • Design and operate model-quality evaluation, including held-out task suites, model-based and human review, tool-use and structured-output accuracy, multi-turn reliability, safety regressions, ablations, and error analysis.
  • Investigate model behavior to identify whether failures originate from data quality, training objectives, model capacity, decoding, context handling, tool interfaces, or serving behavior, and produce evidence for corrective action.
  • Build and ship high-quality, production-grade software using modern engineering practices, with AI as a core part of the development workflow.
  • Build reliable model-serving and inference capabilities while balancing quality, latency, throughput, memory use, and operational reliability.
  • Build robust integrations between models, tools, and enterprise systems, including structured outputs, function calling, and multi-step agent behavior.
  • Make architecture and design decisions with attention to model quality, reproducibility, performance, security, scalability, and future extensibility.
  • Improve observability, traceability, failure analysis, test coverage, and developer workflows across the training and serving lifecycle.
  • Work with domain experts to turn real workflows, product behavior, application programming interfaces, and failure cases into independently verifiable training and evaluation material.
  • Protect customer and company data by using approved sources, preserving provenance, and keeping credentials and sensitive data out of training and model prompts unless specifically authorized.
  • Review model, data, and application changes for factual correctness, quality, security, performance, and operational risk.
  • Mentor engineers and provide technical guidance that raises the quality bar across the team.

Desired Qualifications

  • Experience building integrations with enterprise platforms, application programming interfaces, data systems, identity controls, or tool-using AI applications.
  • Experience with complex enterprise workflows such as customer relationship management, commerce, finance, service, supply chain, or regulated-industry systems.
  • Deep experience with preference optimization or reinforcement-learning methods for large language models, such as DPO, ORPO, GRPO, PPO, or verifiable-reward training, including ability to explain reward/preference data, training stability, and failure modes.
  • Experience with resource-constrained or distributed model training and inference, including PyTorch, Transformers, TRL, Accelerate, DeepSpeed, FSDP, vLLM, GPU optimization, or quantized model serving.
  • Experience with retrieval systems, source provenance, and retrieval evaluation; candidates should understand that retrieval provides context and is not a substitute for model training or model evaluation.
  • Experience with security and data-governance work involving sensitive enterprise data, access scopes, auditability, and human approval boundaries.
  • Experience taking an AI feature from experiment through a measured, monitored production release.

About the Company

Salesforce

Builds cloud software for customer relationships

Salesforce sells cloud software that helps businesses manage sales leads, customer service, marketing, and online commerce from shared customer records. Its flagship Sales Cloud tracks accounts and deals, while Service Cloud organizes support cases and Agentforce builds AI assistants that act on company data. Teams access these tools through a browser and connect outside apps and data sources, with Slack for work messages and Tableau for visual analysis. Salesforce earns most of its revenue from software subscriptions and support, with professional services for implementation and training. Marc Benioff co-founded Salesforce in 1999, and its headquarters are in San Francisco, California.

Company size
10,001+
Company stage
IPO
Headquarters
San Francisco, CA
Founded
1999

Recently Posted Jobs

Explore more opportunities at Salesforce

See more jobs