R

RELX

Global information analytics and decision tools

Manager Data Science

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeSan Francisco, CA, USARemote

About the Job

Requirements

  • Strong understanding of transformer architectures, attention mechanisms, tokenization, language modeling objectives, and differences between pretraining, continued pretraining, and fine-tuning.
  • Strong Python and PyTorch skills, with practical experience using Hugging Face Transformers, Datasets, or equivalent tools.
  • Demonstrated ability to implement supervised fine-tuning (SFT), configure training objectives and loss masking, tune hyperparameters, and select model checkpoints.
  • Practical experience with parameter-efficient fine-tuning (PEFT), including LoRA or QLoRA, and understanding of their quality, memory, and compute tradeoffs.
  • Ability to build instruction-response datasets, apply chat templates, manage sequence lengths and packing, and prevent data leakage and evaluation contamination.
  • Experience training models across multiple GPUs using frameworks such as PyTorch FSDP or DeepSpeed, including mixed precision, gradient accumulation, and gradient checkpointing.
  • Ability to design reliable benchmarks and human evaluations, analyze model errors, and troubleshoot unstable loss, overfitting, and GPU memory issues.
  • Experience with experiment tracking, dataset and model versioning, checkpoint management, and documented training pipelines.

Responsibilities

  • Lead the design and execution of LLM training and fine-tuning projects, including model selection, training strategy, experimentation, and evaluation.
  • Oversee preparation of high-quality training datasets, including data collection, cleaning, deduplication, annotation, and quality validation.
  • Develop and optimize supervised fine-tuning and parameter-efficient fine-tuning workflows; apply preference optimization methods where appropriate.
  • Establish evaluation frameworks to assess factual accuracy, instruction following, domain relevance, safety, and performance on business-specific tasks.
  • Diagnose training issues and improve model quality, training stability, GPU utilization, and computational efficiency.
  • Manage and mentor data scientists, review technical work, and establish reproducible development practices.
  • Partner with product, engineering, and domain experts to define requirements and support model deployment and monitoring.
  • Manage project priorities, timelines, and compute resources, and communicate results and tradeoffs to stakeholders.

About the Company

RELX

Global information analytics and decision tools

RELX is a global provider of information-based analytics and decision tools for professionals across scientific, technical, medical, legal, risk, business, and exhibitions industries. It operates in four segments: Scientific, Technical & Medical; Risk & Business Analytics; Legal; and Exhibitions. Its products combine large datasets, analytics, and decision-support tools to help researchers, healthcare professionals, lawyers, and business leaders make informed choices, improve productivity, and achieve better outcomes. Revenue mainly comes from subscriptions, with additional income from transactional sales and advertising. RELX differentiates itself through its deep data assets, specialized industry knowledge, and multi-segment offerings that span content, analytics, and decision-support services. The company pursues a goal of delivering trusted information and insights while supporting corporate responsibility and alignment with the UN SDGs through its products and partnerships.

Company size
1,001-5,000
Company stage
IPO
Headquarters
London, United Kingdom
Founded
1894

Recently Posted Jobs

Explore more opportunities at RELX

See more jobs