R

Rapid7

Provides cloud-based security analytics and automation

Senior Principal AI Engineer

Natural Language Processing & LLMsConfirmed live in the last 24 hours
Full-timeDublin, Ireland€137.8k - €186.4k /yrIn-person

About the Job

Requirements

  • 14+ years of software or machine learning engineering experience, including 2+ years building production large language model or agentic AI systems.
  • A track record of building scalable, production-grade AI systems and shared platforms adopted across multiple products, with company-wide impact through technical leadership, mentoring, and standards.
  • Expertise in large language models, including transformer architecture, attention, tokenization, positional encodings, model training and serving, and advanced PyTorch skills spanning custom model code, mixed precision, and distributed training such as Fully Sharded Data Parallel and DeepSpeed.
  • Hands-on fine-tuning and post-training of open-weight large language models, including full and parameter-efficient methods such as LoRA and QLoRA, distillation, and preference- or reinforcement-learning-based methods such as DPO and GRPO; experience training large language models from scratch is desirable.
  • Deep experience with context engineering, including retrieval, memory, and context management for long-running agent workflows, and defining evaluation strategy and benchmarks for large language model and agent systems.
  • Deep knowledge of inference optimization, including prefill and decode, key-value cache management, continuous batching, speculative decoding, and quantization, and serving at scale with vLLM, SGLang, or TensorRT-LLM; ideally on AWS and including GPU kernel work with CUDA or Triton.
  • Strong predictive artificial intelligence, classical machine learning, distributed systems, and Python fundamentals, with the judgment to choose approaches based on accuracy, latency, and cost.
  • Accountability for organisation-wide technical outcomes, including addressing systemic risks and removing barriers to delivery while aligning technical decisions with strategic priorities.
  • Ability to articulate complex architectural trade-offs, build consensus, and influence technical and product decisions across the organisation.
  • Ability to build alignment across Engineering, Product, and other functions on technical direction and drive decisions that shape product and platform investments.
  • Ability to anticipate evolving customer needs and shape AI architecture and technical strategy to maximise customer value, making informed trade-offs between capability, performance, cost, and scalability.
  • Ability to thrive in ambiguity at the leading edge of AI and drive change as technology and the threat landscape evolve.
  • Recognition as an AI expert evidenced by publications, patents, open-source contributions, or industry engagement.

Responsibilities

  • Set the AI technical vision, architecture, and multi-year roadmap for large language model and agentic systems across Detection and Response and Exposure and Remediation.
  • Define company-wide model strategy, including when to use frontier or open-source models, fine-tune, distill, or post-train, and where to invest in new capabilities.
  • Lead complex and high-risk technical initiatives across multiple teams, including fine-tuning, distillation, and post-training of open-source large language models on security data.
  • Establish company-wide standards for context engineering, inference optimization, and evaluation, with evaluations serving as the release gate for every AI system shipped.
  • Lead optimization of large language model inference at scale, balancing quality, latency, and cost.
  • Lead design reviews, resolve complex technical trade-offs, and remain hands-on by prototyping and building critical model, training, and inference code.
  • Mentor and develop Principal, Staff, and Senior engineers, building AI engineering talent across the organisation.
  • Represent Rapid7 AI engineering to executives, customers, and the external community, influencing product, platform, and business strategy.

Desired Qualifications

  • A PhD in Computer Science, Machine Learning, or AI, or equivalent depth of expertise demonstrated through industry experience and technical contributions.
  • Experience training large language models from scratch.
  • Experience serving large language models at scale on AWS, including GPU kernel work with CUDA or Triton.

About the Company

Rapid7

Provides cloud-based security analytics and automation

Rapid7 helps organizations improve security by providing a cloud-based suite of tools and services that give visibility into networks and systems, analyze security data, and automate routine security tasks. Its Insight cloud collects telemetry and correlates data to help security teams identify vulnerabilities, monitor for suspicious behavior, investigate incidents, and shut down attacks, with modules for threat analytics, vulnerability management, and security automation. The platform is built as an integrated, cloud-native solution that consolidates multiple security functions in one place, rather than requiring separate tools. Rapid7 aims to help customers securely advance by reducing vulnerabilities, stopping malicious behavior, and speeding up incident response through automated workflows.

Company size
1,001-5,000
Company stage
IPO
Headquarters
Boston, MA
Founded
2000

Recently Posted Jobs

Explore more opportunities at Rapid7

See more jobs