D

DAT Freight & Analytics

On-demand freight marketplace with analytics

Staff AI Platform Engineer - Emerging AI

Applied Machine LearningUpdated on Nov 9
Full-timeSeattle, WA, USA

About the Job

Requirements

  • At least 10 years of software engineering experience, including substantial experience as a senior or staff engineer owning production infrastructure used by other engineering teams.
  • At least 4 years of experience building and operating machine learning or AI platforms, taking models from notebooks into production traffic and maintaining them.
  • Strong development-language skills, ideally in TypeScript/Node.js, Java, or Go, and the software engineering discipline to build libraries adopted by other teams.
  • Extensive production AWS experience, ideally including EKS/Kubernetes, Lambda, Redpanda, MSK/Kafka, S3, and Secrets Manager, plus infrastructure as code with Pulumi, Terraform, or similar tools.
  • Hands-on experience serving models at scale, including containerized inference, GPU scheduling, autoscaling, batching, and the tradeoffs among real-time, streaming, and batch scoring.
  • Practical production experience with large language model systems, including retrieval-augmented generation, vector databases, prompt and context management, tool-calling or agent frameworks, and managed model APIs such as Amazon Bedrock.
  • Experience building evaluation and monitoring for models, including offline evaluation sets, online metrics, drift and data-quality checks, and defining model regression.
  • A strong background in event-driven and distributed systems using Redpanda, AWS MSK, or Kafka.
  • Fluency with observability and on-call health, including designing dashboards, application performance monitoring traces, logs, and alerts; defining service-level objectives; and using these tools to reduce incident frequency and mean time to resolution.
  • Experience establishing and raising team engineering standards, including pull request and testing guidelines, deployment validation checklists, model release criteria, and post-incident review practices.
  • Demonstrated technical leadership in leading cross-team designs in ambiguous problem spaces, writing system design documents and operations runbooks, and aligning Engineering, Product, and Operations.
  • A proven mentoring record, especially helping engineers and data scientists grow in system design, observability, and operational excellence.
  • Ability to explain tradeoffs and system behavior clearly to engineers, product managers, and non-technical stakeholders.

Responsibilities

  • Design, build, and operate shared services used by engineers and business users to ship models, including a large language model gateway, real-time and batch inference endpoints, feature storage, vector search, and a common software development kit.
  • Lead architecture for large-scale AI systems, write design documents, and align Product, Engineering, and business users on how models are built and shipped.
  • Architect and operate scalable, reliable AI infrastructure on AWS, including Bedrock, SageMaker, EKS, Redpanda, MSK (Kafka), Lambda, and S3, with infrastructure defined in Pulumi.
  • Build offline and online evaluation systems to determine whether model or prompt changes improve performance, including regression suites, large-language-model-as-judge pipelines, A/B and shadow testing, and drift detection.
  • Own inference cost and latency metrics; right-size GPU and serverless capacity, tune batching, caching, and quantization, and provide teams visibility into workload costs.
  • Implement guardrails, prompt and output logging, personally identifiable information handling, access controls, and model and dataset lineage to meet security and customer-data commitments.
  • Drive adoption of modern software development practices across AI work, including automated testing, code reviews, continuous integration and delivery pipelines, and infrastructure as code.
  • Mentor engineers and data scientists on production machine learning and distributed systems, and raise the operational bar of teams using the platform.
  • Lead responses and resolutions for complex production incidents involving AI services, perform root cause analysis, and implement preventive measures.

Desired Qualifications

  • Experience with model fine-tuning, distillation, or parameter-efficient training, and a clear perspective on when those approaches outperform prompting.
  • Background in marketplace, pricing, forecasting, or document-extraction problems.
  • Experience in freight, logistics, or supply chain domains.

About the Company

DAT Freight & Analytics

On-demand freight marketplace with analytics

DAT Freight & Analytics runs the DAT Network, North America’s largest on-demand freight marketplace, linking shippers who need to move goods with carriers who transport them and brokers who facilitate transactions. Its core offering is a subscription-based platform that includes a robust load board and analytics tools, with DAT iQ providing market intelligence to help plan and optimize freight operations. The company differentiates itself by the size of its network, its long history dating back to 1978, and its focus on data-driven optimization and automation. Its goal is to make freight matching more reliable and efficient by improving visibility, reducing uncertainty, and speeding up the transportation process for brokers, carriers, and shippers.

Company size
501-1,000
Company stage
Acquired
Total funding
Not listed
Headquarters
Beaverton, OR
Founded
1978

Recently Posted Jobs

Explore more opportunities at DAT Freight & Analytics

See more jobs