F

Field AI

Builds AI that guides robots through changing sites

Agentic AI/ML Engineer - Multimodal

Computer Vision +1Confirmed live in the last 24 hours
Full-timeIrvine, CA, USANo salary listedIn-person

About the Job

Requirements

  • A Master's or Ph.D. in Computer Science, AI/ML, Robotics, or equivalent industry experience.
  • At least 2 years of industry experience or relevant publications in computer vision, machine learning, or artificial intelligence.
  • Strong expertise in computer vision, video understanding, temporal modeling, and vision-language models.
  • Proficiency in Python and PyTorch, with production-level coding skills.
  • Experience building pipelines for large-scale video and image datasets.
  • Familiarity with AWS or other cloud platforms for machine learning training and deployment.
  • Understanding of MLOps best practices, including CI/CD and experiment tracking.
  • Hands-on experience fine-tuning open-source multimodal models using HuggingFace, DeepSpeed, vLLM, FSDP, LoRA, or QLoRA.
  • Knowledge of precision tradeoffs, including FP16, bfloat16, and quantization, and multi-GPU optimization.
  • Ability to design scalable evaluation pipelines for vision/vision-language models and agent performance.

Responsibilities

  • Train and fine-tune million- to billion-parameter multimodal models, focusing on computer vision, video understanding, and vision-language integration.
  • Track state-of-the-art research, adapt novel algorithms, and integrate them into FiFM.
  • Curate datasets and develop tools to improve model interpretability.
  • Build scalable evaluation pipelines for vision and multimodal models.
  • Contribute to model observability, drift detection, and error classification.
  • Fine-tune and optimize open-source vision-language models and multimodal embedding models for efficiency and robustness.
  • Build and optimize Multi-VectorRAG pipelines with vector databases and knowledge graphs.
  • Create embedding-based memory and retrieval chains with token-efficient chunking strategies.
  • Contribute to broader perception and insight-generation initiatives across Field AI.

Desired Qualifications

  • Experience with agentic/RAG pipelines and knowledge graphs, including LangChain, LangGraph, LlamaIndex, OpenSearch, FAISS, or Pinecone.
  • Familiarity with agent operations logging and evaluation frameworks.
  • Background in optimization, including token cost reduction, chunking strategies, reranking, and retrieval latency tuning.
  • Experience deploying models under quantized (int4/int8) and distributed multi-GPU inference.
  • Exposure to open-vocabulary detection, zero/few-shot learning, and multimodal RAG.
  • Knowledge of temporal-spatial modeling, including event/scene graphs.
  • Experience deploying AI in edge or resource-constrained environments.

About the Company

Field AI

Builds AI that guides robots through changing sites

Field AI builds autonomy software that lets mobile robots inspect and work in changing environments, including construction sites and industrial facilities. Its Field Foundation Models act as a shared control system for different machines, bringing perception, navigation and task planning together on the robot. Cameras and other sensors feed the system, while the platform sends site data into customers' project tools to track progress, record conditions and identify deviations from plans. The company sells commercial autonomy solutions and deployment services, integrating its software with robot manufacturers' equipment. Field AI was founded in 2023 and is headquartered in Irvine, California.

Company size
201-500
Company stage
Late Stage VC
Total funding
$1.1B
Headquarters
Irvine, CA
Founded
2023

Recently Posted Jobs

Explore more opportunities at Field AI

See more jobs