C

Citi

Runs banking and payments for global clients

Gen AI Engineer

AI Application Engineering +1Posted on Nov 11
Full-timeNo salary listedHybrid

About the Job

Requirements

  • At least 6 years of professional experience in a role blending software development and data science or machine learning.
  • Expert-level Python development skills and a proven track record of designing and building scalable backend services and APIs; FastAPI is preferred.
  • Hands-on experience designing and building solutions with multiple agentic frameworks, such as LangChain, LangGraph, CrewAI, AutoGen, and Semantic Kernel.
  • Experience architecting and optimizing Retrieval-Augmented Generation systems and integrating them with vector databases such as OpenSearch, Pinecone, and Weaviate.
  • Expertise designing and deploying containerized AI systems using Docker and Kubernetes on a major cloud platform such as AWS, Azure, or Google Cloud Platform.
  • Experience implementing MLOps principles, including continuous integration and continuous delivery, observability, and evaluation frameworks for large language model-based systems.
  • Understanding of AI risk, safety, and enterprise governance requirements.
  • Background in machine learning, deep learning, and natural language processing, including Transformer architectures.

Responsibilities

  • Design and lead the implementation of complex multi-agent AI workflows capable of advanced reasoning, planning, and autonomous execution, using frameworks such as LangGraph, CrewAI, and Google ADK.
  • Translate complex business problems in the risk domain into well-defined technical requirements and develop robust end-to-end AI solutions.
  • Implement end-to-end agentic AI workflows using frameworks such as LangGraph, CrewAI, and AutoGen, focusing on reasoning, tool use, and memory.
  • Build and optimize retrieval pipelines, memory layers, and tool-use sequences using frameworks such as LangChain.
  • Develop robust, scalable Python-based microservices and REST APIs using FastAPI to expose AI capabilities.
  • Construct and refine Retrieval-Augmented Generation pipelines, including document ingestion, embedding, and vector search integration with databases such as Azure AI Search or Pinecone.
  • Package AI services using Docker and deploy them on Kubernetes, contributing to continuous integration and continuous delivery pipelines for reliable releases.
  • Instrument AI workflows using platforms such as Langfuse for tracing and debugging, and implement and maintain evaluation harnesses to ensure model quality and performance.

Desired Qualifications

  • Experience leading the design of large language model evaluation harnesses for automated release validation.
  • Deep experience with Langfuse or similar AI observability and tracing platforms.
  • Hands-on expertise with AWS Bedrock, Azure AI Foundry, or Google Cloud Vertex AI.
  • Knowledge of GraphRAG patterns and advanced multi-hop retrieval strategies.
  • AWS certifications, such as Solutions Architect or AI/ML Specialty, or equivalent.
  • Background in financial services or another highly regulated industry.

About the Company

Citi

Runs banking and payments for global clients

Citi runs banking, investment and payment services for companies, governments and individuals around the world. Its global network connects institutions with local banking systems, while its US consumer business sells credit cards and deposit accounts. Corporate clients use Citi to manage cash, finance trade and raise capital, and investors use its trading, custody and wealth services to hold and manage assets. The bank earns interest on loans and fees from payments, securities transactions, financial advice and account services. Citi traces its banking roots to 1812; the Citigroup holding company was formed in 1998, and its headquarters are in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1812

Recently Posted Jobs

Explore more opportunities at Citi

See more jobs