C

Citi

Runs banking and payments for global clients

Forward Deployed AI Engineer

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeNew York, NY, USAHybrid

About the Job

Requirements

  • A bachelor's or university degree, or equivalent experience, in Computer Science, Data Science, or a related quantitative discipline.
  • Five or more years of relevant software engineering experience, or two or more years with a specialized focus in Python, Java, or Go and Generative AI application development.
  • Solid proficiency in Python, Java, or Go, with hands-on experience integrating REST/gRPC APIs, Docker containers, and Git workflows.
  • Working knowledge of Generative AI concepts, prompt engineering, and evaluation methodologies such as semantic similarity, LLM-as-a-judge, and benchmark test suites.
  • Experience working with automated test pipelines and CI/CD tools such as Tekton, Jenkins, GitHub Actions, or Harness.
  • Strong analytical and problem-solving skills, communication skills, and a methodical, detail-oriented approach to software quality and data integrity.

Responsibilities

  • Develop and iterate on agent features, prompt templates, system instructions, few-shot examples, and data preprocessing scripts under the guidance of senior team members.
  • Build, calibrate, and execute automated evaluation test suites using enterprise evaluation studios and frameworks to measure agent task completion, tool-call correctness, semantic similarity, latency, and hallucination metrics.
  • Curate, version, and maintain domain-specific golden evaluation datasets, synthetic benchmarks, and edge-case regression testbeds in collaboration with Line of Business domain experts.
  • Author and maintain automated test execution scripts within enterprise CI/CD pipelines, enforcing continuous evaluation gates before staging and production rollout.
  • Validate and test AI guardrail policies, including prompt-injection defenses, toxicity filters, and personally identifiable information redaction, across agent input and output pipelines.
  • Monitor agent performance metrics, log evaluations, and generate prompt diagnostic reports to help squad leads and business stakeholders optimize agent behavior.
  • Participate with increasing autonomy in fast-paced agile squads, contributing to sprint planning, standups, and codebase maintenance.
  • Assess risk in business decisions, consider the firm's reputation and safeguard Citi, its clients, and assets; drive compliance with applicable laws, rules, and regulations; adhere to policy and apply sound ethical judgment; and transparently escalate, manage, and report control issues.

About the Company

Citi

Runs banking and payments for global clients

Citi runs banking, investment and payment services for companies, governments and individuals around the world. Its global network connects institutions with local banking systems, while its US consumer business sells credit cards and deposit accounts. Corporate clients use Citi to manage cash, finance trade and raise capital, and investors use its trading, custody and wealth services to hold and manage assets. The bank earns interest on loans and fees from payments, securities transactions, financial advice and account services. Citi traces its banking roots to 1812; the Citigroup holding company was formed in 1998, and its headquarters are in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1812

Recently Posted Jobs

Explore more opportunities at Citi

See more jobs