C

Citi

Runs banking and payments for global clients

Model Validation 2nd LOD Lead Analyst

Quantitative RiskConfirmed live in the last 24 hours
Full-timeWilmington, DE, USA$173k - $173.4k

About the Job

Requirements

  • A Master's degree or foreign equivalent in Statistics, Mathematics, Finance, or a related field and 3 years of experience in a specified model analysis, validation, model development, or data science position; alternatively, a Bachelor's degree in those fields and 5 years of progressively responsible post-baccalaureate experience in those positions.
  • Experience developing AI/ML models to analyze and interpret data for a financial services institution.
  • Experience across Model Risk Management, Artificial Intelligence, Machine Learning, Natural Language Processing, Unsupervised Learning, and Statistical Data Analysis.
  • Experience with Python, R, SQL, PyTorch, TensorFlow, Azure ML, and Spark.
  • Experience with Statistical Modeling, Hypothesis Testing, Perplexity, Benchmarking (MMLU, TruthfulQA), Sensitivity Analysis, Stress Testing, and Back-Testing.
  • Experience with Technical Documentation, Stakeholder Engagement, Cross-functional Collaboration, AI Alignment, Bias Detection and Mitigation, Guardrail Implementation, and Interpretability.
  • At least 1 year of experience with Generative Artificial Intelligence, Big Data, and Object-Oriented Programming.
  • At least 1 year of experience with LLMs, Transformer Architectures, RAG Pipelines, Prompt Engineering, Fine-Tuning (LoRA, RLHF, PEFT), Embedding Models, Vector Databases, Multi-Modal Models, and Agentic AI Frameworks.
  • At least 1 year of experience with Databricks, Uncertainty Quantification, BERT Score, HuggingFace, MLflow, Vertex AI, and LangChain.
  • At least 1 year of experience with BLEU, ROUGE, Validation Report Authoring, and Regulatory Communication.

Responsibilities

  • Provide independent review and effective challenge regarding the soundness and fit-for-purpose of Generative AI and AI/ML objects.
  • Independently manage Generative AI and AI/ML risk across lifecycle activities, including initial review, ongoing monitoring, and periodic reviews.
  • Conduct analysis and prepare detailed technical documentation reports that meet regulatory guidelines and industry standards.
  • Identify weaknesses and limitations of Generative AI and AI/ML objects, inform stakeholders of their risk profiles, and recommend compensating controls.
  • Communicate results to object owners, developers, and senior management.
  • Manage stakeholder interactions with Generative AI and AI/ML object developers and owners throughout the review lifecycle.
  • Interact with senior management to explain the use of risk models and inform critical decisions.
  • Develop Natural Language Processing and Generative AI applications to automate and streamline manual validation processes and improve operational efficiency.
  • Develop risk management practices, validation guidelines, and testing playbooks for AI/ML models, including Generative AI.
  • Lead collaboration with model development, risk governance, and business units on AI/ML/Generative AI projects; present complex validation findings and strategic recommendations to senior stakeholders and negotiate outcomes.
  • Provide structured mentorship to junior validators in technical skills, critical thinking, and communication.
  • Drive a team initiative to streamline a common validation process or improve knowledge sharing.
  • Explore and adopt at least one innovative methodology or tool to improve Generative AI model validation efficiency or effectiveness.
  • Develop internal guidance, best-practice documents, or training sessions based on these initiatives.

About the Company

Citi

Runs banking and payments for global clients

Citi runs banking, investment and payment services for companies, governments and individuals around the world. Its global network connects institutions with local banking systems, while its US consumer business sells credit cards and deposit accounts. Corporate clients use Citi to manage cash, finance trade and raise capital, and investors use its trading, custody and wealth services to hold and manage assets. The bank earns interest on loans and fees from payments, securities transactions, financial advice and account services. Citi traces its banking roots to 1812; the Citigroup holding company was formed in 1998, and its headquarters are in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1812

Recently Posted Jobs

Explore more opportunities at Citi

See more jobs