Model Validation 2nd LOD Lead Analyst
Citi
Model Validation 2nd LOD Lead Analyst
Citi
Runs banking and payments for global clients
Citibank, N.A. seeks a Model Validation 2nd LOD Lead Analyst for its Wilmington, Delaware location.
Duties: Provide independent review and effective challenge on the soundness and fit-for-purpose of Generative AI, AI (Artificial Intelligence) / ML (Machine Learning) objects. Act as a senior model validator to independently manage Generative AI, AI (Artificial Intelligence)/ML(Machine Learning) risk across all life-cycle activities including initial review, ongoing monitoring, and periodic reviews. Conduct analysis and prepare detailed technical documentation reports sufficient to meet regulatory guidelines and exceed industry standards. Identify weaknesses and limitations of Generative AI, AI/ML objects and inform stakeholders of their risk profile and recommend compensating controls. Communicate results to diverse audiences such as object owners and developers and senior management. Manage stakeholder interactions with Generative AI, AI(Artificial Intelligence)/ML(Machine Learning) object developers and owners across the review lifecycle. Interacts with senior levels of management to facilitate understanding of usage of risk models and inform critical decisions. Develop NLP and GenAI applications to automate and streamline existing manual validation processes, aiming to increase operational efficiency for the organization. Developed state-of-art risk management practice, validation guidelines, and testing playbooks for AI/ML(including GenAI) models. Lead collaborative efforts with cross-functional teams (e.g., model development, risk governance, business units) on key AI/ML/GenAI projects and present complex validation findings and strategic recommendations to senior stakeholders and successfully negotiating outcomes. Provide structured mentorship for junior validators, focusing on their technical skills, critical thinking, and communication. Drive team initiative to streamline a common validation process or improve knowledge sharing. Drive the exploration and adoption of at least one innovative methodology or tool to enhance GenAI model validation efficiency or effectiveness. Develop internal guidance, best practices document, or training session based on these initiatives. A telecommuting/hybrid work schedule may be permitted within a commutable distance from the worksite, in accordance with Citi policies and protocols.
Requirements: Requires a Master’s degree or foreign equivalent in Statistics, Mathematics, Finance or related field and 3 years of experience as a Model Analysis Validation Officer, Senior Model Developer, Data Scientist or related position developing AI/ML models to analyze and interpret data for a financial services institution. Alternatively, employer will accept a Bachelor’s degree in the listed fields and 5 years of progressively responsible, post-baccalaureate experience in the listed positions. Full span of experience must include: Model Risk Management, Artificial Intelligence, Machine Learning, Natural Language Process; Unsupervised Learning, Statistical Data Analysis; Python, R, SQL, PyTorch, TensorFlow, Azure ML, Spark; Statistical Modeling, Hypothesis Testing, Perplexity, Benchmarking (MMLU, TruthfulQA), Sensitivity Analysis, Stress Testing, Back-Testing; Technical Documentation, Stakeholder Engagement, Cross-functional Collaboration, AI Alignment, Bias Detection & Mitigation, Guardrail Implementation, Interpretability. Additionally, 1 year of experience must include: Generative Artificial Intelligence, Big Data, Object Oriented Programming; LLMs, Transformer Architectures, RAG Pipelines, Prompt Engineering, Fine-Tuning (LoRA, RLHF, PEFT), Embedding Models, Vector Databases, Multi-Modal Models, Agentic AI Frameworks; Databricks, Uncertainty Quantification, BERT Score, HuggingFace, MLflow, Vertex AI, LangChain; BLEU, ROUGE, Validation Report Authoring, Regulatory Communication. Applicants submit resumes at https://jobs.citi.com/. Please reference Job ID #26991798. EO Employer.
Wage Range: $173,000 to $173,400
Job Family Group: Risk Management
Job Family: Model Validation
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
In addition to salary, Citi’s offerings may also include, for eligible employees, discretionary and formulaic incentive and retention awards. Citi offers competitive employee benefits, including: medical, dental & vision coverage; 401(k); life, accident, and disability insurance; and wellness programs. Citi also offers paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays. For additional information regarding Citi employee benefits, please visit citibenefits.com. Available offerings may vary by jurisdiction, job level, and date of hire.
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
We use automated processing, including artificial intelligence, for our legitimate business interests (or our reasonable and appropriate business purposes) to identify and align the candidate's skills and abilities with a specific job opening. Additionally, if you so choose, or consent, we can match your skills and abilities to other suitable roles at Citi.
Importantly, all our hiring processes and decisions, including determining your suitability for a role, are conducted, checked, and decided by individuals. Our automated processing and AI do not involve relying on automatic or autonomous decision-making. Please refer to any Jurisdictional Considerations, with specific provisions for your country (where relevant) for further details.
Illinois residents – AI Notice and Right
------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.
Citi runs banking, investment and payment services for companies, governments and individuals around the world. Its global network connects institutions with local banking systems, while its US consumer business sells credit cards and deposit accounts. Corporate clients use Citi to manage cash, finance trade and raise capital, and investors use its trading, custody and wealth services to hold and manage assets. The bank earns interest on loans and fees from payments, securities transactions, financial advice and account services. Citi traces its banking roots to 1812; the Citigroup holding company was formed in 1998, and its headquarters are in New York City.
Explore more opportunities at Citi