AI/ML Development Lead Internal Audit

We are looking for Lead with proficiency in Software Development using Python Artificial Intelligence and Machine Learning and large Language Models. Knowledge of J2SE is good to have. Primary focus would be to use available data, find patterns, conceptualize solutions to business problems and come up with Cognitive solutions which would help application users.

Role Description

Looking for a proficient individual contributor in machine learning to help us extract value from data. Proficiency in all the processes from data collection, cleaning, and preprocessing, to training models, identifying & solving problems using “Large language Models (LLMs)” on private public cloud and deploying solutions to production.

The ideal candidate will be passionate about artificial intelligence, LLMs and stay up to date with the latest & cutting-edge developments in the field.

Responsibilities

Leadership:                                                                                                              

• Work as Lead for a suite of applications within Internal Audit.
• Should own the responsibility of a module and synergize with team to deliver.
• Should be able to lead a team to deliver complex system designs.
• Understand requirements and code and unit test required components
• Support acceptance tests and production test
• Report progress on work and work collaboratively with the existing global team
• Keep abreast of latest technological happenings in his work area and bring relevant ideas/concept to the table

Delivery:

• Understanding business objectives and developing models that help to achieve them, along with metrics to track their progress.
• Understand & analyze business problems and try and find solutions by using tolls involving AI/ML, Large Language models.
• Analyzing the ML algorithms/LLMs that could be used to solve a given problem and ranking them by their success probability.
• Exploring and visualizing data to gain an understanding of it, then identifying differences in data distribution that could affect performance when deploying the model in the real world
• Verifying data quality, and/or ensuring it via data cleaning
• Supervising the data acquisition process if more data is needed
• Finding available datasets that could be used for training
• Defining validation strategies
• Defining the preprocessing or feature engineering to be done on a given dataset
• Store preprocessed data for quick lookup when applicable
• Defining data augmentation pipelines
• Training models and tuning their hyper-parameters
• Analyzing the errors of the model and designing strategies to overcome them
• Tuning models
•  Capability to identify pertinent models fit for the problem at hand

Skills

Should have 8-12 years of relevant experience into AIML

Deep understanding Of AI and hand-o on python. Proficiency with Large Language Models (LLMs)– understanding of in-depth details, infra needs and ability to provide solution to day-to-day problems using LLMs.

Proficiency with traditional machine learning models - classification & regression

Proficiency with a deep learning framework such as TensorFlow or Keras

Proficiency with Python and basic libraries for machine learning such as scikit-learn and pandas.

Expertise in visualizing and manipulating big datasets

Proficiency with OpenCV & PDF-Miner

Exposure to semantic and/or contextual searching

Familiarity with Linux

Nice to have

Exposure to Elastic-search, document database, and graph database

Knowledge on flask, Django

Development Value:

(What opportunities to develop can the job offer a prospective candidate?)

• Excellent opportunity to learn Compliance function and opportunity to work on integrated platform for Internal Audit.
• Opportunity to learn/ add domain skill in Internal Audit Analytics and GRC.
• Opportunity to directly work for one of the best technology teams on Wall Street.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Citi is an equal opportunity and affirmative action employer.

Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Citigroup Inc. and its subsidiaries ("Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View the "EEO is the Law" poster. View the EEO is the Law Supplement.

View the EEO Policy Statement.

View the Pay Transparency Posting