Arthur J. Gallagher & Co.

Global insurance brokerage, risk management, consulting

Lead Data Solution and AI Engineer

Data EngineeringConfirmed live in the last 24 hours

Full-timeRolling Meadows, IL, USANo salary listedIn-person

About the Job

Requirements

At least 10 years of progressive experience as a Data Solutions and AI Engineer using current and emerging data technologies and approaches, including at least 7 years on the Microsoft platform.
At least 7 years designing and building large applications using SQL Server and related database technologies.
At least 7 years of experience with physical and cloud database design.
At least 7 years of experience migrating code, database changes, data, and menus through the software development lifecycle.
At least 2 years of experience designing, developing, and deploying AI/ML-powered applications and cloud data solutions.
At least 2 years of experience with natural language processing, entity resolution algorithms, Graph RAG, ontology, and distributed systems.
At least 4 years of experience with CI/CD pipelines and deployment tools.
At least 2 years of experience developing search, retrieval, recommendation, or knowledge management solutions.
At least 2 years of experience with microservices, event-driven architectures, and containerized applications.
At least 3 years of experience working with C#, .NET, REST APIs, and modern application architecture to support integration and solution development.
At least 5 years of experience with database and application performance tuning.
A bachelor's degree in Computer Science, Engineering, or a related field.
A university degree and a minimum of 7 years of prior relevant experience, or equivalent experience.
Strong communication skills with management, development teams, vendors, systems administrators, and other service providers.
Ability to lead a project team, develop and communicate a technology vision, and create detailed estimates for planned technology activities.
Deep technical understanding of data and a disciplined approach to work and craft.
Ability to stay current with emerging data engineering and AI technologies.

Responsibilities

Design and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, Synapse Analytics, and Azure SQL to support analytics, reporting, and AI/ML workloads.
Develop data ingestion, transformation, validation, and loading workflows from APIs, databases, Azure Blob Storage, ADLS Gen2, third-party systems, and on-premises SQL databases.
Support on-premises SQL Server integration, including data extraction, synchronization, replication, and performance tuning.
Write and optimize T-SQL queries, stored procedures, views, and functions to support data processing, reporting, and analytics.
Support data models, data marts, and feature stores for analytics and machine learning use cases.
Develop, train, fine-tune, deploy, and monitor AI/ML models using structured and unstructured data, including model versioning, performance tracking, and retraining.
Develop AI-powered capabilities using large language models and AI services.
Implement intelligent search, knowledge retrieval, and automation solutions.
Troubleshoot ETL failures, data latency issues, and production incidents across Azure and on-premises environments.
Identify and implement process improvements that automate manual activities and improve data delivery.
Improve the performance, scalability, reliability, and maintainability of data engineering solutions.
Apply Azure security best practices, including role-based access control, Managed Identities, Azure Key Vault, and private networking.
Ensure data quality, consistency, lineage, and governance through validation, reconciliation, and exception-handling processes.
Provide technical guidance and leadership to junior developers.
Provide data architecture recommendations, project team leadership, technology vision, and detailed estimates.

Desired Qualifications

Experience with Snowflake and Microsoft Fabric.
Experience with SQL, Python, Azure Data Factory, Databricks, and Spark.
Experience with data transformation, cloud data, distributed data warehouses, and data lakes.
Communication and stakeholder management skills.

Introduction

At Gallagher Bassett, we're there when it matters most because helping people through challenging moments is more than just our job, it’s our purpose. Every day, we help clients navigate complexity, support recovery, and deliver outcomes that make a real difference in people’s lives. It takes empathy, precision, and a strong sense of partnership—and that’s exactly what you’ll find here. We’re a team of fast-paced fixers, empathetic experts, and outcomes drivers — people who care deeply about doing the right thing and doing it well. Whether you're managing claims, supporting clients, or improving processes, you’ll play a vital role in helping businesses and individuals move forward with confidence. Here, you’ll be supported by a culture that values teamwork, encourages curiosity, and celebrates the impact of your work. Because when you’re here, you’re part of something bigger. You’re part of a team that shows up, stands together, and leads with purpose.

How you'll make an impact

The Lead Data Solution and AI Engineer developer provides guidance, leadership, and solid execution of data integration solutions as they related to BI and AI project initiatives. Typically, this role participates in multiple, technically complex, mission-critical, and/or high-profile data projects or initiatives. This individual must possess strong leadership skills including the ability to make sound data architectural solutions recommendations.

Key Responsibilities:

Data Platform and Pipeline Delivery

Design and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, Synapse Analytics, and Azure SQL to support analytics, reporting, and AI/ML workloads.

Develop data ingestion, transformation, validation, and loading workflows from APIs, databases, Azure Blob Storage, ADLS Gen2, third-party systems, and on-premises SQL databases.
Support on-premises SQL Server integration, including data extraction, synchronization, replication, and performance tuning.
Write and optimize T-SQL queries, stored procedures, views, and functions to support data processing, reporting, and analytics.
Support data models, data marts, and feature stores for analytics and machine learning use cases.
Develop, train, fine-tune, deploy, and monitor AI/ML models using structured and unstructured data, including model versioning, performance tracking, and retraining.
Develop AI-powered capabilities using modern large language models (LLMs) and AI services.
Implement intelligent search, knowledge retrieval, and automation solutions.
Troubleshoot ETL failures, data latency issues, and production incidents across Azure and on-premises environments.

Process Improvement and Operational Excellence

Identify and implement process improvements that automate manual activities and improve data delivery.
Improve the performance, scalability, reliability, and maintainability of data engineering solutions.

Security, Governance and Compliance

Apply Azure security best practices, including RBAC, Managed Identities, Azure Key Vault, and private networking.
Ensure data quality, consistency, lineage, and governance through validation, reconciliation, and exception-handling processes.

People Leadership

Provide technical guidance and leadership to junior developers.
Provide data architecture recommendations, project team leadership, technology vision, and detailed estimates.

Core technical stack:

Data Platform and Engineering

Microsoft/Azure: Azure Data Warehouse, Azure SQL Database / Synapse, Azure Data Factory, Azure Functions, SQL Server, T-SQL, SSIS
Data & engineering tools: DevOps, Databricks

AI and Advanced Analytics Enablement

Python, NumPy, Pandas, PyArrow
AI/LLM tools: OpenAI, LangChain, LlamaIndex, AI tools, Vector Database

About You

10+ years of progressive experience as a Data Solutions and AI Engineer using current and emerging data technologies and approaches, including 7+ years on the Microsoft platform.

7+ years designing and building large applications using SQL Server and related database technologies.

7+ years experience with physical and cloud database design

7+ years experience migrating code, database changes, data, and menus through the software development lifecycle.

2+ years experience designing, developing, and deploying AI/ML-powered applications and cloud data solutions.

2+ years experience with NLP, entity resolution algorithms, Graph RAG, ontology, and distributed systems

4+ years experience with CI/CD pipelines and deployment tools

2+ years experience developing search, retrieval, recommendation, or knowledge management solutions.

2+ years experience with microservices, event-driven architectures, and containerized applications

3+ years experience working with C#, .NET, REST APIs, and modern application architecture to support integration and solution development.

5+ years strong understanding of database and application performance tuning

Experience in Snowflake and Microsoft Fabric a plus

Bachelor’s degree in computer science, Engineering, or a related field

Strong communication skills with management, development teams, vendors, systems administrators, and other service providers

Required:
Typically requires a University Degree and minimum 7 years of prior relevant experience, or equivalent experience.

You are a strong communicator and an active listener.
A passion for technology
Deep technical understanding of all things data
Ability to lead a project team
Ability to paint a technology vision and communicate its value
Ability to create detailed estimates for planned technology activities.
A disciplined approach to your work life and your craft
Stay current with emerging data engineering and AI technologies.

Preferred:
• SQL Python, Azure data factory, Data
• Bricks, Spark (experience would be a plus)
• Data transformation
• Cloud Data Experience
• Distributed data warehouse knowledge
• Data Lakes
• Communication and stakeholder management skills

Compensation and benefits

At Gallagher, we believe supporting our colleagues goes far beyond the role itself. For more information, visit our Benefits page.

Competitive compensation
Comprehensive benefits programs designed to support your well-being
Career development opportunities and ongoing learning
A collaborative, people-first culture with accessible leadership
The opportunity to do meaningful work with global reach and local impact

At Gallagher, we are dedicated to building an inclusive and authentic workplace. If your past experience doesn’t align perfectly, we encourage you to join our Talent Community to stay connected to additional career opportunities. At times, we will consider transferable skills from previous roles.

Gallagher is an affirmative action/equal opportunity employer (Minorities/Females/Veterans/Disabled)

About the Company

Arthur J. Gallagher & Co.

Global insurance brokerage, risk management, consulting

Arthur J. Gallagher & Co. is a global insurance brokerage and risk management firm. It helps businesses, public entities, and individuals manage risk and obtain insurance through three segments: brokerage, risk management, and corporate. The brokerage unit offers a full range of retail and wholesale insurance brokerage and consulting services to match clients with coverage. The risk management unit handles contract claim settlements, claim administration, loss control consulting, and risk management information services to reduce exposures. The corporate unit oversees the company’s clean energy and other investments. The firm differentiates itself by providing end-to-end risk solutions across insurance placement, claims handling, risk counseling, and investment activities, rather than focusing on a single service. Its goal is to help clients manage risk effectively, protect assets, and pursue value through diverse investments, including clean energy.

Company size: 10,001+
Company stage: IPO
Headquarters: Itasca, IL
Founded: 1927

Recently Posted Jobs

Explore more opportunities at Arthur J. Gallagher & Co.

See more jobs