W

William Blair

Investment banking, research, brokerage, asset management

Data & AI Engineer - Equities Technology

Data EngineeringConfirmed live in the last 24 hours
Full-timeChicago, IL, USA

About the Job

Requirements

  • A bachelor's degree in information technology or a related field.
  • 4–6+ years of hands-on experience with Databricks, Spark, Azure Data Factory, Azure Synapse, Python, Azure Data Lake Storage (ADLS), and Azure Functions.
  • Strong experience designing and managing Synapse and Azure Data Factory pipelines, activities, and linked services.
  • Ability to build full and incremental data loads from Azure and on-premises data sources.
  • Experience designing reusable ETL/ELT frameworks and orchestrating pipelines across Azure Data Factory, Synapse, and Databricks.
  • Experience implementing LLM-enabled or Retrieval-Augmented Generation (RAG)-based solutions in production environments.
  • Proficiency with REST APIs, data gateways, and third-party system integrations.
  • Strong SQL skills, including data modeling, analytical storage, and performance tuning.
  • Experience with Azure DevOps and YAML-based CI/CD pipelines.
  • Familiarity with Azure Key Vault, automation runbooks, Logic Apps, and cloud security best practices.
  • Strong communication, collaboration, and problem-solving skills.

Responsibilities

  • Design, build, and maintain scalable data pipelines using Databricks, Azure Data Factory, and Azure Synapse.
  • Implement robust ETL/ELT workflows for structured and unstructured financial data across on-premises and cloud platforms.
  • Ensure data quality, lineage, governance, security, and observability across pipelines and storage layers.
  • Design and optimize data models and analytical schemas, including star/snowflake schemas, partitioning, and distribution strategies.
  • Build reusable ingestion and transformation frameworks to support analytics and AI workloads.
  • Build and deploy AI-enabled services, agents, and workflows supporting equity research, trading, sales, and client service use cases.
  • Implement LLM-based and agentic patterns, including Retrieval-Augmented Generation (RAG), using proprietary firm data.
  • Integrate AI capabilities into existing applications and platforms through APIs, batch jobs, and event-driven workflows.
  • Partner with Data Science and business stakeholders to translate AI concepts into production-ready solutions.
  • Productionalize AI and Data Science proofs of concept into secure, scalable, and monitored services suitable for regulated environments.
  • Optimize prompts, embeddings, orchestration logic, and inference workflows for accuracy, performance, cost, and reliability.
  • Ensure AI solutions meet firm standards for security, auditability, explainability, and compliance.
  • Establish operational practices for AI solutions, including monitoring, alerting, lifecycle management, and runbooks.
  • Support migration of legacy data and application solutions, including SQL, SSIS, Synapse, and custom ETLs, to modern Azure-native architectures.
  • Implement CI/CD pipelines using Azure DevOps and YAML, following infrastructure-as-code and automation best practices.
  • Use Azure services, including Functions, Key Vault, Logic Apps, and Automation Runbooks, to build secure, reliable, and maintainable solutions.
  • Develop operational dashboards to monitor pipeline health, service-level agreements, system performance, and cloud spend.
  • Work with Product Managers, Software Engineers, Data Scientists, and business stakeholders to define functional and technical requirements.
  • Participate in Agile ceremonies, sprint planning, and retrospectives.
  • Lead testing of new and modified software, analyze issues, and resolve defects efficiently.
  • Document technical designs and integrations, and maintain operational playbooks and runbooks.
  • Monitor industry trends in data engineering, cloud platforms, and AI, and recommend adoption when aligned with firm strategy.

Desired Qualifications

  • Hands-on experience with Azure AI Services, including OpenAI and embeddings.
  • Familiarity with Microsoft Fabric for future roadmap alignment.
  • Proficiency in ASP.NET, .NET Core, or C#.
  • Background in financial services, capital markets, or other regulated environments.

About the Company

William Blair

Investment banking, research, brokerage, asset management

William Blair is a privately held, employee-owned financial services firm that offers investment banking, equity research, brokerage, asset management, and private capital services. It combines advisory, research, trading, asset management, and private capital solutions to help clients raise, invest, and manage capital. Being privately held and employee-owned differentiates it from many competitors and supports a client-focused, multi-disciplinary approach under one firm. Its goal is to help clients grow and protect their capital by providing comprehensive financial services and access to private capital when needed.

Company size
1,001-5,000
Company stage
Not listed
Total funding
$754.4M
Headquarters
Berlin, Germany
Founded
1935

Recently Posted Jobs

Explore more opportunities at William Blair

See more jobs