U

U.S. Bank

Runs a national bank and processes card payments

Lead Software Engineer - Databricks & Cloud

Data EngineeringPosted on Nov 9
Full-time

About the Job

Requirements

  • Bachelor’s degree or equivalent work experience.
  • Six to eight years of relevant experience.
  • Strong hands-on experience with Python, PySpark, SQL, Spark SQL, and ETL/ELT development.
  • Hands-on expertise with Databricks, Delta Lake, Unity Catalog, medallion architecture, and Databricks Workflows/Lakeflow.
  • Experience building batch, CDC, streaming, API, and file-based pipelines, including Kafka or Azure Event Hubs.
  • Strong cloud data engineering experience with Azure and/or AWS, including services such as ADLS Gen2, Data Factory, S3, IAM, and related technologies.
  • Knowledge of Snowflake, Delta Sharing, Delta UniForm, Apache Iceberg, and cross-cloud data sharing.
  • Experience with data modeling, Power BI/DAX, data quality, governance, lineage, and PII/PCI controls.
  • Strong knowledge of Git, CI/CD, automated testing, technical design, architecture reviews, and engineering best practices.
  • Ability to provide technical direction, code review, and engineering guidance across distributed teams through influence rather than direct authority.

Responsibilities

  • Lead and guide Databricks data engineering across Bronze, Silver, and Gold layers, focusing on trusted, reusable Silver and Gold data products.
  • Translate business requirements into scalable data architecture, engineering designs, delivery standards, and technical acceptance criteria.
  • Remain hands-on in engineering and development, including coding, code review, and code management, while guiding delivery of batch, CDC, streaming, API, and file-based data pipelines.
  • Review data models, solution designs, and critical code for quality, security, scalability, performance, and alignment with engineering standards.
  • Drive cross-cloud data integration and sharing across Azure, AWS, Databricks, and Snowflake.
  • Embed data quality, lineage, governance, PII and PCI controls, monitoring, and reliability into data solutions.
  • Establish engineering best practices for CI/CD, testing, source control, deployment, and observability.
  • Provide technical leadership through influence across distributed onshore, offshore, and GCC engineering teams, establishing clear standards and guiding delivery without direct people-management responsibility.
  • Partner with product, architecture, governance, platform, and business stakeholders to resolve technical dependencies, risks, and delivery challenges.

Desired Qualifications

  • Experience working across multi-cloud environments.
  • Experience with Terraform, Apache Airflow, Datadog, Collibra, Tableau, or Databricks Metric Views.
  • Experience supporting AI/RAG or advanced analytics data use cases.
  • Banking, financial services, or other regulated-industry experience.
  • Experience working with Business Banking or commercial banking data products.
  • Databricks, Snowflake, Azure, or AWS certifications.

About the Company

U.S. Bank

Runs a national bank and processes card payments

U.S. Bank is one of the largest banks in the United States, serving consumers, small businesses, corporations, and government agencies with banking, lending, payments, and wealth management. Its Elavon subsidiary is one of the world's biggest processors of card payments for merchants, handling sales in the United States, Canada, and Europe. People and small businesses use its branches and mobile app for checking, savings, credit cards, mortgages, and loans, while companies use it for corporate cards and cash management, and the bank earns money from loan interest and fees. U.S. Bank received national bank charter No. 24 in 1863, under President Abraham Lincoln, and is based in Minneapolis as the main subsidiary of U.S. Bancorp.

Company size
10,001+
Company stage
IPO
Headquarters
Minneapolis, MN
Founded
1863

Recently Posted Jobs

Explore more opportunities at U.S. Bank

See more jobs