K

KeyBank

Provides banking, loans, and financial services

Lead Data Engineer - Technology Data Product

Data EngineeringConfirmed live in the last 24 hours
Full-timeBrooklyn, OH, USA

About the Job

Requirements

  • Advanced SQL proficiency and hands-on experience with BigQuery datasets, partitioning, clustering, views, schema updates, access controls, and query optimization.
  • Experience designing and operating production ELT/ETL pipelines, state management, incremental loading, and workflow scheduling with Cloud Composer or Apache Airflow.
  • Hands-on programming skills in Python and Bash shell scripting for container and pipeline workflows.
  • Practical experience extracting data from enterprise REST or GraphQL APIs, handling pagination, rate limits, OAuth flows, and secret management systems.
  • Experience developing modular data transformations, dependencies, and automated test assertions using Dataform or comparable SQL-based frameworks.
  • Experience writing reusable Terraform modules to provision GCP data and IAM resources, including BigQuery, Cloud Storage, service accounts, Cloud Run, and Cloud Composer.
  • Practical experience maintaining GitLab CI/CD pipelines, including environment stages, automated testing, container builds, and branch management.
  • Experience implementing automated data-quality controls, reconciliation, observability, alerting, failure recovery, and production support.
  • Experience applying access controls, secure credential handling, lineage, auditability, and data-governance requirements in a regulated or highly governed environment.
  • At least 5 years of hands-on data engineering experience building production cloud data pipelines and data warehouse solutions.
  • At least 2 years of practical experience integrating automated testing, infrastructure as code, and CI/CD deployment workflows.

Responsibilities

  • Design, build, and support production batch and incremental pipelines using Python, SQL, and Cloud Composer to collect and process data and telemetry from enterprise tools and source systems.
  • Implement and maintain BigQuery datasets, tables, views, and transformation workloads; optimize partitioning, clustering, query performance, access, storage, and compute costs.
  • Write and deploy automated transformation workflows and data-quality checks using Dataform.
  • Create and maintain repeatable Terraform configurations and GitLab CI/CD pipelines to automate testing, credential handling, and environment deployments across development, test, and production.
  • Build secure integrations with enterprise APIs and source systems using appropriate authentication and credential management, incorporating retry, error-handling, and rate-limiting patterns.
  • Configure pipeline monitoring, alerting, schema validation, and reconciliation jobs.
  • Partner with the Data Product Owner, data modelers, architects, platform teams, technology teams, and business stakeholders to translate product requirements, metric definitions, data-quality expectations, and governance requirements into reliable technical solutions.
  • Maintain technical documentation, lineage, data contracts, implementation guides, and evidence needed to support governance and audit requirements.
  • Conduct code reviews, establish reusable coding templates, and mentor team engineers on data-engineering and version-control best practices.

Desired Qualifications

  • Experience packaging and running lightweight workloads using Docker, Cloud Build, and Cloud Run.
  • Prior experience building reporting data models around software engineering tools such as Jira, ServiceNow, and GitLab.
  • Familiarity with event-driven data ingestion using Pub/Sub or Apache Beam / Google Cloud Dataflow.
  • Familiarity with engineering, operational, productivity, quality, cost, risk, or AI-related data.

About the Company

KeyBank

Provides banking, loans, and financial services

KeyBank provides a full range of banking services for individuals, small businesses, and commercial clients across the United States. It offers checking and savings accounts, credit cards, mortgages, loans, and other financial products. Customers use these products by making deposits, borrowing money, or using credit in everyday life; the bank earns interest on loans, fees for services, and commissions on products. KeyBank differs from many rivals by offering a wide geographic footprint and a focus on tailored financial solutions plus tools to improve financial wellness, such as budgeting resources and planning guidance. Its goal is to help clients reach financial milestones—like buying a home, paying down debt, or saving for the future—through a comprehensive set of services.

Company size
1,001-5,000
Company stage
IPO
Headquarters
Cleveland, OH
Founded
1824

Recently Posted Jobs

Explore more opportunities at KeyBank

See more jobs