J

Johnson Controls

Provides smart building technology and services

Associate Director - Data Ingestion Delivery

Data EngineeringPosted on Nov 13
Full-timeMilwaukee, WI, USAIn-person

About the Job

Requirements

  • A bachelor's degree in Computer Science, Engineering, Information Systems, Data Management, or a related discipline, or equivalent professional experience.
  • At least 10 years of experience in data engineering, data integration, data platforms, or adjacent disciplines.
  • At least five years of experience leading technical teams, major platforms, programs, or engineering capabilities.
  • Demonstrated experience designing and operating enterprise-scale data ingestion architectures.
  • Strong understanding of ETL and ELT, APIs, change data capture, event and streaming architectures, data lakes and lakehouses, data warehousing, metadata, lineage, data quality, observability, and cloud data platforms.
  • Experience applying CI/CD, DevOps, and DataOps practices to production data pipelines.
  • Demonstrated enterprise architecture thinking, strategic planning, engineering excellence, and operational ownership.
  • Strong people leadership, stakeholder management, problem-solving, change leadership, risk management, and continuous-improvement capabilities.

Responsibilities

  • Own the enterprise roadmap and strategy for data ingestion.
  • Establish common ingestion patterns for batch, streaming, API, file, database, software-as-a-service, and event-based sources.
  • Drive standardization and reuse across business domains and source-system technologies.
  • Eliminate unnecessary point-to-point integrations and duplicate ingestion solutions.
  • Partner with Enterprise Architecture and platform leadership to align ingestion patterns with enterprise data architecture principles.
  • Build and operate a reusable, metadata- and configuration-driven ingestion framework that accelerates source onboarding and minimizes custom development.
  • Establish engineering standards for schema detection and evolution, incremental and change data capture processing, restart and recovery, idempotency, data validation, reconciliation, observability, logging, error handling, metadata capture, security, and encryption.
  • Develop reusable connectors and templates for strategic enterprise source platforms.
  • Apply consistent engineering practices to improve scalability, maintainability, security, and operational support.
  • Establish a documented intake and prioritization process for new ingestion requests.
  • Partner with source-system owners to understand availability, interfaces, refresh requirements, data volumes, dependencies, and business criticality.
  • Define onboarding standards and acceptance criteria that must be met before production deployment.
  • Maintain an enterprise source inventory identifying the owner, refresh cadence, criticality, and sensitivity classification of each feed.
  • Define and publish data freshness and availability service-level agreements for downstream teams.
  • Implement proactive ingestion monitoring and alerting so failures are identified before they affect downstream consumers.
  • Own pipeline reliability, incident response, root-cause analysis, and corrective-action delivery.
  • Establish dashboards covering pipeline health, freshness, latency, throughput, failures, and service-level attainment.
  • Apply DataOps and site reliability engineering practices to continuously improve ingestion reliability.
  • Implement automated data validation as information enters the platform.
  • Ensure source-to-Bronze reconciliation and ingestion completeness.
  • Automate the capture of technical metadata and lineage wherever possible.
  • Ensure ingestion pipelines follow applicable security, privacy, retention, and data governance standards.
  • Partner with Data Governance and Data Stewards on classification, ownership, sensitivity, and lifecycle requirements.
  • Ensure Bronze-layer data complies with applicable enterprise controls.
  • Own the execution of ingestion-related retention and lifecycle requirements.
  • Monitor unused datasets and manage their archival or removal according to defined policies.
  • Identify and retire legacy, manual, and unsupported ingestion mechanisms.
  • Maintain a modernization roadmap for high-risk or unsupported ingestion interfaces.
  • Lead and develop a high-performing team of ingestion engineers and technical leads.
  • Establish clear engineering standards, code-review practices, and technical ownership.
  • Build team capabilities across cloud data engineering, APIs, streaming, change data capture, DevOps, DataOps, and automation.
  • Establish engineering capacity planning and delivery accountability.
  • Foster a culture of automation, reuse, engineering excellence, continuous improvement, and operational ownership.
  • Partner closely with source-system owners, Enterprise Architecture, Data Platform Strategy and Standards, Data Governance, Data Operations, and domain data delivery leaders.
  • Collaborate with Cybersecurity, Privacy, Infrastructure, Cloud, business, and analytics teams to deliver secure and reliable ingestion capabilities.
  • Manage stakeholder expectations, dependencies, risks, priorities, and delivery commitments across enterprise initiatives.
  • Support vendor management and technology decisions related to enterprise ingestion capabilities.

Desired Qualifications

  • Experience with Snowflake and Microsoft Azure.
  • Experience with Azure Data Factory or Fabric Data Factory.
  • Experience with Databricks.
  • Experience with Kafka or other event-streaming platforms.
  • Experience with APIs and API management platforms.
  • Experience with change data capture technologies.
  • Experience integrating data from SAP, Oracle, and Salesforce.
  • Proficiency with SQL and Python.
  • Experience with Git-based CI/CD practices.
  • Experience with enterprise data observability and monitoring platforms.
  • Experience managing technology vendors and strategic delivery partners.

About the Company

Johnson Controls

Provides smart building technology and services

Johnson Controls transforms environments where people live, work, learn, and play by providing smart, healthy, and sustainable buildings. It offers comprehensive digital solutions through its OpenBlue platform, serving healthcare, education, data centers, airports, stadiums, manufacturing, and government sectors with a portfolio of building technology, software, and services focused on efficiency, safety, and sustainability. The company operates in more than 150 countries with about 100,000 experts and aims to reimagine building performance to benefit people, places, and the planet.

Company size
10,001+
Company stage
IPO
Headquarters
Cork, Ireland
Founded
1885

Recently Posted Jobs

Explore more opportunities at Johnson Controls

See more jobs