H

Honeywell

Diversified industrial conglomerate: aerospace, automation, safety

Lead Data Engineer

Data EngineeringPosted on Nov 9
Full-timeAtlanta, GA, USANo salary listed

About the Job

Requirements

  • At least 8 years of data engineering experience, including at least 2 years in a lead or senior role, with progression in technical complexity and team leadership.
  • Hands-on experience building and operating medallion lakehouse architectures using Bronze, Silver, and Gold layers.
  • Deep expertise in Apache Spark or PySpark and production experience with Azure Databricks at scale.
  • Strong proficiency with Apache Kafka and/or Azure Event Hub for real-time IoT data.
  • Cloud data architecture skills, preferably with Azure; AWS or GCP experience is a plus, including designing scalable, cost-effective data lakes and warehouses using cloud-native services.
  • Data modeling and schema design expertise for transactional and analytical workloads, including dimensional modeling and data vault methodologies.
  • Experience building data pipelines for GenAI or machine-learning applications, including retrieval-augmented generation (RAG) systems, embedding pipelines, and document ingestion.
  • Familiarity with MLOps, including model versioning, feature stores, and monitoring and observability for data and ML systems.
  • Ability to lead technical design reviews, mentor engineers, and drive architectural decisions with stakeholder buy-in.
  • Proficiency in continuous integration and continuous delivery (CI/CD) using GitHub Actions to automate data pipeline deployments.

Responsibilities

  • Architect end-to-end data pipelines processing terabytes of IoT telemetry on Azure Databricks using PySpark DLT, Lakeflow, and medallion lakehouse architecture.
  • Design and optimize real-time ingestion pipelines from Azure Event Hub and Apache Kafka for high-volume industrial IoT telemetry.
  • Build fault-tolerant, idempotent streaming architectures that handle schema evolution, backpressure, and latency service-level agreements.
  • Lead architecture reviews, set engineering standards, and drive decisions on data modeling, pipeline design, and platform evolution.
  • Define technical direction for AI-ready data products, including vector stores, embedding pipelines, and RAG-ready structured and unstructured data.
  • Adopt emerging large language model orchestration frameworks, including LangChain and LangGraph, to accelerate GenAI platform capabilities.
  • Build production GenAI pipelines, including RAG workflows, document ingestion, personally identifiable information (PII) anonymization, and vector database infrastructure.
  • Collaborate with data scientists and AI engineers to deliver high-quality AI-ready datasets that improve downstream model performance.
  • Enforce data governance, access control, and security policies, and lead PII detection and anonymization strategies across the data platform.
  • Use GitHub Actions, DAB, Octopus, and Bamboo to automate reliable pipeline delivery and promote CI/CD practices.
  • Ensure compliance with enterprise security standards within the software development lifecycle.
  • Mentor engineers across seniority levels through code reviews, pairing, and technical coaching.
  • Translate business and AI product requirements into technical roadmaps and execution plans.
  • Partner with data scientists, product owners, and architects to align data investments with Honeywell's autonomy strategy.

Desired Qualifications

  • Experience with LangChain, LangGraph, or other agentic AI orchestration frameworks.
  • Expertise in real-time data processing frameworks, including Apache Spark Streaming and Structured Streaming.
  • Knowledge of MLOps practices and experience building data pipelines for AI model deployment.
  • Experience with time-series databases and IoT data modeling patterns.
  • Familiarity with Docker and Kubernetes for AI workloads.
  • Background implementing data quality practices for AI training data.
  • Experience working with distributed teams and cross-functional collaboration.
  • Knowledge of data security and governance practices for AI systems.
  • Experience working on analytics projects using Agile and Scrum methodologies.

About the Company

Honeywell

Diversified industrial conglomerate: aerospace, automation, safety

Honeywell operates in four main areas—aerospace, building automation, performance materials and technologies (PMT), and safety and productivity solutions (SPS). Its products couple hardware, software, and services, delivering integrated solutions for customers in design, manufacturing, installation, maintenance, and analytics. It stands out through a broad, diversified portfolio, a global presence, and the ability to connect multiple stages of the product lifecycle into one ecosystem. The company aims to help customers operate more reliably and efficiently, reduce costs and environmental impact, and grow recurring revenue by offering solutions, services, and digital platforms that link its hardware and software offerings.

Company size
10,001+
Company stage
IPO
Headquarters
Charlotte, NC
Founded
1906

Recently Posted Jobs

Explore more opportunities at Honeywell

See more jobs