H

Huron

Global services firm enabling strategy, transformation

Data Engineer Senior Associate - Devops / Dataops / Delivery Engineering

Data EngineeringConfirmed live in the last 24 hours
Full-timeChicago, IL, USARemote

About the Job

Requirements

  • U.S. work authorization is required.
  • A bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent experience, is required.
  • At least 2–3 years of experience in data engineering, DevOps, or DataOps roles, including hands-on production data pipeline support, is required.
  • Strong hands-on experience with AWS data pipeline infrastructure, including S3, Athena, Lambda, EC2, and event-driven architectures such as SNS/SQS, is required.
  • Strong Python scripting ability for data ingestion, validation, and pipeline automation, and familiarity with Bash, are required.
  • Experience with CI/CD pipelines such as Jenkins or equivalent and Git-based version control practices, including branch protection and pull request workflows, is required.
  • Experience setting up, configuring, and supporting application deployments, not only writing pipeline code, is required.
  • Experience managing multi-client or multi-tenant data environments, including onboarding and provisioning new environments, is required.
  • Experience participating in incident response and root cause analysis for data pipeline and application issues is required.
  • Ability to work as a generalist across infrastructure, data engineering, and DevOps in a fast-moving, client-driven environment with shifting priorities is required.

Responsibilities

  • Support daily operation and monitoring of data pipelines across more than 10 concurrent client environments, triaging no-data, bad-data, and processing failures and escalating complex issues to the DataOps lead before client-facing reporting is affected.
  • Set up, configure, and support deployment of client-facing applications from environment setup through go-live stabilization and ongoing support.
  • Validate successful completion of daily data flows across client environments, checking consoles and logs and investigating further when needed.
  • Support provisioning and configuration of new client environments, including SFTP ingestion setup, instance provisioning, access controls, and coordination with client IT teams on file formats, schedules, and encryption.
  • Contribute to the team’s Jenkins CI/CD pipelines, AWS infrastructure, and Posit Connect analytics hosting platform under the DataOps lead’s direction.
  • Build and maintain pipeline-health monitoring and alerting, distinguish failure types, reduce false alarms, and identify client-visible data issues early.
  • Maintain runbooks and documentation for operational procedures and knowledge transfer.
  • Configure client application environments, including application and infrastructure settings, ahead of deployment.
  • Run and support production deployments, including go-live stabilization and post-launch monitoring.
  • Validate daily data loads and refreshes for every client application, using console-level checks first and deeper investigation when volumes or completion appear abnormal.
  • Investigate application and data-load issues, diagnose root causes across pipeline and application layers, and seek senior-team support for complex cases.
  • Build and maintain client-specific data ingestion pipelines using SFTP, S3, event-driven triggers, and file validation, following architectural guidance from the DataOps lead.
  • Build and maintain standardized, reusable data-validation scripts for quality assurance across client environments.
  • Ingest historical data for new client onboardings and resolve data-quality incidents involving missing files, null values, file-extension issues, and reprocessing.
  • Support migration of the data lake and core tables to Snowflake.
  • Operate and monitor daily processing pipelines across all client environments, distinguishing Lambda failures from regular pipeline failures to reduce false alarms.
  • Build real-time data-integrity alerts for issues such as null DRGs, late file delivery, and failed runs, and route alerts to the team.
  • Investigate and resolve daily processing failures through root-cause analysis, temporary fixes, and permanent remediation.
  • Manage AWS Lambda functions, including version control, deployment, and event-driven triggering through SNS/SQS.
  • Build data-volume quality-control dashboards to track pipeline health across clients.
  • Help manage AWS infrastructure, including EC2, S3, RDS, Athena, IAM, Lambda, and SNS/SQS, across client deployments under the DataOps lead’s direction.
  • Support Posit Connect administration, including configuration, user access, and runtime management for the team’s R-based reporting stack.
  • Provision new client instances, including database setup, ingestion configuration, and access controls.
  • Handle SAML/SSO certificate management and PGP encryption setup for secure client file delivery.
  • Help enforce code-repository governance, including branch protection, pull-request approval requirements, and deployment controls.
  • Build and maintain Jenkins-based CI/CD pipelines from development through staging and production.
  • Set up and validate development and staging environments.
  • Support the team’s Docker-based monorepo deployment architecture across client environments.
  • Execute and document client offboarding processes.
  • Support mandatory Huron compliance activities, PHI data classification, and audit-control documentation.
  • Manage certificate renewals, access-restriction enforcement, and credential rotation for SMTP and IAM.

Desired Qualifications

  • Experience with Snowflake or other modern cloud data warehouse platforms is preferred.
  • Posit Connect or R/Shiny environment familiarity is preferred.
  • Docker and containerized deployment experience is preferred.
  • SAML/SSO certificate management and cloud security practices, including IAM key rotation and PGP encryption, are preferred.
  • Healthcare data environment experience, including SFTP clinical file delivery, PHI handling, and HL7/ADT familiarity, is preferred.
  • Experience building monitoring and alerting systems for data pipelines is preferred.
  • Occasional direct client IT coordination experience involving file delivery issues, certificate renewals, or data-quality questions is preferred.

About the Company

Huron

Global services firm enabling strategy, transformation

Huron is a global professional services firm that helps organizations turn ideas into real results. It works with clients to develop practical strategies, improve how they operate, and speed up digital transformation, while also empowering people within the client organization to own their future. The firm achieves this by bringing diverse perspectives, inviting new ideas, and questioning the status quo to deliver lasting outcomes. In short, Huron guides clients from planning to execution so they can achieve sustainable success.

Company size
5,001-10,000
Company stage
IPO
Headquarters
Amman, Jordan
Founded
2002

Recently Posted Jobs

Explore more opportunities at Huron

See more jobs