Data Engineer

Salary Range: 95000 to 110000 (Currency: USD) (Pay period: per-year-salary)

Primary Responsibilities:

Design, develop, and maintain scalable data ingestion and processing pipelines using Azure Data Factory (ADF), Azure Databricks, Apache Kafka, and related cloud technologies. 
Engineer and optimize data lakehouse solutions, including Delta Lake architectures, semantic models, conformed dimensions, and partitioning strategies that support enterprise analytics and AI/ML workloads. 
Integrate data from enterprise systems, legacy platforms, and cloud-based sources using batch, streaming, and event-driven ingestion patterns. 
Implement automated data validation, reconciliation, and monitoring to ensure data accuracy, completeness, consistency, and freshness. 
Support migration of data pipelines and analytical workloads to Summit, validating parity with source systems and ensuring production readiness. 
Optimize data processing performance, resource utilization, and cloud costs through workload tuning and efficient data architecture. 
Collaborate with data governance specialists to ensure ingested datasets are documented in the Enterprise Data Catalog (EDC), including required metadata, data definitions, and end-to-end lineage. 
Implement Government-approved data governance requirements within engineering solutions, including access controls, data quality standards, and dataset publication criteria. 
Develop and maintain technical documentation, including pipeline specifications, architecture decisions, operational procedures, and troubleshooting guidance. 
Monitor production pipelines, investigate failures and performance issues, and implement corrective actions to maintain reliable data services. 

Minimum Requirements:

Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related technical discipline, or an equivalent combination of education and relevant professional experience. 
Seven or more years of professional experience in data engineering, data integration, or enterprise data platform development. 
Demonstrated hands-on experience with Azure Data Factory, Azure Databricks, and Apache Kafka. 
Strong proficiency in Structured Query Language (SQL) and Python for data processing, transformation, and pipeline development. 
Experience designing and maintaining Extract, Transform, and Load (ETL) and Extract, Load, and Transform (ELT) pipelines. 
Experience with cloud-based lakehouse architectures, distributed data processing, and data modeling. 
Experience implementing automated data quality checks, pipeline monitoring, error handling, and performance optimization. 
Experience integrating data governance requirements into engineering workflows, including metadata management, data lineage, and policy-based data access controls. 
Familiarity with source control, automated testing, and Continuous Integration and Continuous Delivery (CI/CD) practices. 
Strong analytical, troubleshooting, communication, and collaboration skills. 
Ability to meet VA personnel vetting, background investigation, and system access requirements.
 The ability to travel for 1-2 domestic business trips per year. 

Preferred Qualifications:

Experience supporting VA or other federal agency data modernization initiatives. 
Experience working within Microsoft Azure Government cloud environments. 
Experience with Azure Synapse Analytics, dedicated SQL pools, or comparable enterprise data warehouse technologies. 
Familiarity with federated query technologies such as Starburst or Trino. 
Experience migrating complex legacy data warehouse workloads to cloud-based platforms. 
Experience working with sensitive healthcare data and federal privacy and security requirements. 
Microsoft Certified: Azure Data Engineer Associate or comparable cloud data engineering certification.

Benefits (including but not limited to):

Health, dental, and vision plans
Optional FSA
Paid parental leave
Safe Harbor 401(k) with employer contributions 100% vested from day 1
Paid time off and 11 paid holidays
No cost group term life/AD&D plan, and optional supplemental coverage
Pet insurance
Monthly phone and internet stipend
Tuition and training reimbursement