Full-Time

Director – Data Engineering

Updated on 5/17/2024

Hatch IT

Hatch IT

11-50 employees

Recruiting solutions for tech startups


Senior

St. Louis, MO, USA + 1 more

Required Skills
Microsoft Azure
Redshift
Python
Apache Flink
BigQuery
Apache Kafka
Java
AWS
Marketing
Apache Hive
Hadoop
Data Analysis
Snowflake
Google Cloud Platform
Requirements
  • 10 years of experience with modern data engineering projects and practices
  • Strong understanding and hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP)
  • 3 years of experience building data pipelines for AI/ ML models using PySpark or Python
  • 4+ years of experience building data pipelines with modern tools such as Data Bricks, Fivetran, dbt, etc.
  • Familiarity with lakehouse architecture and delta lake
  • BS in Computer Science, Engineering, Statistics, Informatics, Information Systems, or another quantitative field. Master’s degree preferred
Responsibilities
  • Designs and implements scalable data pipelines and analytics solutions on the Data Bricks platform
  • Designs and implements scalable, high-performance data architectures
  • Builds and manages data warehouses using technologies like Amazon Redshift, Google BigQuery, or Snowflake
  • Integrates data from core platforms like Marketing Automation, CRM, and Analytics into a centralized warehouse
  • Builds Extract, Load, and Transform (ELT) processes for ingesting and transforming data from various sources into a unified format
  • Proficient in big data technologies such as Hadoop ecosystem (HDFS, Hive, HBase), Apache Kafka, and Apache Flink
  • Programs in languages such as Python, Scala, or Java
  • Understands data governance principles, data privacy regulations (e.g., HIPAA, GDPR, CCPA), and best practices for ensuring data security and compliance
  • Provides solutions that are forward-thinking in data and analytics
  • Leads and mentors a team of both internal and contracted data engineers
  • Identifies complex data engineering challenges and devises innovative solutions
  • Stay updated with the latest advancements in data engineering, cloud technologies, and industry trends
  • Develop and implement quality controls and departmental standards to ensure quality standards, organizational expectations, and regulatory requirements
  • Contribute to the development and education plans on data engineering capabilities, systems, standards, and processes
  • Anticipate future demands of initiatives related to people, technology, budget and business within your department and design/implement solutions to meet these needs
  • Communicate results and business impacts of insight initiatives to stakeholders within and outside of the company

Hatch I.T. excels as a workplace due to its specialized role in supporting emerging tech startups through tailored recruiting solutions, including innovative programs like Scale which offers a customized Recruitment Process Outsourcing (RPO) for tech teams. This focus on the tech startup sector not only allows employees to engage deeply with the innovative startup ecosystem but also positions them at the forefront of industry-specific hiring trends and practices, providing a dynamic and growth-oriented work environment.

Company Stage

N/A

Total Funding

N/A

Headquarters

Tysons, Virginia

Founded

2012

Growth & Insights
Headcount

6 month growth

20%

1 year growth

4%

2 year growth

-11%

Benefits

Premium insurance

Mental health days

Caregiver leave

Time off

Internet reimbursement

Savings plan

Anniversary reward program

Additional benefits