Simplify Logo

Full-Time

Director – Data Engineering

Posted on 3/20/2024

Hatch IT

Hatch IT

11-50 employees

Recruiting solutions for tech startups

Senior, Expert

St. Louis, MO, USA + 1 more

Category
Data Engineering Management
Data & Analytics
Required Skills
Microsoft Azure
Redshift
Python
Apache Flink
BigQuery
Apache Kafka
Java
AWS
Marketing
Apache Hive
Hadoop
Data Analysis
Snowflake
Google Cloud Platform
Requirements
  • 10 years of experience with modern data engineering projects and practices
  • Strong understanding and hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform (GCP)
  • 3 years of experience building data pipelines for AI/ ML models using PySpark or Python
  • 4+ years of experience building data pipelines with modern tools such as Data Bricks, Fivetran, dbt, etc.
  • Familiarity with lakehouse architecture and delta lake
  • BS in Computer Science, Engineering, Statistics, Informatics, Information Systems, or another quantitative field. Master’s degree preferred
Responsibilities
  • Designs and implements scalable data pipelines and analytics solutions on the Data Bricks platform
  • Designs and implements scalable, high-performance data architectures
  • Builds and manages data warehouses using technologies like Amazon Redshift, Google BigQuery, or Snowflake
  • Integrates data from core platforms like Marketing Automation, CRM, and Analytics into a centralized warehouse
  • Builds Extract, Load, and Transform (ELT) processes for ingesting and transforming data from various sources into a unified format
  • Proficient in big data technologies such as Hadoop ecosystem (HDFS, Hive, HBase), Apache Kafka, and Apache Flink
  • Programs in languages such as Python, Scala, or Java
  • Understands data governance principles, data privacy regulations (e.g., HIPAA, GDPR, CCPA), and best practices for ensuring data security and compliance
  • Leads and mentors a team of both internal and contracted data engineers
  • Identifies complex data engineering challenges and devises innovative solutions
  • Stay updated with the latest advancements in data engineering, cloud technologies, and industry trends
  • Develop and implement quality controls and departmental standards to ensure quality standards, organizational expectations, and regulatory requirements
  • Contribute to the development and education plans on data engineering capabilities, systems, standards, and processes
  • Anticipate future demands of initiatives related to people, technology, budget and business within your department and design/implement solutions to meet these needs
  • Communicate results and business impacts of insight initiatives to stakeholders within and outside of the company

hatch I.T. offers tailored recruiting solutions for emerging tech startups, including a flagship program called Scale, which provides a customized Recruitment Process Outsourcing (RPO) hiring solution designed for startup tech teams. They also provide Contract-To-Hire and Contingency Hiring to support the needs of startups at every stage of growth.

Company Stage

N/A

Total Funding

N/A

Headquarters

McLean, Virginia

Founded

2012

Growth & Insights
Headcount

6 month growth

-4%

1 year growth

-4%

2 year growth

-4%

Benefits

Premium insurance

Mental health days

Caregiver leave

Time off

Internet reimbursement

Savings plan

Anniversary reward program

Additional benefits

INACTIVE