Simplify Logo

Full-Time

Senior Data Engineer

Cloud/EDA/Kafka

Posted on 7/19/2023

Egen

Egen

201-500 employees

Provides cloud and AI engineering services

Consulting

Senior

Naperville, IL, USA

Category
Data & Analytics
Required Skills
Bash
Microsoft Azure
Redshift
Python
Data Science
SQL
Apache Kafka
Data Analysis
Snowflake
Requirements
  • Minimum of Bachelor's Degree or its equivalent in Computer Science, Computer Information Systems, Information Technology and Management, Electrical Engineering or a related field
  • You have productionized real-time data pipelines through EDA leveraging Kafka or a similar service
  • You know what it takes to build and run resilient data pipelines in production and have experience implementing ETL/ELT to load a multi-terabyte enterprise data warehouse
  • You have a strong understanding and exposure to data mesh principles in building modern data-driven products and platforms
  • You have a strong background in distributed data warehousing with Snowflake, Redshift, Big Query, and/or Azure Data Warehouse
  • You have expert programming/scripting knowledge in building and managing ETL pipelines using SQL, Python, and Bash
  • You have implemented analytics applications using multiple database technologies, such as relational, multidimensional (OLAP), key-value, document, or graph
Responsibilities
  • Lead and develop passionate data engineering teams to design and develop distributed and event-driven data pipelines with cloud-native data stores such as Snowflake, Redshift, Big Query, or ADW
  • Design, document, and lead development of end-to-end data product pipelines
  • Consult business, product, and data science teams to understand end-user requirements or analytics needs to implement the most appropriate data platform technology and scalable data engineering practices
  • Prepare data mapping, data flow, production support, and pipeline documentation for all projects
  • Lead data engineering and/or operations teams in delivering completeness of source system data by performing a profiling analysis and triaging issues reported in production systems
  • Facilitate fast and efficient data migrations through a deep understanding of design, mapping, implementation, management, and support of distributed data pipelines

Egen provides a dynamic work environment focused on cloud, data, AI, and platform engineering. This firm is a leader in empowering organizations through their digital transformations, offering a robust portfolio in cloud infrastructure, data architecture, and AI-driven solutions. Employees at Egen benefit from engaging in cutting-edge technology projects and a culture that encourages innovative problem-solving.

Company Stage

Pre-seed

Total Funding

$1.3M

Headquarters

Naperville, Illinois

Founded

2000

Growth & Insights
Headcount

6 month growth

0%

1 year growth

0%

2 year growth

0%
Simplify Jobs

Simplify's Take

What believers are saying

  • Working at Egen offers exposure to cutting-edge technologies and innovative projects, fostering professional growth.
  • The company's emphasis on digital transformation means employees are at the forefront of industry trends and developments.
  • Egen's collaborative work environment and strategic partnerships provide ample opportunities for networking and career advancement.

What critics are saying

  • The fast-paced nature of the tech industry requires constant adaptation, which can be challenging for employees.
  • Egen's reliance on strategic partnerships means any disruption in these relationships could impact business operations.

What makes Egen unique

  • Egen's unique approach to leveraging data analytics and cloud solutions sets it apart from traditional IT service providers.
  • Their focus on digital transformation and modernization for businesses provides a competitive edge in a rapidly evolving tech landscape.
  • Egen's strategic partnerships and collaborations enhance their service offerings, making them more versatile compared to standalone competitors.

Benefits

Fun team outings

Health insurance

401(K)

Dental & vision insurance

Paid time-off

Food & drinks

Parental leave

INACTIVE