Principal Software Engineer
Data
Posted on 7/19/2023
INACTIVE
Egen

201-500 employees

Cloud engineering & data platforms
Company Overview
Egen are cloud engineering and data experts partnering with fast-scaling startups and large enterprises to launch new digital applications, modernize data infrastructures, and create conversational interfaces powered by machine learning and AI.
Consulting

Company Stage

Pre-seed

Total Funding

$1.3M

Founded

2000

Headquarters

Naperville, Illinois

Growth & Insights
Headcount

6 month growth

0%

1 year growth

-1%

2 year growth

3%
Locations
Naperville, IL, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Bash
Microsoft Azure
Redshift
Python
Data Science
SQL
Apache Kafka
AWS
Elasticsearch
Hadoop
Data Analysis
Snowflake
Google Cloud Platform
CategoriesNew
Data & Analytics
Software Engineering
Requirements
  • Minimum of bachelor's degree or its equivalent in Computer Science, Computer Information Systems, Information Technology and Management, Electrical Engineering or a related field
  • You have extensive experience with legacy Informatica, and Hadoop based EDW platforms and have led or significantly contributed to a major cloud migration
  • You are a subject matter expert of standard concepts, best practices, and procedures within an enterprise data warehousing environment
  • You have a strong background in distributed data warehousing with AWS Redshift (Snowflake, Big Query, and/or Azure Data Warehouse)
  • You have expert programming/scripting knowledge in building and managing ETL pipelines using SQL, Python, and Bash
Responsibilities
  • Lead and develop passionate data engineering teams through complex data migrations from disparate legacy ETL platforms to modern and highly scalable distributed data platforms
  • Design and develop distributed ETL/ELT pipelines with cloud-native data stores. AWS, Redshift and Snowflake preferred
  • Facilitate fast and efficient data migrations through a deep understanding of design, mapping, implementation, management, and support of distributed data pipelines
  • Prepare data mapping, data flow, production support, and pipeline documentation for all projects
  • Create and document an end-to-end approach on data warehouse and data mart implementation plans
  • Consult our clients and business, product, and data science teams to understand end-user requirements or analytics needs to implement the most appropriate data platform technology and scalable data engineering practices
Desired Qualifications
  • Elasticsearch
  • Kafka
  • Any technical Professional Certification from AWS, Azure or GCP