Data Engineer

Job Description:

The Role

The Cyber Data Analytics chapter within the Enterprise Cybersecurity organization is seeking a Data Engineer to join our team. You will be at the center of building, maintaining and securing scalable data solutions, including complex data pipelines, migrations, sophisticated data models. Our team serves as a proactive shield against internal and external cyber threats focusing on Identity and Access Management, supporting multiple executive leaders with high-impact analytics for decision-making. 

The Expertise and Skills You Bring 

• Bachelor’s or Master’s degree in computer science, Engineering, or a related technical field. 
• 2-5 years of relevant work experience in data engineering and data analysis. 
• Strong SQL skills and knowledge of multiple RDBMS, specifically Snowflake (including SnowSQL), Postgres, SQL Server and Oracle. 
• Proven data analysis skills to ensure data quality such as accuracy, consistency and completeness and to identify gaps and anomalies. 
• Proven experience building data pipelines using Python, with NiFi and dbt knowledge being a significant advantage. 
• Experience in building Power BI Reports that transform data into aesthetically appealing visuals. 
• Hands-on knowledge of AWS infrastructure, including S3, EC2, RDS, EKS, Batch, and CloudFormation. 
• Good understanding of data modeling principles, specifically 3NF and Star Schema models. 
• Experience with CI/CD workflows using Jenkins and GitHub for automated deployment. 
• Familiarity with workload scheduling and orchestration tools like Control-M. 
• Ability to work independently in an Agile environment (Scrum and Kanban) brings technical stories to completion. 
• Excellent communication and presentation skills.

Primary Responsibilities 

• Design and build scalable data solutions, including data processing pipelines, migrations, and complex data modeling. 
• Perform data analysis to assure data quality in terms of accuracy, consistency and completeness and to identify gaps and anomalies.
• Collaborate with product owners and business partners to translate high-level requirements into actionable technical tasks. 
• Analyze and manipulate datasets to ensure rigorous data integrity, accessibility, and security throughout the entire lifecycle. 
• Integrate automated testing and continuous validation into the sprint cycle to ensure production reliability. 
• Develop end-to-end solutions using distributed platform design patterns and modern analytics technologies. 
• Support and enhance production systems, focusing on high performance, speed, and overall system reliability. 
• Identify new development opportunities within a scalable public Cloud environment to enhance organizational capability. 

The Team 

Our Cyber Data Analytics Team is at the forefront of enterprise cybersecurity, dedicated to providing brand new data analytics solutions. We are part of the Enterprise Cyber Security organization. Our team boasts a diverse range of skills, including data engineers, analysts, and cybersecurity experts. Together, we build a dynamic environment that fosters innovation and problem-solving, envisioning a future where our analytics solutions serve as a proactive shield against cyber threats. 

For more like this search #DE

Category:

Information Technology