The Opportunity:

We are seeking an experienced Data Engineer with a minimum of 3 years of experience in building data ingestion pipelines for large datasets. As a key player in our team, you will be responsible for designing, building, and managing our data infrastructure, supporting our data-driven decision-making capability. You’ll need to be proficient in Python, AWS, and common frameworks used for data ingestion, transformation, and consolidation. The ideal candidate will be passionate about data, a strong team player, and have a continuous learning mentality.

Responsibilities:

• Design, develop and optimize data ingestion pipelines to handle real-time and batch data streams using a variety of sources.
• Utilize your extensive knowledge of Python and AWS to engineer solutions for the transformation, consolidation, and storage of large datasets.
• Collaborate with data scientists and other stakeholders to understand data needs and translate them into data systems and pipelines.
• Enhance our data ecosystem by leveraging industry best practices for testing, deployment, and runtime environments.
• Drive continuous improvements to data reliability, efficiency, and quality.
• Document data architectures, procedures, and data flows, maintaining excellent communication with the team and stakeholders.
• Monitor data systems performance, troubleshoot data issues, perform root cause analysis, and ensure the implementation of optimal solutions.
• Participate in data governance and ensure adherence to data security and privacy standards.

Requirements:

• A minimum of 3 years of experience as a Data Engineer or in a similar role.
• Strong proficiency with Python, AWS, and common frameworks used in data ingestion and transformation.
• Hands-on experience building and optimizing large scale data pipelines, architectures, and data sets.
• Knowledge of data warehousing concepts, including data modeling, data cleaning, and ETL processes.
• Strong understanding of database design and data management principles.
• Experience with AWS cloud services such as EC2, S3, Redshift, DynamoDB, and others.
• Strong problem-solving skills, and the ability to analyze data and design solutions to complex data issues.
• Excellent communication and teamwork skills, and a passion for data.
• Experience with other programming languages (e.g., Java, Scala) is a plus.
• Familiarity with big data tools (e.g., Hadoop, Spark) is a plus.

Check out what our employees think about working at Seamless: CLICK HERE