Data Engineer

About the role:

We are seeking a versatile and innovative Data Engineer who excels at the intersection of data engineering, full-stack development, and AI-powered integrations. The ideal candidate is skilled in SQL, AWS QuickSight, Superset, or another data analysis platform and modern data engines, with a strong ability to design secure, scalable systems that merge and sync diverse datasets in a virtual private cloud environment. Proficiency in building interactive, data-driven UIs and working with APIs and security protocols is essential. This role is perfect for someone passionate about harnessing the power of AI and data, with a meticulous focus on accuracy and meaning, while remaining flexible in tools and methodologies to deliver impactful solutions.

This is what you will do: 

Data Engineering & Analysis

• Design, build, and optimise data pipelines and data models for robust, scalable analytics.
• Work with large datasets to extract meaningful insights and support data-driven decision-making.
• Develop, deploy, and manage advanced and secure data systems using SQL, various AWS data pipelines & platforms, and other tools.

• Integrate AI/ML capabilities into data pipelines and analytics platforms. Prototype and implement machine learning models that solve real-world business problems.

Data Visualisation & UI Development

• Build and maintain data dashboards, reports, and visualisations using AWS Quicksight or similar tools.
• Design and develop user-friendly, interactive UIs for presenting complex datasets and models.
• Collaborate with stakeholders to ensure dashboards and tools meet business needs.

• Design and implement secure end-to-end solutions that integrate backend data systems with front-end applications or data displays.
• Develop and deploy interfaces for advanced data visualisation and interaction.

Collaboration & Problem-Solving

• Work closely with cross-functional teams, including engineers, and business analysts, to align on project goals and deliverables.
• Solve complex technical challenges related to data accuracy, integration, performance, and scalability.
• Advocate for best practices in data governance, security, and architecture.

Requirements: 

Core Technical Skills

• Proficient in SQL, AWS Athena, Quicksight, and other data visualization/analytics platforms.
• Experience with modern data engines and tools (e.g., Snowflake, Redshift, BigQuery, or similar).
• Strong programming skills in Python, JavaScript, R, and other languages.
• Experience with backend technologies such as Node.js, Flask, or Django.
• Ability to create and manage RESTful APIs for data systems.
• Proven ability to create visually compelling and insightful dashboards and UIs.
• Strong sense of design and user experience in data presentation, as well as systems-oriented design abilities (ability to deploy customizable secure data interfaces & visualization systems).

AI/ML Expertise

• Solid understanding of machine learning frameworks and libraries (e.g., TensorFlow, PyTorch, scikit-learn).
• Experience deploying and managing AI models in production environments.
• Strong analytical and critical-thinking skills to solve complex data challenges.
• Passion for exploring new AI capabilities and applying them to enhance data systems.

Soft Skills

• Collaborative mindset and excellent communication and leadership abilities to coordinate with a diverse technical team.
• Strong problem-solving skills.
• Ability to work in an agile development environment.

Bonus points if:

• Experience designing for platforms that incorporate AI, ML, or advanced analytics.
• Familiarity with accessibility standards and inclusive design practices.
• Knowledge of motion/interaction design and ability to create micro-interactions.