Data Engineer Consultant

Job Description

We are looking for an experienced Data Engineer consultant to design and govern complex, end-to-end data architectures. The role covers data ingestion, integration, processing, storage, governance and consumption, with responsibility for evaluating architectural alternatives and guiding technical decisions.

Main Responsibilities

• Design scalable, resilient and secure end-to-end data architectures aligned with business, functional and non-functional requirements.
• Define data models and architectures for Data Warehouses, Data Lakes, Lakehouses and analytical platforms.
• Design data integration approaches covering ETL/ELT, batch, streaming, CDC, APIs and event-driven patterns.
• Evaluate architectural and technology alternatives, document trade-offs and decisions through ADRs or equivalent mechanisms.
• Define and evolve reference architectures, blueprints, standards and data architecture principles.
• Embed Data Governance, Data Quality, Data Lineage, Metadata Management, Data Catalog, Master Data Management, security and GDPR considerations into architecture.
• Address performance, scalability, availability, recoverability, observability and cost optimisation requirements.
• Provide architecture governance and technical guidance to architects, data engineers and implementation teams.
• Produce architecture documentation and communicate recommendations to technical and business stakeholders.

Qualifications

• Minimum 15 years of professional IT experience, including proven experience in Data Architecture, Solution Architecture and complex data solution design.
• Degree in Computer Engineering, Software Engineering or a related field.
• Advanced knowledge of relational and NoSQL databases, data modelling, Data Warehouse, Data Lake, Lakehouse and Big Data technologies.
• Experience with Azure, AWS or Google Cloud.
• Strong experience with data integration architectures and patterns.
• Solid knowledge of data governance, security, quality, lineage, metadata, data catalogues, Master Data Management and GDPR.
• Experience with reference architectures, technology standards and Enterprise Architecture principles.
• Ability to analyse complex requirements, evaluate trade-offs and make architectural decisions autonomously.
• Technical leadership and the ability to influence architectural decisions across multidisciplinary and global teams.
• Knowledge of the Energy & Utilities sector.
• Strong written and verbal communication skills in English and Portuguese.

Additional Valued Experience

• Microsoft Fabric, Azure Databricks, Azure Synapse, BigQuery or Amazon Redshift.
• Strategic projects, Agile methodologies, JIRA and Confluence.
• Data architectures for Analytics, Machine Learning and AI.
• Portuguese and Spanish.

Additional Information