Microsoft Fabric Data Lake Developer

About Us

ABeam Consulting is a global professional services company that specializes in delivering business transformation and technology solutions to clients across a wide range of industries. With a global presence and over 9000 employees worldwide we aim to be the transformation partner of choice for all of our clients.

Role Overview
We are seeking a Microsoft Fabric Data Lake Developer to design, develop, and maintain scalable data solutions using Microsoft Fabric and OneLake. The role involves building data pipelines, implementing lakehouse architectures, and preparing reliable datasets for analytics and reporting.

Key Responsibilities

• Design and develop lakehouse solutions using Microsoft Fabric, OneLake, and Delta tables.
• Build and maintain data ingestion and transformation pipelines using Fabric Data Factory, Dataflows Gen2, and notebooks.
• Integrate data from databases, APIs, enterprise applications, and file-based sources.
• Implement Bronze, Silver, and Gold data layers using a medallion architecture.
• Develop transformations using SQL, Python, PySpark, and Spark SQL.
• Implement incremental loading, change data capture, and data validation processes.
• Monitor pipelines, troubleshoot failures, and optimize performance and resource usage.
• Apply data security, access controls, governance, and data quality standards.
• Prepare curated datasets for Power BI reporting and downstream analytics.
• Collaborate with architects, business analysts, and reporting teams to translate requirements into technical solutions.
• Maintain technical documentation, source-to-target mappings, and operational support procedures.
• Support version control, testing, and deployment across development, test, and production environments.

Required Skills and Experience

• Hands-on experience with Microsoft Fabric, including Lakehouse, OneLake, Data Factory pipelines, and notebooks.
• Strong SQL skills and practical experience with Python or PySpark.
• Experience developing ETL/ELT pipelines and working with structured and semi-structured data.
• Understanding of Delta Lake, Parquet, dimensional modelling, and medallion architecture.
• Experience implementing data quality checks, error handling, logging, and monitoring.
• Knowledge of data security, workspace permissions, and access management.
• Familiarity with Git and CI/CD practices for data solutions.
• Strong analytical, troubleshooting, and communication skills.

Preferred Qualifications

• Experience with Azure Data Factory, Azure Data Lake Storage, Azure Databricks, or Azure Synapse Analytics.
• Experience integrating SAP, Dynamics 365, Salesforce, or other enterprise systems.
• Familiarity with Power BI semantic models and Direct Lake.
• Knowledge of Microsoft Purview and data governance practices.

Why Join Us

At ABeam Consulting, we place a strong emphasis on collaboration, and helping our employees grow and develop their skills, offering a supportive and empowering work environment. With a presence in multiple countries and a diverse range of clients, ABeam Consulting offers an exciting and dynamic workplace for individuals looking to build a career in consulting. ABeam Consulting has also recently joined SAP’s regional strategic partner initiative as their first regional partner in the region and has also been recognized by UiPath as a Diamond Partner in providing RPA solutions. With such accolades, we aim to continue driving enterprise and digital transformation initiatives in order to transform the way people work and communicate in the digital age. In addition, our industry team is working tirelessly in order to bring more solutions to the banking and finance sector.