B

Brillio

Technology consulting for AI-driven digital transformation

Senior Fabric Lead Data Engineer

Data EngineeringPosted on Nov 17
Full-timeBengaluru, Karnataka, IndiaNo salary listed

About the Job

Requirements

  • The candidate must have 5–8 years of overall Data Engineering experience.
  • The candidate must have at least 3 years of hands-on Azure Data Engineering experience and experience with data migration or modernization projects.
  • The candidate must have hands-on expertise with Microsoft Fabric Data Engineering, including Fabric Data Factory, Lakehouse, Warehouse, and OneLake.
  • The candidate must have advanced SQL skills for data transformation, migration, integration, and performance optimization.
  • The candidate must have strong programming experience in Python and PySpark.
  • The candidate must have hands-on experience migrating legacy ETL and SQL-based workloads to Azure or Fabric environments.
  • The candidate must have experience with Azure DevOps for CI/CD and deployment automation.
  • The candidate must have working knowledge of Git and collaborative source-control practices.
  • The candidate must understand Microsoft Fabric workspaces and modern data engineering best practices.
  • The candidate must be able to troubleshoot production data environments.
  • The candidate must hold a bachelor’s degree in Computer Science, Information Technology, Engineering, or a related discipline.

Responsibilities

  • Lead technical implementation of data modernization and migration projects, moving legacy SQL databases, ETL workloads, and data processing solutions to Microsoft Fabric.
  • Analyze existing SQL, ETL, and data integration workloads to identify migration strategies, dependencies, complexity, performance challenges, and optimization opportunities.
  • Design and develop scalable, reliable data pipelines using Microsoft Fabric Data Factory, notebooks, and related Fabric services.
  • Build data engineering solutions using Fabric Lakehouse, Warehouse, and OneLake.
  • Develop and optimize data transformation and processing logic using SQL, Python, and PySpark.
  • Design reusable engineering components and establish standards for code organization, naming conventions, logging, monitoring, and deployment practices.
  • Troubleshoot pipeline failures, data quality issues, and production performance bottlenecks.
  • Implement efficient ingestion patterns, including incremental data loads and Change Data Capture where required.
  • Work with engineering and analytics teams to ensure reliable integration between data platforms and reporting solutions.
  • Conduct code reviews, mentor other data engineers, and promote engineering best practices across the team.

Desired Qualifications

  • Experience with data modeling, dimensional modeling, and data partitioning strategies.
  • Knowledge of data quality, security, and data governance practices within Azure environments.
  • Experience monitoring, logging, and tuning the performance of large-scale data pipelines.
  • Hands-on knowledge of Change Data Capture and incremental ingestion patterns.
  • Familiarity with Power BI and experience working closely with BI and analytics teams.
  • Experience providing technical guidance or mentoring junior- or mid-level Data Engineers.
  • Microsoft Azure or Data Engineering certification.
  • Microsoft Fabric certification, such as Microsoft Certified: Fabric Analytics Engineer Associate.

About the Company

Brillio

Technology consulting for AI-driven digital transformation

Brillio helps organizations move their systems and processes into the digital world by providing technology consulting and customized AI and cloud-based solutions. The company works with large clients, including many Fortune 500 firms, and has a strong emphasis on the healthcare sector. Its offerings include designing and building tailored software and workflows that improve efficiency, security, and scalability, and enabling real-time, AI-powered interactions through generative AI tools. Customers typically engage Brillio through long-term support contracts or project-based work, paying for both advisory services and the implementation of technology solutions. Brillio’s goal is to help clients become ‘generative enterprises’—organizations that leverage AI and cloud technologies to continuously transform operations and user experiences, stay competitive, and drive measurable business outcomes.

Company size
5,001-10,000
Company stage
Late Stage VC
Total funding
Not listed
Headquarters
Dallas, TX
Founded
2014

Recently Posted Jobs

Explore more opportunities at Brillio

See more jobs