E

EXL

Analyzes business data and runs outsourced operations

Senior Azure Databricks Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timePune, Maharashtra, IndiaNo salary listed

About the Job

Requirements

  • A Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field is required.
  • 9–15 years of experience in data engineering and data warehousing is required.
  • At least 5 years of hands-on experience with Azure data engineering technologies is required.
  • At least 4 years of hands-on experience with Azure Databricks and the Spark ecosystem is required.
  • Strong understanding of data lake, lakehouse, and cloud-native architecture patterns is required.
  • Experience handling large-scale structured and unstructured datasets is required.
  • Strong analytical, problem-solving, and troubleshooting skills are required.
  • Strong stakeholder management and communication skills are required.
  • Ability to lead technical initiatives and drive architecture discussions is required.
  • Experience working in Agile/Scrum environments is required.
  • Strong documentation and presentation skills are required.
  • Strong mentoring and team leadership abilities are required.

Responsibilities

  • Design, develop, and maintain data pipelines using Databricks, Apache Spark, and cloud-native services.
  • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data.
  • Develop data models and implement data quality, validation, and governance frameworks.
  • Integrate data from multiple sources into a unified Lakehouse architecture.
  • Optimize Spark jobs and Databricks workloads for performance, scalability, and cost efficiency.
  • Implement security controls, access management, and data governance using Unity Catalog.
  • Collaborate with business, analytics, and AI/ML teams to deliver trusted data products.
  • Monitor, troubleshoot, and resolve data pipeline issues.
  • Support CI/CD, DevOps, and infrastructure automation practices.
  • Maintain technical documentation and best practices.

Desired Qualifications

  • Microsoft Certified: Azure Data Engineer Associate (DP-203).
  • Databricks Certified Data Engineer Associate or Professional.
  • Experience with Snowflake, Power BI, or Microsoft Fabric.
  • Experience in real-time streaming solutions using Kafka or Event Hubs.
  • Exposure to data governance and Master Data Management initiatives.
  • Experience with Microsoft Fabric.
  • Experience with Power BI.
  • Experience with Azure Event Hubs.
  • Experience with Kafka.
  • Experience building machine learning data pipelines.
  • Experience with data governance tools such as Purview.

About the Company

EXL

Analyzes business data and runs outsourced operations

EXL analyzes business data and runs outsourced operations for insurers, healthcare payers, banks, retailers, and other large organizations. Its teams combine industry expertise with data engineering and AI to handle tasks such as claims processing, payment reviews, customer service, and finance within existing technology environments. The company also builds software, including LifePRO, which manages insurance policies, and EXLdata.ai, which connects fragmented data for use in AI systems. Clients pay for consulting projects, ongoing managed services, and software delivered through the cloud. EXL was founded in 1999 and is headquartered in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1999

Recently Posted Jobs

Explore more opportunities at EXL

See more jobs