E

EXL

Analyzes business data and runs outsourced operations

Databricks Developer / Data Architect

Data EngineeringConfirmed live in the last 24 hours
Full-timePune, Maharashtra, IndiaNo salary listed

About the Job

Requirements

  • At least 5 years of experience in data engineering or data architecture.
  • Strong hands-on experience with the Databricks platform.
  • Expertise in Python, Apache Spark, PySpark, and SQL.
  • Strong understanding of Lakehouse Architecture, Medallion Architecture, data modeling, and ETL/ELT design patterns.
  • Experience with Microsoft Azure and AWS cloud platforms.
  • Experience integrating PostgreSQL, DynamoDB, MongoDB, Snowflake, Cloudera, and Domino Server.
  • Knowledge of performance tuning and optimization in Spark and Databricks.
  • Experience with version control and DevOps practices.
  • Strong analytical and problem-solving abilities.
  • Strong documentation and solution design capabilities.

Responsibilities

  • Design and implement scalable enterprise data architectures using the Databricks Lakehouse platform.
  • Configure and manage Databricks workspaces, clusters, access controls, and governance.
  • Implement Medallion Architecture layers (Bronze, Silver, and Gold) for data processing and analytics.
  • Set up and manage Lakehouse Federation and data connectors for multi-source integration.
  • Develop logical and physical data models for structured and semi-structured datasets.
  • Ensure data quality, security, scalability, and performance optimization.
  • Develop and maintain scalable ETL/ELT pipelines using PySpark, Spark SQL, and Databricks workflows.
  • Build reusable data ingestion frameworks for batch and streaming workloads.
  • Optimize Spark jobs for performance, cost efficiency, and reliability.
  • Integrate data from relational and NoSQL databases, cloud platforms, and external systems.
  • Automate deployment and monitoring of ETL workflows.
  • Work with Azure and AWS cloud services to deploy and manage data solutions.
  • Configure integrations with Snowflake, PostgreSQL, MongoDB, DynamoDB, Cloudera, and Domino Server.
  • Support CI/CD, infrastructure automation, and environment management.
  • Collaborate with data scientists, analysts, and business stakeholders.

Desired Qualifications

  • Databricks certifications.
  • Experience with Delta Lake and Unity Catalog.
  • Familiarity with streaming frameworks and real-time data processing.
  • Knowledge of data governance and security best practices.
  • Experience in Agile/Scrum delivery models.
  • Experience with Terraform or infrastructure as code.
  • Exposure to machine learning or data science platforms.
  • Experience with orchestration tools such as Airflow or Azure Data Factory.

About the Company

EXL

Analyzes business data and runs outsourced operations

EXL analyzes business data and runs outsourced operations for insurers, healthcare payers, banks, retailers, and other large organizations. Its teams combine industry expertise with data engineering and AI to handle tasks such as claims processing, payment reviews, customer service, and finance within existing technology environments. The company also builds software, including LifePRO, which manages insurance policies, and EXLdata.ai, which connects fragmented data for use in AI systems. Clients pay for consulting projects, ongoing managed services, and software delivered through the cloud. EXL was founded in 1999 and is headquartered in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1999

Recently Posted Jobs

Explore more opportunities at EXL

See more jobs