E

EXL

Analyzes business data and runs outsourced operations

Assistant Vice President

Data EngineeringConfirmed live in the last 24 hours
Full-timeGurugram, Haryana, IndiaNo salary listedIn-person

About the Job

Requirements

  • At least 5 years of experience in architecture, design, and implementation using Databricks, with 10+ years of overall Data Engineering experience; insurance domain experience is preferred.
  • Experience designing and implementing scalable, fault-tolerant systems.
  • Deep understanding of one or more big data compute technologies, such as Databricks or Snowflake.
  • Demonstrated experience deploying Databricks on cloud platforms, including advanced configurations.
  • In-depth knowledge of Spark internals, Catalyst optimization, and the Databricks Runtime environment.
  • Experience implementing solutions using Databricks.
  • Proficiency in SQL and Python.
  • Experience with Databricks, Delta Lake storage, Spark (PySpark and Spark SQL), Git, Azure DevOps, and Unity Catalog.
  • A B.S. degree in a data-centric field (Mathematics, Economics, Computer Science, Engineering, or another science field), Information Systems, Information Processing, or engineering.
  • Excellent communication and leadership skills, with the ability to lead and motivate team members.
  • Ability to work independently amid some ambiguity and manage multiple demands.

Responsibilities

  • Lead and/or assist in designing and developing data systems, tailoring solutions to meet client-specific requirements.
  • Design and implement Databricks-based solutions, focusing on distributed data processing, data partitioning, and optimization for parallelism.
  • Engage with clients to evaluate current and future needs, craft bespoke solution architectures, and provide strategic recommendations.
  • Develop scalable, modular data architectures using Delta Lake for ACID-compliant data lakes, integrating client business processes and technologies, including Lakehouse architecture.
  • Define and enforce coding standards for ETL processes to ensure maintainability, reusability, and adherence to best practices.
  • Build and orchestrate data pipelines using Databricks Workflows and Auto Loader for real-time ingestion.
  • Architect and implement CI/CD pipelines for Databricks notebooks and jobs, including testing, versioning, and deployment.
  • Develop disaster recovery strategies for Databricks environments to ensure data resilience and minimize downtime in case of failure.
  • Innovate and expand solution offerings to address data challenges.
  • Advise stakeholders on data cloud platform architecture optimization, focusing on performance.
  • Use Scrum and Agile methodologies to coordinate global delivery teams, run Scrum ceremonies, manage backlog items, and handle escalations.
  • Integrate data across different systems and platforms.
  • Manage client discussions through verbal and written communication.

Desired Qualifications

  • Experience in the insurance (P&C) domain.
  • Experience with Terraform.

About the Company

EXL

Analyzes business data and runs outsourced operations

EXL analyzes business data and runs outsourced operations for insurers, healthcare payers, banks, retailers, and other large organizations. Its teams combine industry expertise with data engineering and AI to handle tasks such as claims processing, payment reviews, customer service, and finance within existing technology environments. The company also builds software, including LifePRO, which manages insurance policies, and EXLdata.ai, which connects fragmented data for use in AI systems. Clients pay for consulting projects, ongoing managed services, and software delivered through the cloud. EXL was founded in 1999 and is headquartered in New York City.

Company size
10,001+
Company stage
IPO
Headquarters
New York City, New York
Founded
1999

Recently Posted Jobs

Explore more opportunities at EXL

See more jobs