Senior Data Engineer - Azure Databricks

About the Company
Embitel Technologies is a Volkswagen AG (VW) Group Company. VW is a German multinational automotive manufacturing corporation headquartered in Wolfsburg, Germany. VW is one of the world’s largest automaker by sales. VW sold 10.9 million vehicles in 2019. The group comprises of 12 brands from seven European Countries: Volkswagen, Audi, Lamborghini, Porsche, Bugatti, Bentley, Ducati (motorcycles), Skoda, SEAT, Scania, MAN and Volkswagen commercial vehicles.

About CARIAD (Car, I Am Digital)

The automotive industry is in disruption. As a company, CARIAD is playing a part in multiple large trends at the same time: electrification, automation, and digitalization. The new name builds on changing customer needs. Automotive customers are demanding more comfort, more safety, more sustainability, and more connectivity. With its software platforms and digital features, CARIAD is developing solutions and products that will turn the car into a smart companion to accompany customers into the future with continuous updates and new digital features, even years later. The new company name reflects this zeitgeist: ‘Car, I Am Digital’. The brand profile can be found on its new website https://cariad.technology.

Currently, around 4,000 employees are working at CARIAD on the digital transformation of the car. CARIAD is working intensively on the software and technology platform for Premium Platform Electric (PPE). The first vehicles based on PPE will be the electric Porsche Macan and Audi Q6 e-tron. At the core of CARIAD is the development of the unified and scalable software and technology platform E³ 2.0 for all Group brands. E³ stands for ‘end to end electronics architecture’. The new software and technology platform is built from scratch and will be used first at the end of 2024 in Artemis, the lighthouse project of Audi. As of 2026, E³ 2.0 is due to be scaled by the Volkswagen brand with Trinity in the volume segment.

About our Group

CARIAD COE (Centre of Excellence) is setup in Bangalore, India working exclusively with CARIAD and associated VW groups with the focus on development of ‘VW.OS”. The areas of work involve development of platform components such as firmware, boot loaders, AUTOSAR, Linux/QNX BSP, Service oriented architecture-based middleware components.

Job Description:

Data Engineer – Azure Databricks

Location: Bangalore (Hybrid) 
Experience: 2 – 4 Years
Employment Type: Full-Time

Job Description

We are looking for a highly skilled Data Engineer with strong expertise in Azure Databricks and good understanding DevOps Practices. The ideal candidate will design, build, and optimize large-scale data pipelines and data warehousing solutions on cloud platforms.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python
• Perform distributed data processing using PySpark on Azure Databricks
• Implement and manage Delta Lake, Databricks cluster configurations
• Develop ETL/ELT workflows for structured and unstructured data
• Optimize data warehouse performance through efficient schema design and query tuning
• Work with orchestration tools like Apache Airflow for scheduling and workflow management
• Collaborate with cross-functional teams to deliver high-quality data solutions
• Ensure data reliability, governance, and best practices across platforms

Required Skills

• Advanced proficiency in Python for data engineering
• Strong hands-on experience with PySpark
• Deep expertise in Azure Databricks, including Delta Lake and cluster management
• Strong experience with SQL for analytics and data warehousing
• Experience with data warehousing platforms such as:
  • Snowflake
  • Azure Synapse Analytics
  • AWS Redshift
• Working knowledge of cloud platforms: Azure

Good to Have

• Experience with NoSQL databases (e.g., MongoDB)
• Exposure to big data services like Azure Data Factory
• Devops : CI/CD pipelines, Docker, Kubernetes

Working with Embitel
• Freedom to challenge norms, make mistakes, learn and grow
• There is no ‘I’ in word ‘Team’ and no hierarchy at Embitel
• Employees of Embitel are partners of our excellence and growth. And they are at the core of
organization’s Mission and Vision

To explore an exciting & progressive Career development at Embitel India:
• Visit us at: www.embitel.com
• Follow us at LinkedIn: https://www.linkedin.com/company/embitel-technologies-india