Jade Global

Enterprise IT services and cloud consulting

Databricks Lead - Delivery & Engineering

Data EngineeringConfirmed live in the last 24 hours

Full-timeNo salary listedIn-person

About the Job

Requirements

10–12 years of experience in data engineering.
3–5 years of hands-on Databricks experience.
Deep expertise in Databricks, Apache Spark, and Delta Lake.
Strong hands-on experience with PySpark and Spark SQL, including core functionality, SQL, and streaming.
Experience designing Lakehouse architectures.
Strong understanding of data modeling, data quality, and lineage.
Knowledge of Databricks platform features.
Experience with cloud-native data engineering.
Skills in performance tuning and troubleshooting.

Responsibilities

Lead hands-on Databricks delivery while ensuring adherence to Center of Excellence standards and best practices.
Lead Databricks engineering teams.
Build and optimize Spark and Delta Lake pipelines.
Implement Databricks Jobs, Workflows, and continuous integration and continuous delivery (CI/CD).
Optimize performance and Databricks Unit (DBU) usage.
Contribute to Databricks accelerators and standards.
Design and implement end-to-end data platforms using Databricks Lakehouse.
Lead development of batch and streaming data ingestion.
Lead Delta Lake data modeling using Bronze, Silver, and Gold layers.
Lead development of scalable ETL/ELT pipelines.
Optimize Spark workloads for performance and cost.
Ensure reliability, scalability, and observability of data pipelines.

Desired Qualifications

Databricks Data Engineer Associate certification.
Databricks Data Engineer Professional certification.

Databricks Lead – Delivery & Engineering1

Lead hands-on Databricks delivery, ensuring adherence to CoE standards and best practices.

Key Responsibilities

Lead Databricks engineering teams
Build and optimize Spark & Delta Lake pipelines
Implement Databricks Jobs, Workflows, CI/CD
Optimize performance and DBU usage
Contribute to Databricks accelerators and standards
Design and implement end-to-end data platforms using Databricks Lakehouse
Lead development of:
- Data ingestion (batch & streaming)
- Delta Lake data modeling (Bronze/Silver/Gold)
- Scalable ETL/ELT pipelines
Optimize Spark workloads for performance and cost
Ensure reliability, scalability, and observability of data pipelines

Experience

10–12 years in data engineering
3–5 years hands-on Databricks experience

Skills

Deep expertise in Databricks, Apache Spark, Delta Lake
Strong hands-on experience with PySpark / Spark SQL (core, SQL, streaming)
Experience designing Lakehouse architectures
Strong understanding of data modeling, data quality, and lineage
Databricks platform features
Cloud-native data engineering
Performance tuning & troubleshooting

Certifications (Preferred)

Databricks Data Engineer Associate and Professional

About the Company

Jade Global

Enterprise IT services and cloud consulting

Jade Global provides IT services and consulting to mid-size and large enterprises to modernize their applications, data, and operations using cloud and AI. It offers technology advisory, implementation, integration, testing, and managed services across ERP and enterprise platforms like Oracle, NetSuite, SAP, Salesforce, ServiceNow, Workday, and Boomi, plus cloud, data analytics, and automation work on Snowflake, Databricks, and AWS. Its AI services combine consulting with ready-made AI agents and industry accelerators to speed up data readiness and workflow automation. It serves sectors such as high-tech, healthcare and life sciences, manufacturing, financial services, and retail from offices in the United States, Canada, and India, delivering onshore, nearshore, and offshore engagements with a focus on practical, implementable cloud, data, and AI solutions.

Company size: 1,001-5,000
Company stage: Not listed
Total funding: Not listed
Headquarters: San Jose, CA
Founded: 2003

Recently Posted Jobs

Explore more opportunities at Jade Global

See more jobs