E

Ernst & Young

Global professional services: consulting, assurance, tax

Tech Lead Data Engineer - Databricks

Data EngineeringUpdated on Nov 14
Full-timeLa Défense, FranceIn-person

About the Job

Requirements

  • A Master 2 or engineering-school qualification in computer science and at least six years of Data Engineering experience, including concrete experience as a Tech Lead.
  • Mastery of Apache Spark, Delta Lake, Databricks notebooks and jobs, Lakehouse architecture principles, Kubernetes, and Docker.
  • Significant experience designing and industrializing Data Engineering solutions on Databricks; Azure Databricks, AWS, or GCP experience is desirable within this stated experience requirement.
  • Mastery of Unity Catalog, security mechanisms, and data governance.
  • Mastery of Python, SQL, and PySpark; knowledge of Scala and Java is an additional asset.
  • Mastery of DevOps principles, CI/CD tools, and Infrastructure as Code approaches applied to Databricks.
  • Ability to work with Databricks integrated into a modern data ecosystem, including orchestration, streaming, APIs, business intelligence, MLOps, and cloud services.
  • Databricks Certified Data Engineer Professional certification is expected; Databricks Certified Data Engineer Associate is the minimum level.
  • A good level of English.
  • Prior experience as a technical referent or Tech Lead, with experience supervising development teams and managing technically significant projects.
  • Ability to design robust, secure, high-performing, and scalable Lakehouse architectures considering business needs, cost and performance constraints, and security requirements.
  • Ability to make strategic technical decisions while involving team perspectives and taking project constraints into account.
  • Ability to explain complex technical concepts to non-technical stakeholders.
  • Ability to understand client needs and propose solutions balancing technical and functional considerations.
  • Keep up to date with technology trends and share discoveries with the team.

Responsibilities

  • Support the definition and validation of use cases through workshops with clients’ business and IT stakeholders.
  • Define and implement Data Lakehouse architectures on Databricks with Product Owners and technical or application architects.
  • Design and industrialize pipelines with Apache Spark, Delta Lake, Databricks Workflows, and Delta Live Tables/Lakeflow, ensuring performance, resilience, and observability.
  • Implement governance, security, and access controls with Unity Catalog, and establish development, deployment, and platform operations standards.
  • Lead CI/CD and Infrastructure as Code practices for Databricks in Azure, AWS, or GCP environments.
  • Manage technical backlogs for Data projects with Product Owners and actively participate in Agile ceremonies, including daily meetings, demos, and retrospectives.
  • Contribute to Databricks development, including data ingestion, transformation, quality improvement, enrichment, and exposure; ensure delivery quality through code reviews, optimization, refactoring, and good practices.
  • Supervise and coach development teams in delivery and implementation of good practices.
  • Study and evaluate Databricks platform updates and new technology components to assess their relevance and integration into existing Data architectures.
  • Participate in selecting and evaluating candidates identified to strengthen development teams.

Desired Qualifications

  • Knowledge of Scala and Java.
  • Databricks Certified Machine Learning Professional or Databricks Certified Generative AI Engineer Associate certification, depending on the assignment.

About the Company

Ernst & Young

Global professional services: consulting, assurance, tax

EY (Ernst & Young) provides professional services at a global scale, offering consulting, assurance, tax, and transaction advisory services. It serves clients across industries such as technology, media, real estate, hospitality, and construction. Instead of selling a single product, EY works with clients through tailored engagements where cross-disciplinary teams analyze challenges, design strategies, perform audits, help with tax planning, and assist with mergers or divestitures. What sets EY apart is its worldwide reach and integrated service model, industry-specific expertise, and focus on responsible business practices like sustainability, cybersecurity, and workforce flexibility. EY’s goal is to help organizations improve performance, manage risk, and achieve sustainable growth while building a better working world.

Company size
5,001-10,000
Company stage
Not listed
Total funding
Not listed
Headquarters
Boston, MA
Founded
1991

Recently Posted Jobs

Explore more opportunities at Ernst & Young

See more jobs