G

G MASS

Databricks Technical Lead

Data EngineeringConfirmed live in the last 24 hours
Full-timeNo salary listed

About the Job

Requirements

  • Enterprise software development lifecycle experience.
  • Financial services experience, including banking exposure.
  • Strong hands-on Databricks experience, including Spark, PySpark, Delta Lake, Databricks SQL, and Workflows, with proficiency in Python and/or Scala.
  • Experience with Unity Catalog and data governance within a regulated environment.
  • Strong AWS experience with EC2, Lambda, ECS, RDS, S3, and IAM.
  • Hands-on Terraform and Infrastructure as Code experience.
  • Continuous integration and continuous delivery experience using Jenkins.
  • A degree in Computer Science or a related discipline, or equivalent experience.
  • Experience with IBM MQ or similar messaging systems.

Responsibilities

  • Lead the development and enhancement of strategic banking data platforms and applications across Databricks and AWS cloud environments.
  • Design, build, and optimise large-scale data pipelines using Spark, PySpark, Delta Lake, and Databricks Workflows.
  • Own data governance and access control within the Databricks environment, including Unity Catalog design and implementation.
  • Manage cloud infrastructure deployments using Terraform and Infrastructure as Code best practices.
  • Maintain technical documentation and internal knowledge resources.
  • Provide technical leadership through mentoring, code reviews, and best-practice guidance.
  • Support architectural design with a focus on scalability, performance, cost efficiency, and reliability.
  • Drive continuous integration and continuous delivery improvements across cloud and on-premise environments.
  • Promote clean coding standards, automated testing, and effective use of AI-assisted development tools.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at G MASS

See more jobs