Unison Group

Builds financial risk and compliance systems

Senior Data Engineer - Noresh

Data EngineeringConfirmed live in the last 24 hours

Full-timeKuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia$10k - $20kIn-person

About the Job

Requirements

Strong hands-on experience with Databricks, including workspace configuration, notebooks, compute, jobs, and orchestration.
Practical expertise in Delta Lake, Delta Live Tables or Lakeflow Spark Declarative Pipelines, Unity Catalog, and Databricks SQL Warehouses.
Proficiency in Python or Scala, with strong SQL skills for data engineering or machine-learning workflows.
Good understanding of at least one major cloud ecosystem: AWS, Microsoft Azure, or Google Cloud Platform.
Experience with Terraform or similar infrastructure-as-code tools, Git-based workflows, continuous integration and continuous delivery, and DevOps or MLOps practices.
Familiarity with monitoring, observability, security, and governance frameworks for large-scale data platforms.
Ability to communicate technical concepts clearly to customer and engineering stakeholders.

Responsibilities

Design, build, and maintain scalable data pipelines using Delta Live Tables or Lakeflow Spark Declarative Pipelines, Spark SQL, Python, or Scala.
Optimize batch ETL, streaming, and machine-learning workloads for performance, cost efficiency, scalability, and reliability.
Configure and administer Databricks workspaces, Unity Catalog, cluster policies, SQL Warehouses, access controls, and secure governed environments.
Automate infrastructure provisioning and application deployments using Terraform, Git, and continuous integration and continuous delivery pipelines.
Establish platform observability, monitoring, alerting, and cost-management practices using tools such as Splunk, Prometheus, AWS CloudWatch, or equivalent cloud-native tools.
Collaborate with customers and cross-functional teams to deliver AI and large language model solutions using MLflow, Mosaic AI, and relevant Databricks model-serving and evaluation capabilities.
Troubleshoot production issues, improve operational reliability, and document architecture, engineering standards, and runbooks.
Provide technical guidance, conduct code reviews, and mentor engineers on Databricks, data engineering, governance, and DevOps best practices.

Senior Data Engineer

Unison Group · Kuala Lumpur, Malaysia · Full-time · Posted 2026-10-14

Salary: unknown currency 10,000–20,000

Workplace: on_site

Department: Noresh

Description

Role Overview

We are seeking a hands-on Databricks engineer with deep technical expertise in building, operating, and optimizing Lakehouse-based data and AI solutions. In this role, you will design, develop, and operationalize Delta Lakehouse architectures that deliver measurable outcomes for enterprise customers. You will own implementation activities, contribute to technical delivery leadership, and mentor engineering teams in best practices across data engineering, platform governance, and AI.

Key Responsibilities

Design, build, and maintain scalable data pipelines using Delta Live Tables (DLT) / Lakeflow Spark Declarative Pipelines, Spark SQL, Python, or Scala.
Optimize batch ETL, streaming, and machine-learning workloads for performance, cost efficiency, scalability, and reliability.
Configure and administer Databricks workspaces, Unity Catalog, cluster policies, SQL Warehouses, access controls, and secure governed environments.
Automate infrastructure provisioning and application deployments using Terraform, Git, and CI/CD pipelines.
Establish platform observability, monitoring, alerting, and cost-management practices using tools such as Splunk, Prometheus, or AWS CloudWatch and equivalent cloud-native tools.
Collaborate with customers and cross-functional teams to deliver AI/LLM solutions using MLflow, Mosaic AI, and relevant Databricks model-serving and evaluation capabilities.
Troubleshoot production issues, improve operational reliability, and document architecture, engineering standards, and runbooks.
Provide technical guidance, conduct code reviews, and mentor engineers on Databricks, data engineering, governance, and DevOps best practices.

Required Skills & Experience

Strong hands-on experience with Databricks, including workspace configuration, notebooks, compute, jobs, and orchestration.
Practical expertise in Delta Lake, DLT / Lakeflow Spark Declarative Pipelines, Unity Catalog, and Databricks SQL Warehouses.
Proficiency in Python or Scala, with strong SQL skills for data engineering and/or machine-learning workflows.
Good understanding of at least one major cloud ecosystem: AWS, Microsoft Azure, or Google Cloud Platform (GCP).
Experience with Terraform or similar infrastructure-as-code tools, Git-based workflows, CI/CD, and DevOps/MLOps practices.
Familiarity with monitoring, observability, security, and governance frameworks for large-scale data platforms.
Strong problem-solving skills and the ability to communicate technical concepts clearly to customer and engineering stakeholders.

Apply

Apply at Unison Group

About the Company

Unison Group

Builds financial risk and compliance systems

Unison Group builds technology systems for financial institutions that need to manage risk, meet reporting rules and modernize their operations. Its consultants work across liquidity, market and credit risk, combining financial knowledge with software implementation and data analysis. The business also designs cloud infrastructure and develops custom applications, connecting these systems with the information and processes clients already use. It earns money through consulting, technology implementation and engineering services for enterprises, with work ranging from system design to deployment. Founded as Unison Consulting in 2012, the group is headquartered in Singapore.

Company size: 201-500
Company stage: Not listed
Total funding: Not listed
Headquarters: Not listed
Founded: 2012

Recently Posted Jobs

Explore more opportunities at Unison Group

See more jobs