I

ICM Asia Pacific

Global SaaS design, build, hosting, operations

Senior Data Engineer / Consultant - Databricks

Data EngineeringPosted on Nov 17
Full-timeNo salary listed

About the Job

Requirements

  • At least 6 years of professional experience across Data Engineering, Data Platforms, or a closely related discipline.
  • Strong hands-on experience delivering production data engineering solutions using Databricks, including notebooks, workflows, Lakehouse architectures, and modern data pipeline development.
  • Strong capability in Python, PySpark, and SQL.
  • Experience designing and developing ETL/ELT pipelines and complex data transformations.
  • Understanding of modern data architecture patterns, including Medallion architecture and scalable Lakehouse design.
  • Strong data modelling knowledge, including dimensional, Star, and Snowflake modelling approaches.
  • Experience with cloud data platforms, ideally Microsoft Azure or another major cloud ecosystem.
  • Experience applying DevOps and software engineering practices, including version control, CI/CD, and automated deployment.
  • Experience implementing testing, data quality, and validation practices within production data environments.
  • Familiarity with analytics and data consumption technologies such as Power BI or similar platforms.
  • Strong communication skills and confidence working directly with clients and senior stakeholders.
  • Experience in consulting, professional services, or client-facing delivery environments, or demonstrable experience operating in a similar capacity.
  • Ability to work autonomously while collaborating effectively across multidisciplinary delivery teams.

Responsibilities

  • Design, build, and optimise modern data pipelines across data lakes, lakehouses, and data warehouses.
  • Deliver production-grade solutions using Databricks and associated cloud data technologies.
  • Develop data transformations and engineering solutions using Python, PySpark, and SQL.
  • Work with Databricks notebooks, workflows, and Lakeflow Declarative Pipelines (formerly Delta Live Tables).
  • Apply modern data architecture patterns, including Lakehouse and Medallion architectures.
  • Design and implement robust data models for analytics, reporting, and downstream data consumption.
  • Apply software engineering and DevOps practices, including Git, CI/CD, automated deployment, and environment management.
  • Implement testing, data validation, monitoring, and performance optimisation to ensure reliable production data solutions.
  • Work directly with clients to understand requirements and translate business needs into pragmatic technical solutions.
  • Lead technical discussions and communicate engineering concepts to technical and non-technical stakeholders.
  • Collaborate with architects and other consultants on solution design, estimation, scoping, and delivery planning.
  • Identify delivery risks, communicate progress, and help resolve technical blockers.
  • Conduct peer reviews and support high standards across code, documentation, and engineering practices.
  • Mentor junior and intermediate engineers and contribute to knowledge sharing across the Data Practice.
  • Improve reusable frameworks, delivery patterns, templates, and engineering standards.
  • Stay current with developments across Databricks, cloud data platforms, AI/ML, and the broader modern data ecosystem.

Desired Qualifications

  • Exposure to Microsoft Fabric and the wider Microsoft Data ecosystem.
  • Relevant Databricks, Azure, or other cloud certifications, and a demonstrated commitment to ongoing professional development.

About the Company

ICM Asia Pacific

Global SaaS design, build, hosting, operations

ICM Asia Pacific provides end-to-end SaaS development services, partnering with clients to analyze their SaaS needs, design solutions, build platforms, provision hosting, and operate the services to meet requirements. They deliver complete SaaS platforms that are secure, high-performing, and massively scalable, with 24/7 availability and global accessibility from planning through deployment and ongoing management. The company differentiates itself by covering the full lifecycle—discovery, development, hosting, and operations—emphasizing security, performance, scalability, and around-the-clock global access. Its goal is to help clients deploy best-of-breed SaaS platforms that are secure, reliable under high demand, and accessible worldwide.

Company size
11-50
Company stage
Not listed
Total funding
Not listed
Headquarters
Auckland, New Zealand
Founded
1999

Recently Posted Jobs

Explore more opportunities at ICM Asia Pacific

See more jobs