Lead Data Engineer
Unison Group
Lead Data Engineer
Unison Group
Builds financial risk and compliance systems
Unison Group · Singapore, Singapore · Full-time · Posted 2026-09-25
Workplace: on_site
Department: Bharat
Role: Lead Data Engineer (Banking)
Must-have skills
Banking and domain
• Production delivery of data pipelines inside banks.
• Customer, account, transaction, payments and AML data.
• Working within bank release, scheduling and change controls.
Core data engineering
• Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.
• Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.
• Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.
• ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.
• Reconciliation, data quality and SLA monitoring.
• Performance at scale: tables of 1 billion+ rows and multi-year history.
Experience:
Banking and domain
• Production delivery of data pipelines inside banks.
• Customer, account, transaction, payments and AML data.
• Working within bank release, scheduling and change controls.
Core data engineering
• Teradata SQL, BTEQ, TPT and FastLoad/MultiLoad; query tuning.
• Spark (PySpark/Scala), Hive, Impala, HBase, Pig and Hue; Apache Iceberg and Trino; Python and R.
• Historical data processing: snapshots, SCD Type 2 and multi-grain backfills with control totals and validation reports.
• ETL/ELT development, CDC, metadata-driven automation frameworks and parameter-driven SQL generation.
• Reconciliation, data quality and SLA monitoring.
• Performance at scale: tables of 1 billion+ rows and multi-year history.
Integration and platforms
• Kafka, Spark Streaming, Informatica (PowerCenter, IDMC, IDL) and Talend; REST API development.
• Denodo, Snowflake and NoSQL databases.
• Airflow, Control-M or Autosys; Git, CI/CD, GitOps and Kubernetes.
Delivery and communication (Lead)
• Framework design, code standards, code reviews and estimation.
• Guiding a team of engineers and working with architects and analysts.
Good-to-have skills
• Databricks: Delta Lake, Unity Catalog and Workflows.
• Data services on Azure, Google Cloud, Huawei Cloud or Alibaba Cloud.
• Data modelling for Qlik Sense or Power BI.
Certifications (preferred): Teradata Vantage; Cloudera Data Engineer; Databricks Data Engineer Associate or Professional
Powered by Workable
Builds financial risk and compliance systems
Unison Group builds technology systems for financial institutions that need to manage risk, meet reporting rules and modernize their operations. Its consultants work across liquidity, market and credit risk, combining financial knowledge with software implementation and data analysis. The business also designs cloud infrastructure and develops custom applications, connecting these systems with the information and processes clients already use. It earns money through consulting, technology implementation and engineering services for enterprises, with work ranging from system design to deployment. Founded as Unison Consulting in 2012, the group is headquartered in Singapore.
Explore more opportunities at Unison Group