N

NCS

ICT consulting, digital transformation, cybersecurity services

Senior AI Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeSingaporeNo salary listedIn-person

About the Job

Requirements

  • A minimum of 4 years of relevant data engineering experience.
  • Experience with generative AI, agentic AI, or large language model-based solutions.
  • Proficiency in Python, including FastAPI, Pydantic, and Pandas.
  • Experience designing and implementing AI harnesses or multi-agent frameworks.
  • Hands-on experience with LangChain and LangGraph.
  • Experience with Apache Iceberg, Trino, and Parquet-based lakehouse architectures.
  • Experience building data ingestion, transformation, and orchestration pipelines.
  • Strong knowledge of metadata management, data lineage, and data governance practices.
  • Experience developing REST APIs, software development kits, and reusable engineering frameworks.
  • Experience with observability, monitoring, tracing, and operational support practices.
  • Strong understanding of distributed systems, event-driven architectures, and microservices patterns.
  • Ability to design, develop, and operationalize enterprise-grade AI agents for data discovery, ingestion, transformation, optimization, governance, and observability.

Responsibilities

  • Design and implement the foundational agent framework for agent orchestration and coordination, workflow execution and state management, memory and context handling, tool and function calling, agent-to-agent communication, human approval workflows, logging and audit trails, error handling and recovery, security and access controls, and observability and monitoring.
  • Build an AI harness that supports autonomous and multi-agent execution patterns.
  • Create specialized agents to discover Iceberg catalogs and schemas; profile datasets; generate metadata and lineage; ingest data from databases, APIs, files, and streams; create Parquet datasets; register and maintain Iceberg tables; generate Trino SQL; build transformation workflows; create curated and business-ready datasets; validate schemas and data integrity; detect anomalies; generate reconciliation reports; analyze Trino workloads; recommend partitioning strategies; optimize Iceberg tables and Parquet files; classify sensitive information; manage metadata and lineage; apply retention and compliance policies; monitor pipelines and agent activities; detect failures and bottlenecks; and generate alerts and operational insights.
  • Produce Iceberg table definitions and schemas, Trino SQL scripts and views, Python data pipeline code, data quality validation suites, metadata and lineage documentation, CI/CD deployment artifacts, monitoring and observability configurations, and technical documentation and runbooks.

Desired Qualifications

  • Familiarity with modern data engineering technologies, including DuckDB and dbt, and related engineering tools for data transformation, modelling, and pipeline development.
  • For senior engineers: demonstrated experience leading technical designs, guiding junior engineering team members, working independently with clients and delivery teams, and translating AI and data requirements into scalable, secure, and deployable solutions.

About the Company

NCS

ICT consulting, digital transformation, cybersecurity services

NCS delivers ICT services in the Asia Pacific region, including consulting, digital transformation, technology solutions, and cybersecurity for government and private sector clients. It offers advisory, implementation, and managed services, supported by three innovation centers in Singapore, Melbourne, and Shenzhen and a workforce of about 13,000 across 20 cities. The company emphasizes long-term client partnerships, regional scale, and practical solutions developed at its innovation centers. Its goal is to help clients navigate digital transformation and cybersecurity while maintaining ethical conduct and transparent governance.

Company size
10,001+
Company stage
Grant
Total funding
$780K
Headquarters
Singapore, Singapore
Founded
1981

Recently Posted Jobs

Explore more opportunities at NCS

See more jobs