C

Centre for Strategic Infocomm Technologies

Develops secure cybersecurity solutions and research

Staff Platform Engineer - Big Data Platform Management

Platform EngineeringConfirmed live in the last 24 hours
Full-timeSingaporeNo salary listedIn-person

About the Job

Requirements

  • A degree or professional qualification in Computer Science, Engineering, or a related field is required.
  • At least 8 years of experience managing Big Data platforms, with experience in Spark, Iceberg, Trino, Elastic Stack, NiFi, Kafka, and Airflow.
  • Expertise in Big Data Engineering, including building streaming and batch pipelines, architecting data warehouses, and deploying AI/ML infrastructure.
  • Ability to manage and use storage protocols including S3, NFS, SMB, and HDFS.
  • Knowledge of securing applications through SSL/TLS encryption, data-at-rest encryption, and authentication and authorization using OIDC/OAuth2.
  • Understanding of networking principles, including firewall configuration, DNS management, routing, and subnetting.
  • Experience with scripting languages including Bash, Python, Scala, and Java.
  • Proficiency in Kubernetes orchestration and its ecosystem for automated scaling, self-healing, and CI/CD integration.
  • Experience supporting search workloads involving multiple terabytes and billions of records.
  • Experience with agile development methodologies and version control systems such as Git.
  • Experience leading engineering teams.

Responsibilities

  • Design, implement, and manage the Big Data Infrastructure platform, including Hadoop, Spark, NoSQL databases, and data lakes.
  • Manage Big Data clusters by monitoring, troubleshooting, and optimizing performance, and by managing job scheduling and resource allocation.
  • Design and implement storage solutions for Big Data workloads, including HDFS, S3, and other object storage systems.
  • Secure and govern the Big Data Infrastructure platform by managing access controls, implementing data encryption, and conducting regular security audits.
  • Collaborate with data engineers and data scientists to optimize Big Data application performance and provide technical support and guidance on using the platform.
  • Plan and manage Big Data resource capacity, including forecasting, procurement, and deployment of new hardware and software.

Desired Qualifications

  • Certifications in Big Data, such as Hadoop Certified Developer or Spark Certified Developer.
  • Experience managing physical and virtual infrastructures.
  • Knowledge of deploying and scaling LLM-based and agentic AI/ML applications.

About the Company

Centre for Strategic Infocomm Technologies

Develops secure cybersecurity solutions and research

CSIT builds cybersecurity and secure digital solutions to safeguard Singapore’s national security, conducting applied cybersecurity research and developing AI and data-exploitation tools in a self-built secure cloud. Its engineers design and deploy software within this private cloud to counter digital threats and protect highly sensitive information. The center’s work is closely tied to national defense, focusing on applied research rather than consumer products and using an in-house secure cloud. Its goal is to shield Singapore from cyber threats and safeguard sensitive secrets through advanced technology.

Company size
201-500
Company stage
Not listed
Total funding
Not listed
Headquarters
Singapore, Singapore
Founded
2003

Recently Posted Jobs

Explore more opportunities at Centre for Strategic Infocomm Technologies

See more jobs