A

Activate Interactive Pte

Technology consultancy delivering end-to-end digital solutions

Data Engineer

Data EngineeringUpdated on Nov 12
Full-timeSingapore

About the Job

Requirements

  • Proficiency in database design and databases such as SQL, PostgreSQL, AWS S3, Athena, MongoDB, PostGIS, MySQL, SQLite, VoltDB, and Cassandra.
  • Experience with cloud technologies such as AWS, Azure, or Google Cloud.
  • Experience in data engineering in a big data environment using cloud platforms such as AWS, Azure, or Google Cloud.
  • Experience building production-grade data pipelines and ETL/ELT data integration.
  • Knowledge of system design, data structures, and algorithms.
  • Familiarity with data modeling, data access, and data storage infrastructure such as data marts, data lakes, data virtualization, and data warehouses.
  • Familiarity with REST APIs and web requests or protocols.
  • Familiarity with big data frameworks and tools such as Hadoop, Spark, Kafka, and RabbitMQ.
  • Familiarity with the W3C Document Object Model and customized web scraping using tools such as BeautifulSoup, CasperJS, PhantomJS, Selenium, and Node.js.
  • Familiarity with data governance policies, access control, and security best practices.
  • Comfort with at least one scripting language, such as SQL or Python.
  • Comfort working in Windows and Linux development environments.
  • General data-cleaning and transformation proficiency, including SQL, pandas, or R.
  • Proficiency building ETL pipelines using tools such as SQL Server Integration Services, AWS Database Migration Service, Python, AWS Lambda, ECS Container Tasks, EventBridge, AWS Glue, or Spring.

Responsibilities

  • Design, develop, and deploy data tables, views, and marts in data warehouses, operational data stores, data lakes, and data virtualization systems.
  • Perform data extraction, cleaning, transformation, and flow; data extraction may include web scraping.
  • Design, build, launch, and maintain efficient, reliable large-scale batch and real-time data pipelines with data-processing frameworks.
  • Integrate and collate data silos in a scalable and compliant manner.
  • Collaborate with project managers, data architects, business analysts, frontend developers, designers, and data analysts to build scalable data-driven products.
  • Develop backend APIs and work on databases to support applications.
  • Work in an Agile environment that practices Continuous Integration and Delivery.
  • Collaborate with fellow developers through pair programming and code reviews.

About the Company

Activate Interactive Pte

Technology consultancy delivering end-to-end digital solutions

Activate Interactive Pte is a technology consultancy in Singapore that blends strategy, creativity, and engineering to help organizations adopt digital solutions. It delivers end-to-end development for mobile and web apps, cloud technology, and UI/UX design, and it integrates digital tools into all areas of a business to remove tech roadblocks and boost efficiency for clients of all sizes. Its approach combines consulting insight with hands-on engineering to turn ideas into practical applications that people can use. The company differentiates itself by offering a single, integrated team that covers strategy, design, and development, aiming for cost-effective, holistic solutions rather than siloed services. Its goal is to help people live better and healthier through technology by creating solutions that improve population health and overall quality of life while developing its employees and supporting communities.

Company size
51-200
Company stage
Not listed
Total funding
Not listed
Headquarters
Singapore, Singapore
Founded
1997

Recently Posted Jobs

Explore more opportunities at Activate Interactive Pte

See more jobs