Senior Data Engineer

Responsibilities

As a Senior Data Engineer at Workato, you will be part of the data engineering team that is responsible for maintaining two data circuits.

• The first circuit is the raw data layer and pipelines for internal analytics. This helps us understand how our clients use the Workato platform and requires close collaboration with internal stakeholders such as the Product and Business analytics teams.

• The second circuit is data, pipelines, and queries for in-product analytics. This helps our users understand how their clients use the products they built using our automation platform.

• Your main responsibility will be to develop a new usage tracking/billing platform that will provide accurate near real-time data for both circuits. This platform will also be integrated smoothly with the back office, internal data warehouse, and in-product analytical and reporting tool called Workato Insights. Additionally, the new platform will address advanced use cases like usage forecasting, anomaly detection, and real-time alerts.

• You should also be prepared to work closely with the ML team, as the data platform will be an important foundation for current and future projects in this area.

• You will work as part of a small, flexible team of 4 engineers and will have a direct impact on modernizing and maturing the platform, including architecture decisions. On a daily basis you will use modern tools such as Iceberg Datalake, Snowflake, Clickhouse, Airflow, Flink, Spark, Trino, and Kafka Ecosystem.

Requirements

Qualifications / Experience / Technical Skills

• 5+ years of work experience building & maintaining data pipelines on data-heavy environments (Data Engineering, Backend with emphasis on data processing)

• Fluent knowledge of  SQL.

• Strong knowledge of common analytical domain programming languages such as Java, Scala and basic knowledge of Python.

• Strong experience with Flink and Spark.

• Experience with Data Pipeline Orchestration tools (Airflow, Dagster or similar).

• Experience with Data Warehousing Solutions (Snowflake, Redshift, BigQuery).

• Production experience with PostgreSQL and Clickhouse is a plus.

• Experience with building billing/usage tracking platforms is a plus.

• Confidence in using Git, K8s and Terraform.

• Experience with a solution cost optimization and capacity planning.  

• Good understanding of Data Privacy and Security (GDPR, CCPA).

Soft Skills / Personal Characteristics

• Good communication and collaboration skills.

• Exposure or interest working with Data pipeline technologies.

• Readiness to work remotely with teams distributed across the world and timezones.

• Spoken English (at the level enough to pass technical interviews and later work with colleagues).

(REQ ID: 1956)