I

impact.com

Builds software for brand partnerships

Data Platform Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeCape Town, South Africa

About the Job

Requirements

  • Three to five years of experience in data platform, data engineering, or backend/distributed systems engineering, including ownership of production systems at terabyte scale or systems with stringent service-level agreements, multiple downstream consumers, or compliance requirements.
  • Strong Python skills and production experience in a Java Virtual Machine language, with the ability to write production-quality code with proper error handling, logging, and testing; willingness to become proficient in Scala if needed.
  • Hands-on depth in either distributed batch processing with Spark, including DataFrames, Spark SQL, partitioning, shuffles, and fault tolerance, or streaming with Kafka or Pub/Sub, including producers, consumers, topics, partitions, and stream-processing patterns, plus working familiarity with the other.
  • Advanced SQL skills, including complex queries, window functions, common table expressions, and query optimization.
  • Experience with workflow orchestration such as Airflow, including scheduling, dependencies, retry logic, and workflow coordination.
  • Working fluency with a major cloud platform, ideally Google Cloud Platform, including BigQuery, Dataproc, Cloud Storage, and Pub/Sub.
  • Engineering and operational practice including Git, continuous integration and delivery, automated testing, code review, monitoring, alerting, incident response, and on-call participation.
  • Security and governance practice in data systems, including access control, secrets management, encryption, and least-privilege design.
  • Written and verbal communication for a distributed team, and some experience or aptitude for mentoring less experienced engineers.

Responsibilities

  • Own platform components and a pipeline domain end to end, including design, implementation, reliability, performance, and cost.
  • Design and build scalable extract, transform, and load (ETL), extract, load, and transform (ELT), and streaming pipelines using Spark/Dataproc, Kafka, and Pub/Sub.
  • Integrate diverse data sources into BigQuery and other data stores.
  • Build modular, fault-tolerant components with graceful schema evolution.
  • Configure and maintain core platform infrastructure as code, including Dataproc, Kafka, Airflow/Astronomer, BigQuery, and Cloud Storage.
  • Tune performance and cost through query optimization, partitioning, and resource configuration, and tune streaming configurations for throughput and reliability.
  • Own and track service-level objectives for freshness, success, and latency.
  • Implement monitoring, alerting, and data quality checks.
  • Participate in on-call as a Tier 2 responder and independently troubleshoot and resolve incidents.
  • Implement security and governance by design, including access control, secrets, encryption, audit logging, lineage, and retention.
  • Build self-service capabilities and paved roads for analytics engineers, analysts, and data scientists.
  • Write clean, well-tested code with continuous integration and delivery, and maintain current runbooks and architecture documentation.
  • Use AI coding assistants while maintaining the same quality and review standards.
  • Mentor Associate Data Platform Engineers through pairing and code review.
  • Communicate platform trade-offs clearly and contribute to platform standards and data contracts.

Desired Qualifications

  • Infrastructure as code such as Terraform or equivalent, and automated deployment.
  • Experience migrating legacy big-data platforms to cloud-native alternatives.
  • Familiarity with dbt, Looker, or semantic-layer concepts, and dbt orchestration through Astronomer Cosmos.
  • Functional Scala patterns such as cats-effect and the Typelevel ecosystem, or Java Virtual Machine tuning exposure such as garbage collection, memory management, and thread pools.
  • Observability tooling such as Grafana, Datadog, or Cloud Monitoring.
  • Experience with Dataflow (Apache Beam), SingleStore, or BigTable.
  • A bachelor's degree in Computer Science, Engineering, Mathematics, or a related field.
  • Experience in the digital marketing technology industry.

About the Company

impact.com

Builds software for brand partnerships

impact.com builds partnership software for brands that sell through affiliates, creators, and customer referrals. Its Performance, Creator, and Advocate products let marketing teams coordinate these channels through a shared platform rather than separate program tools. Brands use the software to recruit partners, agree on contracts, attribute sales, monitor activity, and automate payments, while publishers and creators find brands through its marketplace. The company earns subscription fees for its software and charges additional fees for services and payment volume above contracted limits. Founded in 2008, impact.com is headquartered in Santa Barbara, California.

Company size
1,001-5,000
Company stage
Growth Equity (Venture Capital)
Total funding
$331.4M
Headquarters
Santa Barbara, CA
Founded
2008

Recently Posted Jobs

Explore more opportunities at impact.com

See more jobs