R

Retail Insight

SaaS platform for retail optimization

Senior Data Engineer

Data EngineeringPosted on Nov 17
Full-timeChicago, IL, USA$125k

About the Job

Requirements

  • Solid, demonstrable experience in data engineering, including building and maintaining production-grade Databricks pipelines.
  • Experience with Databricks Unity Catalog and Databricks Asset Bundles.
  • Strong hands-on knowledge of Apache Spark, Delta Lake, and Databricks Workflows.
  • Proficiency in Python and SQL, with a good understanding of data modelling, ETL/ELT patterns, and distributed data processing.
  • Experience with Azure data platforms, including Azure Data Factory, ADLS Gen2, and Azure DevOps, or equivalent services on AWS or GCP.
  • Experience implementing data quality checks and pipeline monitoring.
  • Strong communication skills and the ability to work effectively with technical and non-technical colleagues.
  • A collaborative approach, ownership of quality outcomes, and a drive to learn and improve.
  • A degree in computer science, data engineering, or a related field, or equivalent practical experience.
  • Willingness to travel as required.

Responsibilities

  • Build and maintain scalable data pipelines, developing and optimising batch and streaming workflows for reliability and performance.
  • Contribute to the design and implementation of data architecture.
  • Implement data quality checks, monitoring, and observability across pipelines.
  • Apply security, access control, and governance standards established by the platform team.
  • Collaborate with data scientists and analysts to deliver data products that support their work.
  • Work with the Lead Data Engineer to translate business requirements into technical solutions.
  • Participate in code reviews, set a high bar for engineering quality, and contribute to team standards.
  • Help identify opportunities to optimise cloud costs and platform performance.
  • Contribute to platform documentation, tooling choices, and continuous improvement.

Desired Qualifications

  • Familiarity with infrastructure-as-code tools such as Terraform or Bicep.
  • Familiarity with dbt or similar data transformation frameworks.
  • Exposure to real-time streaming technologies such as Kafka or Event Hubs.
  • Exposure to retail or consumer packaged goods (CPG) data, such as point of sale, inventory, or supply chain.
  • Experience working directly with clients.

About the Company

Retail Insight

SaaS platform for retail optimization

Retail Insight provides a SaaS software platform for retail optimization targeted at the consumer packaged goods (CPG) and grocery sectors. Its platform uses machine learning, AI, and advanced analytics to turn data from a broad portion of the global retail market into actionable insights for retailers and CPG suppliers. The product suite includes modules like AvailabilityInsight, WasteInsight, OnlineInsight, InventoryInsight, PromoInsight, and StoreInsight to address shelf availability, waste, online substitutions, phantom inventory, promotions, and overall store performance. Its goal is to help retailers and CPG brands operate more efficiently, grow sales, reduce waste, and increase profitability by delivering data-driven guidance across merchandising, supply chain, and store operations.

Company size
201-500
Company stage
Not listed
Total funding
Not listed
Headquarters
Kingston, Jamaica
Founded
2005

Recently Posted Jobs

Explore more opportunities at Retail Insight

See more jobs