R

Raising The Village

Not-for-profit boosts rural agricultural incomes

Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeNo salary listed

About the Job

Requirements

  • One to three years of experience.
  • A bachelor's degree in Computer Science, Software Engineering, Data Engineering, Information Systems, Statistics, or a related quantitative field is preferred; equivalent practical experience through demonstrable project work, open-source contributions, or bootcamp training is welcome.
  • Clear evidence of building and shipping production-grade pipelines, including demonstrable ownership from design through deployment with specific examples of integrating, moving, and transforming data at meaningful scale.
  • Strong hands-on experience with Python, including Pandas, SQL, and building or supporting ETL/ELT pipelines.

Responsibilities

  • Design and deliver batch and streaming data pipelines that ingest data from field collection platforms, including SurveyCTO, ArcGIS, and custom mobile apps, into the Databricks warehouse.
  • Implement ELT and ETL workflows in PySpark and Databricks SQL, applying Medallion Architecture principles to produce clean, versioned, consumption-ready data layers.
  • Contribute to sprint-based delivery cycles and own pipeline workstreams end-to-end, from design through deployment and monitoring.
  • Build and maintain Delta Lake table structures with schema enforcement, ACID-compliant write patterns, and time travel capabilities to support auditability across program datasets.
  • Contribute to data modelling decisions, including star schema design, slowly changing dimension patterns, and denormalization trade-offs.
  • Support the evolution of Unity Catalog governance structures, including lineage tracking, access controls, and dataset documentation.
  • Support data observability frameworks across pipeline stages, covering data freshness, volume anomalies, schema drift detection, and service-level agreement monitoring.
  • Build validation and quality checks at ingestion and transformation layers using tools such as Great Expectations, dbt tests, or Databricks-native monitoring capabilities.
  • Contribute to structured logging, alerting, and incident response practices that provide visibility into pipeline health across environments.
  • Integrate structured household data, image classification outputs, and machine-learning model predictions into unified warehouse layers for use by Data Scientists and the WorkMate AI platform.
  • Collaborate with ML Engineers and Data Scientists to build and maintain feature engineering pipelines and training data preparation workflows supporting computer vision and adoption scoring systems.
  • Work with the technical team on roadmap prioritization, architectural decisions, and engineering standards.
  • Partner with Software Engineers, Data Scientists, field evaluation teams, and program staff to understand data requirements and translate them into reliable, documented pipeline solutions.
  • Maintain documentation of pipeline architectures, transformation logic, data dictionaries, and runbooks.

Desired Qualifications

  • Experience with PySpark, Databricks, or similar modern data platforms is highly valued.
  • Exposure to Delta Lake, Unity Catalog, Medallion Architecture, streaming pipelines, data observability, AWS, and business intelligence tools is considered an asset.

About the Company

Raising The Village

Not-for-profit boosts rural agricultural incomes

Raising The Village partners with ultra-poor, last-mile communities to raise household income and production from under $1/day to over $2/day by boosting farming income, expanding diverse income sources, building productive assets, and removing barriers to economic participation. Its programs combine community collaboration with hands-on farming, income diversification, and asset development, guided by real-time data analytics that monitor conditions and outcomes to adjust interventions quickly. The organization relies on live data to target support where it is needed, enabling precise, measurable impact as a not-for-profit. The goal is to lift the poorest households’ income and production in a sustainable way through data-informed, household-level assistance.

Company size
201-500
Company stage
Not listed
Total funding
Not listed
Headquarters
Toronto, Canada
Founded
2006

Recently Posted Jobs

Explore more opportunities at Raising The Village

See more jobs