Data Engineer
Posted on 9/26/2023
Toronto, ON, Canada
Experience Level
Desired Skills
Apache Spark
Apache Kafka
Data Analysis
Google Cloud Platform
Apache Flink
Data & Analytics
  • Ability to effectively communicate data insights and negotiate options at senior management levels
  • Experience in leading significant project steps and communicating progress/approach with technical/non-technical peers/clients and leaders
  • GCP experience (for junior candidates, or exceptional talent with other cloud experience, we will provide training programs)
  • Experience in large-scale, secure, and high-availability solutions in a Cloud environment, such as GCP
  • Experience with one Dataflow or Spark
  • Experience with orchestration frameworks such as Airflow, Kubeflow, Azkaban, etc
  • Extensive programming experience in Python, Java and/or Scala
  • Good understanding of modern data architecture
  • Good understanding of GCP services such as IAM, and Google Cloud Storage buckets
  • Experience with business intelligence tools like QuickSight, Looker and Data Studio
  • Technical writing experience; preparing and presenting technical material to a variety of audiences
  • Experience in working in or with, Agile delivery teams
  • Passionate about delivering high-quality commercial software products and platforms to market
  • Team player. We are a small team and enjoy working with each other and our clients - we would like to keep it the same way as we grow
  • Strong understanding of modern software engineering processes
  • Client-focused and passionate about delivering strong business values
  • Able to communicate clearly and effectively with various audiences, including developers, clients, customers, partners, and executives
  • Flexible and willing to use the right technology for each problem in the context of timelines and business goals
  • Ability to complete the job regardless of the circumstance
  • Work closely with technical leads and client teams to fully demonstrate the benefits of GCP technology
  • Introduce clients to data architecture and analytics best practices
  • Solve some of the most challenging, high-scale data, and IoT problems (banking, telco, energy, retail, etc.)
  • Write high-quality and testable batch and real-time data pipelines
  • Work with Data Scientists to design pipelines that improve their productivity and enable them to implement their ideas
  • Support clients in troubleshooting issues in their test and/or production environments and identifying root causes and solutions
Desired Qualifications
  • Streaming experience with Dataflow, Spark, Flink, Kafka Streams, etc
  • Strong understanding of Data Governance principles and experience working with tools such as Collibra or Immuta