Data Engineer
Posted on 9/26/2023
INACTIVE
Locations
Toronto, ON, Canada
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Agile
Apache Spark
Apache Kafka
Data Analysis
Google Cloud Platform
Java
Airflow
Apache Flink
Python
Looker
CategoriesNew
Data & Analytics
Requirements
- Ability to effectively communicate data insights and negotiate options at senior management levels
- Experience in leading significant project steps and communicating progress/approach with technical/non-technical peers/clients and leaders
- GCP experience (for junior candidates, or exceptional talent with other cloud experience, we will provide training programs)
- Experience in large-scale, secure, and high-availability solutions in a Cloud environment, such as GCP
- Experience with one Dataflow or Spark
- Experience with orchestration frameworks such as Airflow, Kubeflow, Azkaban, etc
- Extensive programming experience in Python, Java and/or Scala
- Good understanding of modern data architecture
- Good understanding of GCP services such as IAM, and Google Cloud Storage buckets
- Experience with business intelligence tools like QuickSight, Looker and Data Studio
- Technical writing experience; preparing and presenting technical material to a variety of audiences
- Experience in working in or with, Agile delivery teams
- Passionate about delivering high-quality commercial software products and platforms to market
- Team player. We are a small team and enjoy working with each other and our clients - we would like to keep it the same way as we grow
- Strong understanding of modern software engineering processes
- Client-focused and passionate about delivering strong business values
- Able to communicate clearly and effectively with various audiences, including developers, clients, customers, partners, and executives
- Flexible and willing to use the right technology for each problem in the context of timelines and business goals
- Ability to complete the job regardless of the circumstance
Responsibilities
- Work closely with technical leads and client teams to fully demonstrate the benefits of GCP technology
- Introduce clients to data architecture and analytics best practices
- Solve some of the most challenging, high-scale data, and IoT problems (banking, telco, energy, retail, etc.)
- Write high-quality and testable batch and real-time data pipelines
- Work with Data Scientists to design pipelines that improve their productivity and enable them to implement their ideas
- Support clients in troubleshooting issues in their test and/or production environments and identifying root causes and solutions
Desired Qualifications
- Streaming experience with Dataflow, Spark, Flink, Kafka Streams, etc
- Strong understanding of Data Governance principles and experience working with tools such as Collibra or Immuta