Simplify Logo

Full-Time

Senior Data Engineer

Education

Posted on 9/10/2024

Chan Zuckerberg Initiative

Chan Zuckerberg Initiative

501-1,000 employees

Develops technologies to understand human biology

Consumer Software
Enterprise Software
Social Impact
Biotechnology
Education
Healthcare

Compensation Overview

$190k - $285kAnnually

Senior, Expert

San Carlos, CA, USA

Hybrid role with relocation support for Bay Area.

Category
Data Engineering
Data & Analytics
Required Skills
Python
Airflow
Apache Spark
SQL
Apache Kafka
AWS
Snowflake
Requirements
  • Hands-on experience with AWS services and Kubernetes.
  • Experience with Databricks / Spark ecosystem.
  • Knowledge of CDC, Debezium, and Kafka.
  • Experience in Software Engineering or Data Engineering.
  • Expertise in writing efficient and optimized SQL.
  • Experience with dimensional data modeling and schema design in a database or data warehouse.
  • Expertise with scripting languages such as Python.
  • Experience with ETL tooling such as Airflow.
  • Experience with large scale cloud data warehouses such as Snowflake.
  • Passion for education and bringing technology to improving education.
  • Experience working with large data sets.
  • Love for collaborating and working with people in understanding data needs as well as scoping and executing on projects.
Responsibilities
  • Set up roles & access permissions for Databricks following best practices.
  • Set up ETL pipelines or orchestration workflows within AWS & Databricks ecosystems.
  • Collect and organize knowledge through various sources, maintaining and updating data to ensure accuracy.
  • Transform, integrate, aggregate, annotate, and enrich data to enhance its value.
  • Derive and continuously update student attributes for personalization use cases.
  • Create new CDC pipelines to support new product launches.
  • Collaborate with the infra team on improving the monitoring and scalability of the CDC pipelines.
  • Triage and investigate Debezium or Kafka issues in collaboration with the infra team.
  • Maintain key data pipelines.
  • Ingest external data sets for use by the team.
  • Improve data usability and data quality in our data warehouse.
  • Launch new ETL (extract, transform, load) processes in production.
Chan Zuckerberg Initiative

Chan Zuckerberg Initiative

View

The Chan Zuckerberg Initiative is dedicated to developing technologies that enhance our understanding of human biology, specifically in the areas of inflammation and rare diseases. This commitment to cutting-edge science ensures a dynamic work environment where contributions lead directly to significant scientific and educational advancements. Employees have the unique opportunity to work alongside industry-leading experts and leverage novel tools in a mission-driven organization, significantly impacting health and education sectors globally.

Company Stage

N/A

Total Funding

$2.5B

Headquarters

Menlo Park, California

Founded

2015

Simplify Jobs

Simplify's Take

What believers are saying

  • CZI's substantial investments in cutting-edge technologies and startups offer employees the opportunity to work on groundbreaking projects.
  • The formation of an AI Advisory Group and residency program provides a platform for professionals to contribute to pioneering AI-driven scientific research.
  • Recognition and awards for CZI-backed projects, such as the Top EdTech Products Award for Along, highlight the initiative's impact and innovation in education technology.

What critics are saying

  • The ambitious scope of CZI's projects, such as synthetic biology and AI integration, may face significant technical and ethical challenges.
  • Dependence on high-profile partnerships and collaborations could lead to vulnerabilities if these relationships falter.

What makes Chan Zuckerberg Initiative unique

  • The Chan Zuckerberg Initiative (CZI) leverages significant financial resources and high-profile partnerships to drive innovation in both education and scientific research.
  • CZI's focus on integrating AI and synthetic biology into life sciences research sets it apart from traditional philanthropic organizations.
  • The initiative's collaboration with leading academic institutions and industry experts enhances its ability to tackle complex scientific challenges.
INACTIVE