Simplify Logo

Full-Time

Senior Data Engineer

Posted on 10/25/2023

Zencore

Zencore

51-200 employees

Provides generative AI and managed solutions

Consulting
Enterprise Software

Senior

Remote in USA

Category
Data Engineering Management
Data & Analytics
Required Skills
Python
Airflow
BigQuery
Apache Spark
SQL
Java
Hadoop
Data Analysis
Snowflake
Google Cloud Platform
Requirements
  • 5+ years of experience serving as a data engineer or in a comparable engineering capacity
  • Strong skills with Python or a JVM language (Java, Scala)
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases
  • Experience working with cloud data warehouses, specifically BigQuery or Snowflake
  • Experience working with data platforms built on public cloud in a production setting
  • Experience developing production Spark or Hadoop applications
  • Gained experience with a workload scheduling and orchestration tool such as Apache Airflow/Cloud Composer
  • Familiarity with modern DataOps practices and IaC (e.g. Terraform)
  • Experience with batch, micro-batch, and real-time streaming architectures
  • Experience with relational database management systems and change data capture (CDC) is a plus
Responsibilities
  • Working with fast-paced innovative companies, leveraging Cloud as the key driver of their transformation
  • Covering a large spectrum of technology topics like ETL/ELT, Data Warehousing, Distributed Data Processing, and Streaming Data systems
  • Being a trusted advisor for customers, helping them along their journey on Google Cloud
  • Developing ELT or ETL pipelines processing large amounts of data
  • Communicating internally and with customers
  • Connecting customers to Google and moving quickly when others can’t
  • Removing uncertainty and risk by clearly outlining the process of cloud migration for customers
  • Accelerating timelines and not dwelling on a challenge
  • Relating to customer complexities
Desired Qualifications
  • Experience with dbt or Airbyte is preferred
  • Experience with GCP native data toolset is preferred
  • Experience with relational database management systems and change data capture (CDC) is a plus

Zencore specializes in Zen_AI, a generative AI solution, leveraging the expertise of former Google Cloud Architects and Engineers to provide managed solutions and migration services. Their focus on deep engineer-to-engineer relationships makes them a top choice for addressing complex technical infrastructure challenges.

Company Stage

N/A

Total Funding

N/A

Headquarters

San Francisco, California

Founded

2021

INACTIVE