Simplify Logo

Full-Time

Staff Data Engineer

Databricks

Posted on 12/13/2023

Affinity

Affinity

201-500 employees

AI-driven relationship management and analytics

Food & Agriculture
Data & Analytics
Consulting
Enterprise Software
Cybersecurity
AI & Machine Learning

Compensation Overview

$193.5k - $255.5kAnnually

Senior, Expert

Remote

Category
Data Management
Data Engineering Management
Data & Analytics
Required Skills
Python
Apache Spark
Apache Kafka
AWS
Hadoop
Data Analysis
Requirements
  • 8+ years of experience working in data engineering
  • 3+ years of acting as a senior team lead or staff engineer
  • Extensive hands-on experience in building scalable data platforms and reliable data pipelines
  • Experience with Spark, Hadoop, Databricks, AWS SQS, AWS Kinesis, and/or Kafka
  • Comfortable with high-scale data ingestion, transformation, and distributed processing tools such as Apache Spark (Scala or Python)
  • Experience with AWS, DBX or related cloud technologies
  • Familiarity with databases and analytics technologies in the industry
  • Experience mentoring and helping the engineers around you grow
  • Experience partnering with product and machine learning teams on large, strategic data projects and routine partner work
  • Pride in delivering exceptionally high quality work in terms of data accuracy, performance, and reliability
Responsibilities
  • Design scalable and reliable data pipelines
  • Help define the data roadmap
  • Build frameworks for measuring and monitoring data quality and integrity
  • Establish CI/CD processes, test frameworks, and infrastructure-as-code tooling
  • Implement and build data solutions using Spark, Python, Databricks, and the AWS ecosystem
  • Mentor, coach, and inspire the engineers on the team
  • Identify and fill gaps in the team, and create the processes necessary for the team's success

Affinity.co leverages artificial intelligence to analyze and manage professional relationships by centralizing and interpreting data from emails, calendars, and external sources. This technological approach ensures an organized, updated view of relationship networks, which can greatly enhance networking and business opportunities. As a specialist in AI-driven relationship management, working here means contributing to cutting-edge technology that shapes how businesses connect and thrive in their industries.

Company Stage

Series C

Total Funding

$133.5M

Headquarters

San Francisco, California

Founded

2014

Growth & Insights
Headcount

6 month growth

-2%

1 year growth

3%

2 year growth

9%

Benefits

Daily lunches

Commuter passes

Flexible PTO

Free events

Health insurance

INACTIVE