Full-Time

Staff Data Engineer

Affinity

Affinity

201-500 employees

CRM intelligence platform

Food & Agriculture
Data & Analytics
Cybersecurity
AI & Machine Learning

$193500 - $255500

Health care coverage, Flexible personal & sick days, Education budget, Reimbursement for transportation, Home internet, Meals, Wellness memberships/equipment

Senior, Expert

Remote

Required Skills
Python
Apache Spark
Apache Kafka
AWS
Hadoop
Data Analysis
Requirements
  • 8+ years of experience working in data engineering
  • 3+ years of acting as a senior team lead or staff engineer
  • Extensive hands-on experience in building scalable data platforms and reliable data pipelines
  • Experience with Spark, Hadoop, Databricks, AWS SQS, AWS Kinesis, and/or Kafka
  • Comfortable with high-scale data ingestion, transformation, and distributed processing tools such as Apache Spark (Scala or Python)
  • Experience with AWS, DBX or related cloud technologies
  • Familiarity with databases and analytics technologies in the industry
  • Experience mentoring and helping the engineers around you grow
  • Experience partnering with product and machine learning teams on large, strategic data projects and routine partner work
  • Pride in delivering exceptionally high quality work in terms of data accuracy, performance, and reliability
Responsibilities
  • Design scalable and reliable data pipelines
  • Help define the data roadmap
  • Build frameworks for measuring and monitoring data quality and integrity
  • Establish CI/CD processes, test frameworks, and infrastructure-as-code tooling
  • Implement and build data solutions using Spark, Python, Databricks, and the AWS ecosystem
  • Mentor, coach, and inspire the engineers on the team
  • Identify and fill gaps in the team, and create the processes necessary for the team's success

Company Stage

Series C

Total Funding

$133.5M

Headquarters

San Francisco, California

Founded

2014

Growth & Insights
Headcount

6 month growth

2%

1 year growth

10%

2 year growth

1%

Benefits

Daily lunches

Commuter passes

Flexible PTO

Free events

Health insurance