Data Engineer
Data Ops
Posted on 10/20/2022
INACTIVE
Ad & marketing platform
Company Overview
System1's mission is to provide the most accurate and useful predictions in marketing. The company operates a Responsive Acquisition Marketing Platform to connect high intent customers with advertisers at scale.
Data & Analytics
Company Stage
N/A
Total Funding
$920M
Founded
2013
Headquarters
Los Angeles, California
Growth & Insights
Headcount
6 month growth
↓ -6%1 year growth
↓ -9%2 year growth
↓ -2%Locations
Los Angeles, CA, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Microsoft Azure
Redshift
Python
Airflow
BigQuery
SQL
Apache Kafka
AWS
Linux/Unix
Data Analysis
Snowflake
Google Cloud Platform
CategoriesNew
Data & Analytics
Requirements
- SQL expertise, and preferably SQL query optimization experience
- Programming proficiency, Python preferred
- Datastores, both relational and non-relational. Snowflake, Redshift, BigQuery preferred
- Cloud ecosystems such as AWS, Azure or GCP
- Modern orchestration platforms such as Airflow
- Strong data engineering fundamentals and skills
- Knowledge of data engineering mechanics, flow, distribution, organization, optimization, latency, observability
- Nuances of distributed data processing and storage systems
- Containerization strategies, Linux/UNIX
- Experience with Kafka is preferred, but not required
Responsibilities
- Designing and developing data processing infrastructure
- Developing new and improving existing data pipelines, extracting from external API sources or internal events
- Consult with engineering teams to productionize data pipelines
- Continuously improving monitoring and alerting coverage
- Identifying scaling bottlenecks and how to prevent them
- Contribute to technical specification documents for data architecture projects
- Performing maintenance of existing infrastructure, investigating issues and failures
- Conducting SQL data investigations
- Proof of concept for new technologies, new patterns, new APIs.Participate in peer code reviews and produce high quality documentation