Data Engineering Lead
Confirmed live in the last 24 hours
Mobile brand advertising software
Company Overview
Kargo’s mission is to unite the world’s leading brands and premium publishers on mobile devices using innovative and creative ad formats. The company is transforming advertising in the mobile space by providing businesses with metrics to analyze and improve performance across key advertiser KPI’s.
Company Stage
N/A
Total Funding
$6.7M
Founded
1999
Headquarters
New York, New York
Growth & Insights
Headcount
6 month growth
↑ 6%1 year growth
↑ 40%2 year growth
↑ 60%Locations
New York, NY, USA
Experience Level
Entry
Junior
Mid
Senior
Expert
Desired Skills
Agile
AWS
Confluence
Docker
JIRA
Airflow
Snowflake
SQL
Kubernetes
Python
CategoriesNew
Data & Analytics
DevOps & Infrastructure
Software Engineering
Requirements
- You have proven expertise in owning, designing and maintaining large-scale, interdependent systems
- You have experience in planning deployment and leading a team to complete development on such systems
- You have mastery in Python and experience with building complex pipelines in Airflow
- You have proficiency in crafting SQL queries for Snowflake, with an understanding of cost and performance nuances
- You have experience with Docker/Kubernetes and the AWS ecosystem
- You have familiarity interacting with third party APIs within ETL pipelines
- You are familiar with Agile methodologies and have worked with Jira/Confluence
- You are comfortable communicating and presenting complex topics and plans to people in the organization, regardless of their technical skill level
- You are comfortable with requirements gathering, cross-team design brainstorming sessions, and ensuring consensus among stakeholders
- You have an innate drive to take initiative and ownership of projects, transform uncertainty into actionable strategies, and a deep-seated pride in delivering meticulous, high-quality work
Responsibilities
- Oversee a team of data engineers, ensuring adherence to high standards, project delivery, and continuous skill development
- Engage in deep-dive sessions with a diverse range of technical and non-technical stakeholders, translating business needs into actionable technical requirements in Jira/Confluence
- Collaborate with data vendors and our data partnership team to evaluate and onboard new datasets that will enhance our targeting abilities. You and your team will be responsible for building and maintaining scalable and cost-efficient data ingestion pipelines (Python, Airflow, Snowflake, AWS, Docker, Kubernetes)
- Spearhead the architecture, design and enhancement of our targeting solutions and workflows, ensuring quality, efficiency, and transparency of the processes
- Create comprehensive documentation detailing system architecture, interdependencies, data flow diagrams, and best practices for future reference and onboarding purposes
- Monitor data storage and processing costs, seeking ways to optimize without compromising on quality