Lead Data Engineer

We are Two Circles. We are a Sports & Entertainment Marketing business. We grow audiences and revenues. We do that by knowing fans best. We work with clients to help them understand & influence what their fans are doing – the way fans spend their money, the events that fans attend, the channels fans respond to, the content fans watch and more. And we use the understanding this gives us to help our clients grow. Grow their audiences and grow their revenues - both direct to consumer and business to business revenues. Our platforms and services are trusted by over 1000 clients globally, including the English Premier League, Red Bull, UEFA, VISA, the NFL, Nike and Amazon. We are over 1000 people, based out of 15 offices, and we deliver work for sports and entertainment businesses of all shapes and sizes all over the world.

Two Circles is looking for a Data Engineer to join our dynamic KORE Intelligence Platform team. In this role, you'll be a key part of our Partnership Intelligence > Measurement Team that specializes in the ingestion, transformation, and storage of large-scale social and broadcast data. Working under the guidance of an experienced Data Engineers and Architects, you will gain hands-on experience designing and maintaining scalable, efficient data pipelines that support enterprise web applications, analytics, and business intelligence.

About The Role

We are seeking a Lead Data Engineer to join our Measurement team in the Partnership Intelligence Platform. You will round out the team with expertise in directly managing AWS Services, with technologies such as Airflow, Snowflake, MS SQL Server and .Net. Experience designing and managing large scale data pipelines is a must for this role, as well as a keen interest to explore new technologies and solutions. We are looking for someone who brings experience and passion working with the flow of data and infrastructure.

Key Responsibilities

• Work as part of a cross-functional product team to deliver a high-quality SaaS based data platform.
• Design and implement data pipelines with a clear focus on data quality and reliability.
• Partner with both Product Management and stakeholders, as well as both technical and non-technical team members to deliver our vision, roadmap, and data strategy in addition to innovative client solutions.
• Act as an advocate for development best practices including technical design reviews, implementing test plans, test driven development, monitoring/alerting, peer code reviews, and documentation.
• Contribute to our DevOps culture and participate in ownership of our designs through production operations.
• Support the ongoing maintenance and operations of the data platform.

Ideal Tech Stack:

• .Net / C#
• Python
• AWS or similar
• Snowflake
• SQL
• Airflow

Experience

• 7+ years of experience in software engineering with a data focus, working in a fast-paced, agile environment
• 7+ years of experience writing, debugging and refining database queries
• 7+ years of experience with object oriented languages (preferably Python and C# .Net)
• 7+ years of experience building or maintaining cloud infrastructure and services (preferably AWS)
• 7+ years experience automating repetitive tasks (like setups, developer onboarding, support, moving data, etc.)

Technical Skills

• Experience with various orchestration and batch processing technologies like Apache Airflow
• Proficiency in Snowflake and MS SQL.
• Proficiency in Python and C#. Both are required to be successful in this role
• Strong experience with containerization such as Docker
• Familiarity with monitoring tools for data pipeline performance such as New Relic
• Experience developing against APIs and building scalable systems.
• Experience with writing unit tests using frameworks such as PyTest for quality assurance.
• Understanding architectural differences between streaming and batch-oriented integrations

Professional Growth: Work on a variety of projects, enhancing your testing skills across different applications and technologies.

Impactful Work: Play a key role in delivering high-quality solutions that shape the future of the sports and entertainment industries.

Collaborative Environment: Be part of a team that values ideas, fosters a supportive atmosphere, and encourages continuous learning and improvement.

Innovative Culture: Join a company committed to revolutionizing fan and stakeholder engagement through cutting-edge technology.

Equal Opportunity Employer: Two Circles is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.

The range below represents the low and high end of the base salary someone in this role may earn as an employee of Two Circles. Salaries will vary based on various factors including but not limited to professional and academic experience, training, associated responsibilities, and other business and organizational needs. The range listed is just one component of our total compensation package for employees. Salary decisions are dependent on the circumstances of each hire.