Big Data Engineer

Company Description

See how Epsilon powers connected marketing by unlocking the full potential of data and identity.

Overview

At Epsilon, we do more than collect and store data. We help some of the world’s biggest brands discover real opportunities inside the data types, delimiters and decimals. We’re looking for an experienced Software Engineer to join Epsilon’s Development Team in our Data Practice.

We’re looking for an experienced Software Engineer to help us build innovative and secure data solutions for social media, search, and digital ads within a Big Data environment. In this role, you will use best-in-class engineering approaches and secure data management practices to help process terabytes of data each week, while solving difficult problems using predictive analytics and cutting-edge technologies. 

In this role with our company, you will work in a group that is not only focused on their project work but also their efficiency, compliance, standards, situational awareness, and readiness. You’ll be a critical part of a fast-moving, innovative team where you’ll work independently in some situations as well as working with a greater team in tasks that require full collaboration.

Responsibilities

• Design, develop, and maintain scalable data processing solutions across on-premises and cloud environments using Python and Apache Spark on Databricks.
• Optimize and fine-tune Spark jobs for performance, including resource utilization, shuffling, partitioning, and caching, to ensure maximum efficiency in large-scale big data environments.
• Design and implement scalable, fault-tolerant data pipelines with end-to-end monitoring, alerting, and logging.
• Leverage AWS/DBX cloud services to build and manage data pipelines and distributed processing workloads.
• Develop and optimize SQL queries across relational and data warehouse systems (RDBMS/Data Warehouse).
• Apply design patterns and best practices for efficient data modeling, partitioning, and distributed system performance.
• Use Git (or equivalent) for source control and maintain strong unit and integration testing practices.
• Collaborate with Product Owners, partners, and cross-functional teams to translate business requirements into technical solutions.
• Demonstrate strong analytical skills with the ability to extract actionable insights from large datasets and support data-driven decision-making.

Qualifications

• B.S. in Computer Science, Computer Engineering, or a similarly related field.
• 1-3 years of software development experience in a scalable, distributed, or multi-node environment.
• Experience in Machine Learning, including model development, feature engineering, or integrating ML workflows into data pipelines.
• Passionate about DATA – understanding data ingestion, ETL processes, and data shift/trend analysis.
• Proficient in programming with Python, PySpark, SQL, or C++ and is comfortable building data-driven solutions at scale.
• Experience with Databricks, including Notebooks, Delta Lake, Jobs, Pipelines, and Unity Catalog, preferred.
• Significant experience with Apache Spark and exposure to Hadoop, Hive, and related big data technologies.
• Demonstrated experience with cloud platforms (AWS, preferred) and an interest in cloud migration projects.
• Exposure to modern data tools and frameworks such as Databricks and MWAA/Airflow.
• Strong problem-solving skills with the ability to own problems end-to-end and deliver results.
• Consultative mindset — comfortable taking initiative, building relationships, communicating broadly, and tackling challenges head-on. 
• Collaborative team player with an eagerness to learn from peers and mentors while contributing to a culture of growth.
• Motivated to grow your career within a dynamic, innovative company

Why you might stand out from other talent:

• Experience with all three of Hadoop, Spark, and Scala is a plus.
• Experience with both Docker and Kubernetes is a plus.
• AWS, Databricks, or Spark certifications are preferred.
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations is a plus.

Additional Information

When you join Epsilon, we’ll create something EPIC together. We’re a global leader in data and identity, with deep expertise in digital media, clean rooms, customer data platforms, loyalty and marketing services. Positioned at the center of Publicis Groupe, Epsilon helps brands deliver personalized experiences at scale and build lasting customer relationships by unlocking the full potential of data and identity. Epsilon operates in 30+ countries across EMEA, the Americas and APAC, with more than 8,000 employees.

Check out a few of these resources to learn more about what makes Epsilon so EPIC:

Our Culture: https://www.epsilon.com/us/about-us/our-culture-epsilon

Life at Epsilon: https://www.epsilon.com/us/about-us/epic-blog

Epsilon has five values that define our culture and guide us as we create value for our clients, our people and consumers. We seek candidates who align with our company values, demonstrate them and make them meaningful in their day-to-day work:

• Act with integrity. We are transparent and have the courage to do the right thing.
• Work together to win together. We believe collaboration is the catalyst that unlocks our full potential.
• Innovate with purpose. We shape the market with big ideas that drive big outcomes.
• Respect all voices. We embrace differences and foster a culture of connection and belonging.
• Empower with accountability. We trust each other to own and deliver on common goals.

Because You Matter

As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to:

• Time to recharge: Flexible time off (FTO), 14 paid holidays, paid sick time
• Family well-being: Parental/new child leave, childcare & elder care assistance, adoption assistance
• Extra perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling

Epsilon benefits are subject to eligibility requirements and other terms.

Epsilon is an Equal Opportunity Employer. Epsilon’s policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories. Epsilon will provide accommodations to applicants who need accommodations to complete the application process. Please reach out to [email protected] to request an accommodation.

For San Francisco Bay and Los Angeles Areas: Epsilon will consider qualified applicants with criminal histories for employment in a manner consistent with the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance. Applicants with criminal histories are welcome to apply. 

#LI-AM1

 

Compensation Range: USD $73,500.00 - USD $136,500.00/Annually. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time. Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party benefits administration system once certain criteria have been met. For regular roles, the Company will offer medical coverage, dental, vision, disability, 401k, and paid time off. The Company anticipates the application deadline for this job posting will be 12/24/2026.