Lead Big Data Administrator

Company Description

See how Epsilon powers connected marketing by unlocking the full potential of data and identity.

Overview

Employer: Epsilon Data Management LLC   

Job Title: Lead, Big Data Administrator  

Job Requisition:6630.7112.9

Job Location: Irving, Texas 

Job Type: Full Time 

Responsibilities

Duties: Responsible for deploying and managing large-scale distributed systems, ensuring their performance, availability, and scalability; Oversee the installation, configuration, and maintenance of Hadoop ecosystems, including HDFS, Yarn, Hive, and Spark, as well as Kafka clusters; Implement and manage high-availability and disaster recovery strategies for both Hadoop and Kafka environments; Performance tuning, including resource allocation, cluster optimization, and monitoring, is a core responsibility to maintain system efficiency; Handle data pipeline orchestration and ensure seamless integration between Kafka producers, consumers, and downstream processing frameworks; Ensuring data security through encryption, access control, and auditing mechanisms; Troubleshoot and resolve complex issues related to cluster health, data loss, or Kafka offsets while maintaining minimal downtime; Automation of repetitive tasks using tools like Ansible, shell scripting in order to enhance the operational efficiency; Collaborate closely with development, data engineering, and analytics teams to support evolving business requirements and optimize workflows; and Staying updated with emerging technologies in big data and streaming, which provide strategic guidance on system upgrades and architectural improvements. 

Telecommuting available from anywhere in the US 

Qualifications

Requirements Employer will accept a bachelor’s degree in Computer Applications or a related field followed by eight years of progressive, post-baccalaureate experience in the job offered or eight years of progressive, post-baccalaureate experience in any occupation in which the required experience was gained

Position requires:

1. Proficiency with the core Hadoop components and managing a cluster, including HDFS, Yarn, Hive, and Spark, as well as Kafka clusters.
2. Utilize ZooKeeper for coordination and synchronization within both Hadoop and Kafka clusters
3. Kerberos Security-Authentication: Kerberos, LDAP integration; Encryption: SSL/TLS, Hadoop KMS; Audit Tools: Ranger, Atlas, or custom solutions
4. Prometheus and Grafana to visualize metrics and set up alerts to track the health, performance, and resource utilization of clusters.
5. Diagnose and resolve complex issues related to cluster connectivity, performance degradation, and system failures
6. Fine-tune cluster configurations and optimize job performance by adjusting parameters related to memory, I/O, and replication
7. Bash and Python to automate routine tasks such as backups, log management, and cluster maintenance

Telecommuting available from anywhere in the US 

Additional Information

When you join Epsilon, we’ll create something EPIC together. We’re a global leader in data and identity, with deep expertise in digital media, clean rooms, customer data platforms, loyalty and marketing services. Positioned at the center of Publicis Groupe, Epsilon helps brands deliver personalized experiences at scale and build lasting customer relationships by unlocking the full potential of data and identity. Epsilon operates in 30+ countries across EMEA, the Americas and APAC, with more than 8,000 employees.

Check out a few of these resources to learn more about what makes Epsilon so EPIC:

Our Culture: https://www.epsilon.com/us/about-us/our-culture-epsilon

Life at Epsilon: https://www.epsilon.com/us/about-us/epic-blog

Epsilon has five values that define our culture and guide us as we create value for our clients, our people and consumers. We seek candidates who align with our company values, demonstrate them and make them meaningful in their day-to-day work:

• Act with integrity. We are transparent and have the courage to do the right thing.
• Work together to win together. We believe collaboration is the catalyst that unlocks our full potential.
• Innovate with purpose. We shape the market with big ideas that drive big outcomes.
• Respect all voices. We embrace differences and foster a culture of connection and belonging.
• Empower with accountability. We trust each other to own and deliver on common goals.

Because You Matter

As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to:

• Time to recharge: Flexible time off (FTO), 14 paid holidays, paid sick time
• Family well-being: Parental/new child leave, childcare & elder care assistance, adoption assistance
• Extra perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling

Epsilon benefits are subject to eligibility requirements and other terms.

Epsilon is an Equal Opportunity Employer. Epsilon’s policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information or any other characteristic protected by applicable federal, state or local law. Epsilon also prohibits harassment of applicants and employees based on any of these protected categories. Epsilon will provide accommodations to applicants who need accommodations to complete the application process. Please reach out to [email protected] to request an accommodation.

For San Francisco Bay and Los Angeles Areas: Epsilon will consider qualified applicants with criminal histories for employment in a manner consistent with the City of Los Angeles’ Fair Chance Initiative for Hiring Ordinance and San Francisco Police Code Sections 4901-4919, commonly referred to as the San Francisco Fair Chance Ordinance. Applicants with criminal histories are welcome to apply.

 

Compensation Range: USD $138,715.00 - USD $182,000.00/Annually. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time. Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party benefits administration system once certain criteria have been met. For regular roles, the Company will offer medical coverage, dental, vision, disability, 401k, and paid time off. The Company anticipates the application deadline for this job posting will be 1/25/2027.