Site Reliability Engineer - Big Data

Job Description

This role is responsible for managing and maintaining complex, distributed big data ecosystems. It ensures the reliability, scalability, and security of large-scale production infrastructure. Key responsibilities include automating processes, optimizing workflows, troubleshooting production issues, and driving system improvements across multiple business verticals.

Roles and Responsibilities:

• Manage, maintain, and support incremental changes to Linux/Unix environments.
• Lead on-call rotations and incident responses, conducting root cause analysis and driving postmortem processes.
• Design and implement automation systems for managing big data infrastructure, including provisioning, scaling, upgrades, and patching clusters.
• Troubleshoot and resolve complex production issues while identifying root causes and implementing mitigating strategies.
• Design and review scalable and reliable system architectures.
• Collaborate with teams to optimize overall system performance.
• Enforce security standards across systems and infrastructure.
• Set technical direction, drive standardization, and operate independently.
• Ensure availability, performance, and scalability of systems and services through proactive monitoring, maintenance, and capacity planning.
• Resolve, analyze, and respond to system outages and disruptions and implement measures to prevent similar incidents from recurring.
• Develop tools and scripts to automate operational processes, reducing manual workload, increasing efficiency and improving system resilience.
• Monitor and optimize system performance and resource usage, identify and address bottlenecks, and implement best practices for performance tuning.
• Collaborate with development teams to integrate best practices for reliability, scalability, and performance into the software development lifecycle.
• Stay informed of industry technology trends and innovations, and actively contribute to the organization's technology communities.
• Develop and enforce SRE best practices and principles.
• Align across functional teams on priorities and deliverables.
• Drive automation to enhance operational efficiency.

Qualifications

• Over 7 years of experience managing and maintaining distributed big data ecosystems.
• Strong expertise in Linux including IP, Iptables, and IPsec.
• Proficiency in scripting/programming with languages like Perl, Golang, or Python.
• Hands-on experience with the Hadoop stack (HDFS, HBase, Airflow, YARN, Ranger, Kafka, Pinot).
• Familiarity with open-source configuration management and deployment tools such as Puppet, Salt, Chef, or Ansible.
• Solid understanding of networking, open-source technologies, and related tools.
• Excellent communication and collaboration skills.
• DevOps tools: Saltstack, Ansible, docker, Git.
• SRE Logging and monitoring tools: ELK stack, Grafana, Prometheus, opentsdb, Open Telemetry.

Good to Have:

• Experience managing infrastructure on public cloud platforms (AWS, Azure, GCP).
• Experience in designing and reviewing system architectures for scalability and reliability.
• Experience with observability tools to visualize and alert on system performance.

Additional Information

PhonePe Full Time Employee Benefits (Not applicable for Intern or Contract Roles)

Insurance Benefits - Medical Insurance, Critical Illness Insurance, Accidental Insurance, Life Insurance Wellness Program - Employee Assistance Program, Onsite Medical Center, Emergency Support System Parental Support - Maternity Benefit, Paternity Benefit Program, Adoption Assistance Program, Day-care Support Program Mobility Benefits - Relocation benefits, Transfer Support Policy, Travel Policy Retirement Benefits - Employee PF Contribution, Flexible PF Contribution, Gratuity, NPS, Leave Encashment Other Benefits - Higher Education Assistance, Car Lease, Salary Advance Policy

Our inclusive culture promotes individual expression, creativity, innovation, and achievement and in turn helps us better understand and serve our customers. We see ourselves as a place for intellectual curiosity, ideas and debates, where diverse perspectives lead to deeper understanding and better quality results. PhonePe is an equal opportunity employer and is committed to treating all its employees and job applicants equally; regardless of gender, sexual preference, religion, race, color or disability. If you have a disability or special need that requires assistance or reasonable accommodation, during the application and hiring process, including support for the interview or onboarding process, please fill out this form.

Read more about PhonePe on our blog.

Life at PhonePe

PhonePe in the news