Senior Core Infrastructure Engineer

Independently designs, implements, and optimizes components within distributed systems to meet scalability, reliability, and operational requirements. Owns scoped features from design through production, validates behavior through performance, load, and fault-injection testing, and reviews peer implementations for correctness and resilience. Uses data plane platforms and distributed state technologies to support high-volume data retrieval, storage, and processing.
Designs for failure and recovery using redundancy, replication, synchronization, and automatic failover. Configures retries, circuit breakers, and timeouts to handle network variability and dependency failures. Builds actionable telemetry, dashboards, and alerts; authors runbooks; and participates in on-call rotations, incident response, and root cause analysis. Uses operational findings to prevent recurrence and improve system reliability.
Develops automation and infrastructure-as-code tools for troubleshooting and maintenance. Applies encryption, access controls, and vulnerability remediation, and follows change management, security, compliance, and documentation standards. Resolves component-level issues independently and collaborates with senior engineers on broader architectural decisions and complex failures.
 

Key Responsibilities
System Design & Architecture - System Scalability:
–Implements and contributes to the development for components of distributed systems that support horizontal and vertical scaling including leveraging distributed state management tools.
–Optimizes code and/or systems for large-scale data processing in large-scale systems.
–Implements scalability requirements for assigned components and reviews implementation of team members.
–Leverages components of data plane platforms to handle large-scale data retrieval, storage, and processing.
–Implements performance and load testing.
System Design & Architecture - System Reliability Design:
–Collaborates with team to build fault-tolerant components capable of withstanding in-service updates by implementing redundancy, replication, and automatic failover mechanisms.
–Applies recovery oriented computing principles to design components that effectively handle service disruptions.
–Implements retry mechanisms, circuit breakers, and timeouts to help handle network unreliability.
System Design & Architecture - System Reliability Performance:
–Implements tests and alarm configurations to proactively detect and address issues/failures.
–Supports efforts to recover from failures by drafting and executing runbooks and operational procedures.
–Builds and customizes dashboards, telemetry systems, and alerting mechanisms to monitor component health.
System Design & Architecture - Correctness / Availability:
–Designs and implements functional requirements and testing for assigned features within an existing system.
–Implements tests scenarios (e.g., fault-injection, brown-out) to evaluate system correctness.
–Implements standard data replication and synchronization techniques to maintain data integrity and availability.
Operational Troubleshooting & Incident Management:
–Diagnoses, debugs, and resolves issues in system components to support ongoing operation.
–Implements basic strategies to prevent interruptions, ensuring no maintenance windows are required for customers and users when resolving issues.
–Designs and implements automation scripts and tooling used to troubleshoot operational issues.
–Participates in operational support rotations, assisting in incident responses and root cause investigations.
Compliance & Security:
–Applies advanced security measures to protect data and applications in multi-tenant environments, including encryption and access controls.
–Implements remediation plans to continuously improve security.
–Collaborates with the team to ensure cloud infrastructure complies with relevant industry standards and regulations and that documentation is up-to-date
Automation & Change Management:
–Maintains automation scripts and tools (e.g., Infrastructure as Code (IaC)) for managing cloud infrastructure.
–Adheres to change management plans for patching, updating, and rolling back applications.

Basic Qualification

• 5+ years of industry experience working on commercial or open-source software.
• Strong fluency in C++ or Java or similar modern languages
• Excellent problem-solving skills and a deep understanding of Computer Science fundamentals, including data structures, algorithms, and distributed systems.
• Experience with cloud infrastructure (AWS/GCP/Azure) and build control plane systems for cloud scale
• Strong systems programming skills, including experience with multi-threading and concurrency.
• A solid foundation in distributed systems concepts (e.g., consistency, scaling, failure recovery).
• Experience with implementation testing, debugging, and documentation, specifically within a Linux development environment.
• BS in Computer Science; Masters preferred
• Intense curiosity, willingness to question and passion for making systems