Job Description

What we are building

We are building data platforms with on-prem datacenters and public clouds in multiple regions. Our stack is fairly modern. We use Kubernetes, Istio, Kong, Kafka, Flink, Spark. All new applications are developed to run in containers Our cloud infrastructure is completely described and managed using infrastructure-as-code (IAC) and configuration management tools. At the data-layer, the stack is built on top of technologies including Spark, Kafka, Hadoop For monitoring we use VictoriaMetrics, Prometheus and Grafana We use ElasticSearch , Kibana and Fluentd for logs.

Responsibilities

You’ll work on high impact projects that improve data availability, scalability, and reliability of our data infrastructure.

You will manage several Kubernetes, Kafka and Hadoop cluster You will manage resources in AWS and Azure

You will assist our system architecture team to improve the on-prem data platform.

You will design, architect, improve and support new and existing tools to help us operate at scale.

You will Own and Operate cloud infrastrucure in AWS/Azure by usic IAC tools like Terraform,Packer,Chef and Ansible

And, finally, join us in our oncall rotation.

Qualifications

• Have a strong understanding of Linux, networking and production systems.
• Have 6+ experience building and maintaining infrastructure and services or are a quick learner.
• Experience in managing Production grade Kubernetes clusters and have deep understanding on securing the workloads You have strong understanding of Kafka, Hadoop and Spark
• Proficient at scripting and programming
• Experience in using IAC and config management tools like Terraform, Packer, Chef and Ansible
• Bachelor’s degree in computer engineering or equivalent

Nice to have:

• Due to the nature of the work, US citizen is preffered but not mandatory.
• Some experience operating infrastructure service Federal customers