Two95 International

Big Data Platform Engineer

Platform EngineeringConfirmed live in the last 24 hours

Full-timeRemote in IndiaNo salary listedRemote

About the Job

Requirements

At least 8 years of overall IT experience.
At least 5 years of experience in cloud infrastructure engineering.
At least 4 years of experience working with Kubernetes platforms.
At least 3 years of experience supporting enterprise-scale data platforms.
At least 3 years of experience in DevOps or site reliability engineering practices.
At least 2 years of experience working with Azure Data Services.
Strong hands-on experience with Apache NiFi, Azure Event Hub, Azure Functions, and enterprise-scale data platform administration.
Strong expertise in Azure Kubernetes Service cluster deployment and administration, cluster upgrades and patch management, node pool management, ingress controllers including NGINX and Application Gateway, role-based access control implementation, security hardening, autoscaling using HPA, VPA, and Cluster Autoscaler, persistent storage management, troubleshooting cluster issues, and network policies.
Production support of Azure Kubernetes Service environments, multi-node and multi-environment setups, and implementation of high availability and disaster recovery.
Knowledge of Kubernetes networking concepts, services, ingress, load balancers, DNS resolution, pod-to-pod and pod-to-service communication, network policies, service mesh concepts, and CNI architecture.
Knowledge of Azure networking, including virtual networks, subnets, private endpoints, peering, network security groups, user-defined routes, Azure Firewall, and VPN connectivity.
Experience creating and optimizing Docker images, managing container lifecycles and registries, security scanning, multi-stage builds, container troubleshooting, Azure Container Registry, image versioning, and governance.
Experience with Azure DevOps Pipelines, YAML pipelines, build and release pipelines, Git repositories, and branching strategies.
Experience with infrastructure as code, ARM Templates, Bicep, and Terraform, including platform provisioning, environment consistency, and version-controlled infrastructure.
Experience with deployment automation, environment promotion, and release management.
Experience implementing monitoring strategies, configuring alerts, creating dashboards, developing KQL queries, performing performance analysis and troubleshooting, and using Azure Application Insights, distributed tracing, and metrics collection.
Experience monitoring cluster health and pod performance and optimizing resources.
Hands-on experience with Azure Event Hub architecture, namespace management, consumer groups, scaling and throughput units, monitoring and troubleshooting, security, and access control.
Hands-on experience supporting Azure Functions deployment and operations, managing Function Apps, configuring scaling, integrating Managed Identity, monitoring and troubleshooting, and deploying through CI/CD.
Strong hands-on experience setting up and maintaining Apache NiFi clusters, deploying flows, configuring security, tuning performance, monitoring, and troubleshooting.
Experience with platform provisioning and maintaining environment consistency through version-controlled infrastructure.

Responsibilities

Manage and support Azure Kubernetes Service-based big data platform infrastructure.
Administer Apache NiFi, Azure Event Hub, and Azure Functions.
Implement and maintain CI/CD pipelines using Azure DevOps.
Monitor platform health using Azure Monitor and Log Analytics.
Troubleshoot platform, networking, and infrastructure issues.
Implement infrastructure automation through Terraform and Bicep.
Ensure platform security, governance, and compliance.
Collaborate with data engineering teams to enable platforms.
Perform upgrades, patching, capacity planning, and optimization.
Support production incidents and platform reliability initiatives.

Desired Qualifications

Experience with NiFi Registry, cluster scaling, and high availability implementation.
Experience with GitOps using ArgoCD or Flux, platform automation, self-service platform concepts, and internal developer platforms.
Experience with Grafana, Prometheus, and OpenTelemetry.
Experience with Microsoft Defender for Cloud, Kubernetes security best practices, container security, secrets management, and vulnerability management.
Experience with Azure Data Factory and Synapse Analytics.
Experience with multi-region architecture, disaster recovery planning, and landing zone implementation.
Experience with PowerShell, Bash, and Python.

Big Data Platform Engineer

Two95 International Inc. · India (Remote) · Full-time · Posted 2026-08-03

Workplace: remote

Description

Experience Requirements

● 8+ years of overall IT experience ● 5+ years of experience in Cloud Infrastructure Engineering ● 4+ years of experience working with Kubernetes platforms ● 3+ years of experience supporting enterprise-scale Data Platforms ● 3+ years of experience in DevOps/SRE practices ● 2+ years of experience working with Azure Data Services

Mandatory Skills

Candidates must possess strong hands-on experience in the following areas: ● Apache NiFi ● Azure Event Hub ● Azure Functions ● Enterprise-scale Data Platform Administration These are core and non-negotiable requirements. Profiles without hands-on experience in Apache NiFi and Azure Event Hub will not be considered.

Requirements

1. Azure Kubernetes Service – AKS

Strong Expertise

● AKS cluster deployment and administration ● Cluster upgrades and patch management ● Node pool management ● Ingress Controllers, including NGINX and Application Gateway ● RBAC implementation ● AKS security hardening ● Autoscaling using HPA, VPA, and Cluster Autoscaler ● Persistent storage management ● Troubleshooting cluster issues ● Network policies

Experience

● Production support of AKS environments ● Multi-node and multi-environment AKS setups ● High availability and disaster recovery implementation

2. Kubernetes and Azure Networking

Kubernetes Networking ● Kubernetes networking concepts ● Services, Ingress, and Load Balancers ● DNS resolution ● Pod-to-Pod communication ● Pod-to-Service communication ● Network Policies ● Service Mesh concepts, preferably Istio ● CNI Architecture

Azure Networking

● Virtual Networks ● Subnets ● Private Endpoints ● Peering ● Network Security Groups ● User Defined Routes ● Azure Firewall ● VPN connectivity

3. Docker and Containerization

● Docker image creation and optimization ● Container lifecycle management ● Registry management ● Security scanning ● Multi-stage builds ● Container troubleshooting ● Azure Container Registry ● Image versioning and governance

4. Azure DevOps and CI/CD

CI/CD Expertise ● Azure DevOps Pipelines ● YAML pipelines ● Build and Release pipelines ● Git repositories ● Branching strategies

Infrastructure Deployment

● Infrastructure as Code ● ARM Templates ● Bicep ● Terraform

Automation

● Deployment automation ● Environment promotion ● Release management

5. Monitoring and Observability

Azure Monitor

● Monitoring strategy implementation ● Alert configuration ● Dashboard creation

Log Analytics

● KQL query development ● Performance analysis ● Troubleshooting

Application Monitoring

● Azure Application Insights ● Distributed tracing ● Metrics collection

AKS Monitoring

● Cluster health monitoring ● Pod performance monitoring ● Resource optimization

6. Azure Event Hub Candidates must have strong hands-on experience in: ● Event Hub architecture ● Namespace management ● Consumer groups ● Scaling and throughput units ● Monitoring and troubleshooting ● Security and access control 7. Azure Functions Candidates must have hands-on experience in: ● Deployment and operations support ● Function App management ● Scaling configuration ● Managed Identity integration ● Monitoring and troubleshooting ● CI/CD deployment 8. Apache NiFi Candidates must have strong hands-on experience in: ● NiFi cluster setup and maintenance ● Flow deployment ● Security configuration ● Performance tuning ● Monitoring ● Troubleshooting Preferred ● NiFi Registry ● Cluster scaling ● High availability implementation 9. Infrastructure as Code Must-Have Skills ● Terraform ● Bicep ● ARM Templates

Required Capabilities

● Platform provisioning ● Environment consistency ● Version-controlled infrastructure Good-to-Have Skills Platform Engineering ● GitOps using ArgoCD or Flux ● Platform automation ● Self-service platform concepts ● Internal Developer Platform Observability ● Grafana ● Prometheus ● OpenTelemetry Security ● Microsoft Defender for Cloud

● Kubernetes security best practices ● Container security ● Secrets management ● Vulnerability management Data Platform ● Azure Data Factory ● Synapse Analytics Cloud ● Multi-region architecture ● Disaster recovery planning ● Landing Zone implementation Scripting ● PowerShell ● Bash ● Python

Key Responsibilities

● Manage and support AKS-based Big Data platform infrastructure. ● Administer Apache NiFi, Azure Event Hub, and Azure Functions. ● Implement and maintain CI/CD pipelines using Azure DevOps. ● Monitor platform health using Azure Monitor and Log Analytics. ● Troubleshoot platform, networking, and infrastructure issues. ● Implement infrastructure automation through Terraform and Bicep. ● Ensure platform security, governance, and compliance. ● Collaborate with Data Engineering teams for platform enablement. ● Perform upgrades, patching, capacity planning, and optimization. ● Support production incidents and platform reliability initiatives.

Apply

Apply at Two95 International Inc.

About the Company

Two95 International

Company size: Not listed
Company stage: Not listed
Total funding: Not listed
Headquarters: Not listed
Founded: Not listed

Recently Posted Jobs

Explore more opportunities at Two95 International

See more jobs