IT Engineer Data & Analytics DevOps

Job Description

Job Description

Job Description

▪ Design, build, and operate a stable, scalable, and secure data platform infrastructure on Azure, including Databricks, CI/CD systems, and Power BI integration.

▪ Take ownership of platform infrastructure, deployment automation, and reliability engineering by reducing manual operations through automation and engineering solutions.

▪ Enable and continuously improve the reliable execution of data pipelines by implementing observability, monitoring, and automated recovery mechanisms.

▪ Build and evolve Infrastructure-as-Code-based platform provisioning and configuration management.

▪ Collaborate with software engineers, ML engineers, and architects to ensure platform capabilities align with development and architectural standards.

Main Tasks

Platform Engineering & Infrastructure

▪ Design, build, and operate Azure-based platform infrastructure using Infrastructure-as-Code (Terraform).

▪ Automate provisioning, configuration, and scaling of platform components (AKS, Key Vault, Monitor, Storage).

▪ Automate and manage Databricks workspace configuration, access control, and cluster policies.

▪ Define and enforce platform standards for cluster usage, performance, and cost optimization.

CI/CD & Automation

▪ Design and implement CI/CD pipelines for Scala-based data applications.

▪ Automate build, packaging, and deployment processes (e.g., SBT, github enterprise).

▪ Enforce DevSecOps practices, including secure pipeline design and infrastructure governance.

Reliability Engineering & Observability

▪ Implement observability for data pipelines and platform components (logging, metrics, alerting), using grafana.

▪ Diagnose failures and implement long-term reliability improvements, including root cause analysis and post-incident remediation.

▪ Define and implement reliability engineering practices, including SLIs/SLOs, incident response, and automated recovery mechanisms.

▪ Monitor Spark workloads using logs, metrics, and performance diagnostics.

Data Platform Enablement

▪ Enable reliable runtime execution of production data pipelines and ensure SLA adherence.

▪ Collaborate with engineers to resolve performance bottlenecks and deployment issues.

▪ Support environment transitions, and platform lifecycle processes.

Power BI Platform Integration

▪ Engineer and automate Power BI service configuration, workspace management, and monitoring.

▪ Design and operate enterprise gateway infrastructure for hybrid data integration scenarios.

▪ Troubleshoot and continuously improve reliability of dataset refresh and hybrid integration pipelines.

Governance & Security

▪ Implement and enforce platform governance standards (RBAC, tagging, audit logging).

▪ Design secure secrets and credential management using Azure Key Vault, managed identities, and federated identity credentials.

▪ Automate compliance checks and support platform audits across Azure, Databricks, and Power BI environments.

Platform Optimization

▪ Optimize resource utilization, scalability, and cost-efficiency across platform components.

▪ Provide transparency into platform usage, cost drivers, and optimization opportunities.

Qualifications

Qualifications

Qualifications

▪ Degree in Computer Science, Engineering, Information Systems, or a related field.

▪ Minimum 5 years of experience in platform engineering, DevOps, or SRE roles, with a strong focus on automation and infrastructure engineering.

▪ Strong hands-on experience with cloud platforms (Azure preferred), Infrastructure-as-Code (Terraform/Bicep), and CI/CD pipelines.

▪ Experience designing and operating production-grade data platforms and pipeline ecosystems (Scala / Spark environments).

▪ Strong understanding of distributed systems, reliability engineering, and observability practices.

▪ Experience with Databricks platform operations and Spark workload optimization.

▪ Experience integrating build and deployment pipelines (e.g., SBT, github enterprise).

▪ Experience with Power BI service administration and enterprise gateway architectures is a plus.

▪ Strong focus on automation-first approaches with minimal reliance on manual operations.

▪ Ability to work across global teams and collaborate with engineers, architects, and business stakeholders.

NOT a Fit If Your Experience Is Primarily

▪ Manual system or platform administration without automation or Infrastructure-as-Code

▪ Ticket-based operations or L2/L3 support roles

▪ BI/reporting-focused roles or Power BI-only administration

Additional Information

Additional information

The well-being of our employees is important to us. That's why we offer exciting career prospects and support you in achieving a good work-life balance with additional benefits such as:

• Training opportunities
• Mobile and flexible working models
• Sabbaticals

and much more...

Sounds interesting for you? Click here to find out more.

Ready to drive with Continental? Take the first step and fill in the online application.