BlackStone eIT

System integrator delivering AI-enabled digital transformation

Senior Data Platform Engineer

Data EngineeringConfirmed live in the last 24 hours

Full-timeDubai - United Arab Emirates

About the Job

Requirements

A bachelor's or master's degree in Computer Science, Information Technology, or a related field is required.
At least 8 years of experience in data engineering, focused on data platform architecture and development, is required.
Strong proficiency in SQL and experience with relational and NoSQL databases are required.
Hands-on experience with cloud data platforms such as AWS, Azure, or Google Cloud is required.
Experience with big data technologies such as Hadoop and Spark, and data warehousing solutions, is required.
Knowledge of data governance, security, and compliance standards is required.
Experience leading technical projects and mentoring team members is required.
Hands-on experience extracting data from SAP FI/CO modules using OData services, RFC/BAPI, SAP Data Services, or CDS views is required.
Python experience for asynchronous data pipelines, background jobs, and scheduled tasks is required.
PostgreSQL experience in schema design, migrations with Alembic, query optimization, and partitioning is required.
Experience with Azure Data Lake Storage and Synapse Analytics is required.
Experience with Microsoft Graph API for SharePoint, M365, and organizational data is required.
Experience with Apache Airflow or Azure Data Factory is required.
Experience with dbt or an equivalent tool for transformation and quality testing is required.
Redis experience in queue management, TTL, and cache invalidation is required.
Experience with structured logging and Azure Monitor or Prometheus/Grafana is required.
Experience with Docker for containerized pipeline jobs is required.
Experience with Terraform or an equivalent infrastructure-as-code tool is required.

Responsibilities

Design, build, and maintain scalable data platforms for diverse data workloads.
Develop and optimize ETL/ELT pipelines for efficient data movement and transformation.
Collaborate with cross-functional teams to translate business requirements into technical solutions.
Ensure data platform security, governance, and regulatory compliance.
Monitor platform performance, troubleshoot issues, and implement improvements.
Provide technical leadership and mentorship to junior data engineers.
Design platform architecture, including pipeline design patterns, orchestration strategy, infrastructure-as-code, and monitoring stack.
Own the approach for enterprise data extraction from SAP FI/CO (budgets, actuals, and commitments via OData/RFC), Microsoft Graph API (SharePoint and M365), and SuccessFactors OData API, and build initial pipelines.
Design the PostgreSQL staging schema, raw-to-clean transformation patterns, and refresh strategies.
Establish logging standards, failure alerting, and monitoring dashboards for pipeline health.
Define data quality checks and determine which conditions pause a pipeline versus trigger a warning.
Work with the Governance Lead to embed automated classification tagging into every pipeline.
Set technical standards and review work for the Senior Data Platform Engineer.
Stay current with data platform engineering trends and technologies.

Senior Data Platform Engineer

BlackStone eIT · Dubai, United Arab Emirates · Full-time · Posted 2026-04-10

Workplace: on_site

Department: Outsource

Description

BlackStone eIT is seeking an experienced Senior Data Platform Engineer to lead the design, development, and maintenance of our enterprise data platforms. In this role, you will ensure that our data infrastructure is scalable, reliable, and optimized to support advanced analytics and business intelligence efforts.

You will work closely with data engineers, data scientists, and IT teams to develop robust data platforms that facilitate seamless data ingestion, processing, storage, and accessibility. This is an opportunity to make significant contributions to BlackStone eIT’s data strategy and technological advancement.

Key Responsibilities

Design, build, and maintain scalable data platforms to support diverse data workloads.
Develop and optimize ETL/ELT pipelines to ensure efficient data movement and transformation.
Collaborate with cross-functional teams to translate business requirements into technical solutions.
Ensure data platform security, governance, and compliance with relevant regulations.
Monitor platform performance, troubleshoot issues, and implement improvements.
Provide technical leadership and mentorship to junior data engineers.
Stay updated with the latest trends and technologies in data platform engineering.
- Platform architecture: pipeline design patterns, orchestration strategy, infrastructure-as-code, monitoring stack
- Enterprise data extraction: SAP FI/CO (budget, actuals, commitments via OData/RFC), Microsoft Graph API (SharePoint, M365), SuccessFactors OData API — you own the extraction approach and build the first pipelines yourself
- Staging layer design: PostgreSQL staging schema, raw-to-clean transformation patterns, refresh strategies
- Ingestion observability: logging standards, alerting on failures, monitoring dashboards for pipeline health
- Data quality framework: defining quality checks, deciding what pauses a pipeline vs. what triggers a warning
- Classification enforcement: working with the Governance Lead to embed automated classification tagging into every pipeline
- Technical mentorship: setting standards and reviewing work for the Senior Data Platform Engineer

Requirements

Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
8+ years of experience in data engineering, with a focus on data platform architecture and development.
Strong proficiency in SQL and experience with relational and NoSQL databases.
Hands-on experience with cloud data platforms such as AWS, Azure, or Google Cloud.
Experience with big data technologies like Hadoop, Spark, and data warehousing solutions.
Knowledge of data governance, security, and compliance standards.
Excellent problem-solving and communication skills.
Proven ability to lead technical projects and mentor team members.
Required Skills & Technologies
- SAP data extraction: OData services, RFC/BAPI, SAP Data Services, or CDS views — hands-on experience pulling data from SAP FI/CO modules
- Python — async data pipelines, background jobs, scheduled tasks
- PostgreSQL — schema design, migrations (Alembic), query optimization, partitioning
- Azure Data Lake Storage + Synapse Analytics
- Microsoft Graph API — SharePoint, M365, organizational data
- Apache Airflow or Azure Data Factory
- dbt or equivalent for transformation and quality testing
- Redis — queue management, TTL, cache invalidation
- Observability — structured logging, Azure Monitor or Prometheus/Grafana
- Docker — containerized pipeline jobs
- Infrastructure-as-code (Terraform or equivalent)

Benefits

Paid Time Off
Performance Bonus
Training & Development

Apply

Apply at BlackStone eIT

About the Company

BlackStone eIT

System integrator delivering AI-enabled digital transformation

Blackstone eIT is a system integrator and independent software vendor that helps organizations modernize through customized technology solutions across strategy, development, and managed services. It combines consulting, custom software, IT governance, workflow automation, and UI/UX design with hosted data storage, network, and security to support the full digital transformation lifecycle. It emphasizes long-term partnerships and uses intelligent technologies such as AI, machine learning, computer vision, big data analytics, blockchain, and IoT, including Agentic AI and Generative AI across its offerings and proprietary products like a Business Excellence Suite, Learning Management System, e-invoicing platform, Carbon Management Platform, and archiving system. Its goal is to help clients become digital-first, data-informed, and AI-enabled, with the aim of reducing costs and improving operational efficiency across finance, education, government, and manufacturing.

Company size: 201-500
Company stage: Not listed
Total funding: Not listed
Headquarters: Seattle, WA
Founded: 2014

Recently Posted Jobs

Explore more opportunities at BlackStone eIT

See more jobs