M

Müllers Solutions

Big Data Engineer

Data EngineeringConfirmed live in the last 24 hours
Full-timeDubai - United Arab EmiratesNo salary listedIn-person

About the Job

Requirements

  • A bachelor's degree in Computer Science, Information Technology, or a related field is required.
  • At least 3 years of experience as a Big Data Engineer or in a similar data engineering role is required.
  • Proficiency in big data technologies such as Apache Spark, Hadoop, and Apache Kafka is required.
  • Strong coding skills in Java, Scala, or Python are required.
  • Familiarity with data processing frameworks and extract, transform, load (ETL) tools is required.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud and data storage solutions such as HDFS, S3, or BigQuery is required.

Responsibilities

  • Design, build, and maintain scalable data pipelines using big data technologies such as Apache Spark, Hadoop, and Kafka.
  • Collaborate with data scientists, analysts, and IT teams to identify data requirements and deliver solutions that meet business needs.
  • Ensure high data quality and integrity by implementing robust data validation and testing processes.
  • Optimize data storage solutions for performance and cost efficiency across cloud and on-premises environments.
  • Monitor and troubleshoot data processing workflows to ensure timely data delivery.
  • Document data architectures, processes, and workflows for knowledge sharing and compliance.
  • Stay current with industry trends and best practices in big data technologies and methodologies.

Desired Qualifications

  • Experience with machine learning frameworks and algorithms.
  • Knowledge of data governance and security best practices.
  • Familiarity with containerization technologies and orchestration tools such as Docker and Kubernetes.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at Müllers Solutions

See more jobs