A

Accenture

Advises businesses and runs their technology

Data & AI Consultant - Databricks

Data EngineeringConfirmed live in the last 24 hours
Full-timeKuala Lumpur, Federal Territory of Kuala Lumpur, MalaysiaNo salary listedIn-person

About the Job

Requirements

  • Candidates should have hands-on experience in one or more areas of modern Data Engineering and Data & AI transformation.
  • Candidates should have experience with Databricks, Python, SQL, Apache Spark and/or PySpark, ETL/ELT and data pipeline development, data modelling and transformation, data lake/lakehouse architecture, and cloud-based data platforms.
  • Relevant Databricks experience may include development using the Databricks Lakehouse Platform; building and managing Databricks data pipelines; Delta Lake; Unity Catalog; Databricks notebooks and workflows; data governance and access management; performance optimisation; batch and/or streaming data processing; and integration of Databricks with enterprise data ecosystems.
  • A bachelor's degree in Computer Science, Information Technology, Engineering, Data Science or another relevant discipline is required.

Responsibilities

  • Design, develop and implement scalable data solutions using the Databricks Lakehouse Platform.
  • Build and optimise ETL/ELT pipelines for large-scale data processing and transformation.
  • Develop data engineering solutions using Python, SQL, Apache Spark and/or PySpark.
  • Design and implement modern data lake, lakehouse and cloud data warehouse architectures.
  • Work with Delta Lake for reliable and scalable data storage and processing.
  • Support enterprise data governance, access management and data discovery using technologies such as Unity Catalog.
  • Integrate Databricks with cloud platforms such as Microsoft Azure, AWS or Google Cloud Platform.
  • Support organisations in modernising legacy data platforms and migrating data workloads to cloud-based architectures.
  • Design data models and transformation processes that enable analytics, reporting, machine learning and AI use cases.
  • Assess existing client data environments and recommend target-state architectures and transformation roadmaps.
  • Translate business and technical requirements into scalable data solutions.
  • Work with business stakeholders, architects, engineers and delivery teams throughout the solution lifecycle.
  • Participate in client workshops, technical discussions, solution design sessions and architecture reviews.
  • Identify and resolve complex data and technology challenges.
  • Contribute to proposals, solution development, proof-of-concepts and client presentations.
  • Support the development of reusable Data & AI assets, accelerators and best practices.
  • Where applicable, contribute to Machine Learning, Generative AI and AI-driven workloads running on Databricks.

Desired Qualifications

  • Experience with related cloud data services, data lakes, data warehouses and integration technologies is an advantage.
  • Relevant Databricks certifications are an advantage.
  • Cloud certifications across Microsoft Azure, AWS or Google Cloud Platform are an advantage.
  • Certifications related to Data Engineering, Data Architecture or Data Management are advantageous.

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs