A

Accenture

Advises businesses and runs their technology

Data Architect

Data EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listed

About the Job

Requirements

  • At least 7.5 years of experience with the Databricks Unified Data Analytics Platform.
  • Have 15 years of full-time education.
  • Have strong programming and debugging skills in Python.
  • Have hands-on experience with PySpark to build data transformation and validation logic.
  • Be proficient in at least one cloud platform: AWS, GCP, or Azure.
  • Have experience with cloud-based services relevant to data engineering, data storage, data processing, data warehousing, real-time streaming, and serverless computing.
  • Have hands-on experience applying performance optimization techniques.
  • Understand data modeling and data warehousing principles.

Responsibilities

  • Define data requirements and structure for applications, and model and design application data structures, storage, and integration.
  • Develop scalable ETL/ELT pipelines using Databricks technologies, including Delta Lake, Auto Loader, and DLT.
  • Create modular Databricks functions for transformation, personally identifiable information masking, and validation logic reusable across DLT and notebook pipelines.
  • Implement ingestion patterns using Auto Loader with checkpointing and schema evolution for structured and semi-structured data.
  • Build secure and observable DLT pipelines with DLT Expectations, supporting Bronze/Silver/Gold medallion layering.
  • Configure Unity Catalog by setting up catalogs and schemas, managing user and group access, enabling audit logging, and defining masking for personally identifiable information fields.
  • Enable secure data access across domains and workspaces through Unity Catalog External Locations, Volumes, and lineage tracking.
  • Access and use data assets from the Databricks Marketplace to support enrichment, model training, or benchmarking.
  • Collaborate with data-sharing stakeholders to implement Delta Sharing internally and externally.
  • Integrate Power BI, Tableau, or Looker with Databricks using optimized ODBC/JDBC connectors and Unity Catalog security controls.
  • Build stakeholder-facing SQL dashboards within Databricks to monitor key performance indicators, data-pipeline health, and operational service-level agreements.
  • Prepare generative AI-compatible datasets by managing vector embeddings, indexing with Databricks Vector Search, and using Feature Store with MLflow.
  • Package and deploy pipelines using Databricks Asset Bundles through CI/CD pipelines in GitHub or GitLab.
  • Troubleshoot, tune, and optimize jobs using the Photon engine and serverless compute to ensure cost efficiency and service-level agreement reliability.
  • Collaborate with various teams to ensure the data architecture is robust, scalable, and efficient, address development challenges, and align data architecture with business objectives and technical specifications.

Desired Qualifications

  • Databricks Certified Professional certification or a similar certification.
  • Knowledge of machine-learning concepts and experience with popular machine-learning libraries.
  • Knowledge of big-data processing technologies such as Spark, Hadoop, Hive, or Kafka.
  • Experience with Apache Airflow for data orchestration.
  • Knowledge of CI/CD pipelines and DevOps practices in a cloud environment.
  • Experience with ETL tools such as Informatica, Talend, Matillion, or Fivetran.
  • Familiarity with dbt (Data Build Tool).

About the Company

Accenture

Advises businesses and runs their technology

Accenture advises large businesses and public agencies on strategy, builds their technology systems and runs ongoing operations. Its teams connect business planning with implementation, covering areas such as cloud migration, cybersecurity and customer experience. Consultants work with clients to redesign processes, while engineers integrate software from technology partners and maintain the resulting systems for multinational organizations. Clients pay for project work or continuing services, including application support and business processes such as finance and customer service. Accenture was founded in 1989 and has its headquarters in Dublin, Ireland.

Company size
10,001+
Company stage
IPO
Headquarters
Dublin, Ireland
Founded
1989

Recently Posted Jobs

Explore more opportunities at Accenture

See more jobs