P

Protiviti

Global consulting on risk, IT, audits

Databricks Solutions Architect Associate Director

Data EngineeringConfirmed live in the last 24 hours
Full-timeHybrid

About the Job

Requirements

  • Bachelor’s degree in a relevant discipline, such as Management Information Systems, Computer Information Systems, or Analytics.
  • At least 9 years of experience working in professional services or a related industry.
  • Professional certification is required, specifically Databricks Certified Data Engineer Professional or Databricks Certified Machine Learning Professional.
  • Experience articulating the value of Databricks capabilities and using data storytelling to guide decision-making.
  • Experience formulating, communicating, and executing data strategies aligned with organizational goals using Databricks and relevant technologies.
  • Experience assessing existing on-premises or cloud data solutions to inform improvement initiatives.
  • Advanced skills architecting future-state data solutions using Well-Architected Frameworks aligned to Databricks.
  • Experience planning and migrating data solutions from on-premises, other cloud platforms, or legacy systems to Databricks.
  • Proficiency implementing ETL processes and databases using Databricks or complementary solutions.
  • Significant experience optimizing data implementations, including pipelines, queries, and data models.
  • Knowledge of administering and maintaining data solutions for stability, security, scalability, and affordability.
  • High proficiency in data engineering, including data movement, integration, transformation, and cleansing.
  • Ability to lead the design, management, and optimization of data warehousing and modern data platforms.
  • Strong data modeling skills, including entity-relationship, dimensional, and semantic modeling.
  • Ability to perform data analytics, including exploratory data analysis and deriving actionable insights.
  • Experience implementing data governance frameworks and policies, including managing data assets with Unity Catalog.
  • Understanding of data security practices, including encryption and access control.
  • Knowledge of networking as it applies to configuring Databricks on-premises or in cloud solutions.
  • Understanding of DevOps or DataOps concepts and experience deploying Databricks solutions.
  • Expertise in SQL and Spark, including PySpark and Spark SQL.
  • Competency in at least three and exposure to most of the listed technologies: Databricks Lakehouse architecture and medallion design patterns; Unity Catalog governance, lineage, access controls, and data sharing; Apache Spark development using PySpark, Spark SQL, and Delta Lake; data engineering with Auto Loader, Lakeflow Declarative Pipelines, and workflow orchestration; Databricks Asset Bundles, Git integration, CI/CD, and environment promotion; Databricks SQL, serverless compute, query optimization, and performance tuning.
  • Ability to establish and cultivate business relationships and a professional network, including with senior executives.
  • Ability to pursue business development opportunities and identify and implement strategies to obtain new work or clientele.
  • Ability to translate and communicate issues, risks, or challenges to client personnel, including executives.
  • Direct supervisory experience leading teams, including conducting performance appraisals, mentoring and coaching, reviewing work, coordinating across teams, and motivating team members.
  • Successful completion of a background check is required as a condition of employment.

Responsibilities

  • Lead client relationships and guide the successful completion of engagements.
  • Partner with strategic clients to manage risks associated with their use of technology.
  • Develop strategies and solutions to address complex business problems using analytics, automation, and current tools and methods.
  • Develop new projects, identify new business, and build lasting client and community relationships while representing Protiviti in the market.
  • Mentor and support team growth and development while overseeing successful completion of project work plans.
  • Create development opportunities for team members, including participating in training creation and rollout and identifying ways for the team to improve client and community outcomes.
  • Identify opportunities to integrate product solutions and resources to improve client service capabilities.
  • Translate client challenges into new project proposals and sales.
  • Contribute to thought leadership and encourage knowledge-sharing and collaboration across teams.
  • Manage a diverse portfolio of clients across industries.
  • Create a collaborative team environment where members feel valued, welcomed, and able to contribute ideas.
  • Deliver best-in-class solutions and manage deliverables.
  • Design and deliver modern data engineering solutions with Databricks.

Desired Qualifications

  • Databricks Champion certification.
  • Familiarity with programming languages such as C#, Java, Scala, R, DAX, MDX, or M.
  • Experience with data science or machine learning.
  • Familiarity with Mosaic AI, MLflow, model serving, or generative AI capabilities.

About the Company

Protiviti

Global consulting on risk, IT, audits

Protiviti is a global consulting firm that helps large organizations tackle risk, compliance, technology, and process challenges. It delivers tailored engagements—often long-term partnerships—drawing on experts in risk and compliance, IT consulting, internal audit, and business process improvement, including legal advisory. In technology, Protiviti assists with digital transformation, cybersecurity, and data analytics; in risk and compliance, it helps manage regulatory requirements and internal controls. Its goal is to help clients strengthen governance, reduce risk, optimize operations, and improve performance across industries, including many Fortune 1000 and Global 500 companies.

Company size
10,001+
Company stage
Not listed
Total funding
Not listed
Headquarters
Menlo Park, CA
Founded
2002

Recently Posted Jobs

Explore more opportunities at Protiviti

See more jobs