Simplify Logo

Full-Time

Big Data Solutions Architect

Updated on 9/7/2024

Databricks

Databricks

5,001-10,000 employees

Unified data, analytics, and AI platform

Data & Analytics
Consulting
Hardware
Industrial & Manufacturing
Consumer Software
Enterprise Software
AI & Machine Learning

Mid, Senior

London, UK

Category
Sales Engineering
Solution Engineering
Sales & Solution Engineering
Required Skills
Microsoft Azure
Python
Bootstrap
Apache Spark
AWS
Scala
Data Analysis
Google Cloud Platform
Requirements
  • Proficient in data engineering, data platforms, and analytics with a strong track record of successful projects and in-depth knowledge of industry best practices
  • Comfortable writing code in either Python or Scala
  • Working knowledge of two or more common Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one
  • Deep experience with distributed computing with Apache Spark™ and knowledge of Spark runtime internals
  • Familiarity with CI/CD for production deployments
  • Working knowledge of MLOps
  • Design and deployment of performant end-to-end data architectures
  • Experience with technical project delivery - managing scope and timelines.
  • Documentation and white-boarding skills.
  • Experience working with clients and managing conflicts.
  • Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects.
  • Travel to customers 30% of the time
  • Databricks Certification
Responsibilities
  • You will work on a variety of impactful customer technical projects which may include designing and building reference architectures, creating how-to's and productionalizing customer use cases
  • Work with engagement managers to scope variety of professional services work with input from the customer
  • Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications
  • Consult on architecture and design; bootstrap or implement customer projects which leads to a customers' successful understanding, evaluation and adoption of Databricks.
  • Provide an escalated level of support for customer operational issues.
  • You will work with the Databricks technical team, Project Manager, Architect and Customer team to ensure the technical components of the engagement are delivered to meet customer's needs.
  • Work with Engineering and Databricks Customer Support to provide product and implementation feedback and to guide rapid resolution for engagement specific product and support issues.

Databricks provides a Lakehouse Platform integrating data management, analytics, and AI capabilities across a range of industries. Employing tools like Delta Lake and Databricks SQL enhances operational efficiency and precision. As a workplace, it offers a collaborative and technology-driven environment, promoting growth through cutting-edge machine learning solutions and a commitment to leading the industry in data innovation. This makes it an inspiring place for tech professionals to advance their careers in a vibrant and forward-thinking setting.

Company Stage

Series I

Total Funding

$4.2B

Headquarters

San Francisco, California

Founded

2013

Growth & Insights
Headcount

6 month growth

7%

1 year growth

21%

2 year growth

79%
Simplify Jobs

Simplify's Take

What believers are saying

  • The $1 billion acquisition of Tabular is likely to enhance Databricks' data management capabilities and market reach.
  • The development and launch of the DBRX generative AI model, with a $10 million investment, underscores Databricks' dedication to leading in AI technology.
  • High-profile investments from figures like Nancy Pelosi indicate strong confidence in Databricks' growth potential.

What critics are saying

  • The integration of Tabular's team and technology could face challenges, potentially disrupting operations.
  • The competitive landscape in AI and data analytics is intense, with major players like Google and Microsoft posing significant threats.

What makes Databricks unique

  • Databricks' acquisition of Tabular, founded by the creators of Apache Iceberg, strengthens its position in the open lakehouse market.
  • The launch of DBRX, an open-source LLM that outperforms GPT-3.5 and Llama 2, showcases Databricks' commitment to cutting-edge AI innovation.
  • Strategic partnerships, such as with AVEVA for industrial AI, highlight Databricks' ability to integrate and enhance diverse technological ecosystems.

Benefits

Extended health care including dental and vision

Life/AD&D and disability coverage

Equity awards

Flexible Vacation

Gym reimbursement

Annual personal development fund

Work headphones reimbursement

Employee Assistance Program (EAP)

Business travel accident insurance

Paid Parental Leave