Simplify Logo

Full-Time

Databricks Platform Engineer

Mlops

Updated on 7/23/2024

Guidepoint

Guidepoint

1,001-5,000 employees

Provides on-demand intelligence and research platform

Consulting
Enterprise Software
Fintech

Mid, Senior

Toronto, ON, Canada

Category
DevOps & Infrastructure
Cloud Engineering
Required Skills
Microsoft Azure
Apache Spark
Development Operations (DevOps)
Requirements
  • Bachelor’s Degree
  • 2+ years of relevant experience on Databricks
  • Experience in cloud solutions, preferably on Azure
  • Skills in MLFlow, containerization, and deployment practices
Responsibilities
  • Design and implement cloud solutions, build MLOps on cloud (Azure and Databricks)
  • Build CI/CD pipelines orchestration using tools such as Azure DevOps
  • Proficiently use MLFlow and handle model serving and monitoring on Databricks
  • Test, validate, and automate tests for ML models
  • Tune Databricks for spark cluster performance and utilization optimization
  • Provide infrastructure guidance on Databricks capabilities to accommodate business/technical use cases
  • Automate and manage provisioning needs, including Databricks Cluster Policies, Unity Catalog, Secrets Management, Role-Based Access Control model, and permissions
  • Monitor and manage data and processes to control costs and optimize compute spend
  • Configure and manage monitoring/alerting around latency performance on the Databricks platform, including Delta Live Tables and Databricks Workflows and machine learning model performance
  • Coordinate and collaborate with dependent infrastructure teams and Azure services to integrate Databricks securely
  • Provide technical expertise and troubleshooting as well as support for change management, governance, compliance, internal audits, and remediations
  • Communicate with a team of data scientists, ML engineers, data engineers, and architects, and document the processes

Guidepoint is ideally positioned as a leading research enablement platform that enhances decision-making with its innovative technology and comprehensive real-time data. The company boasts a vast network of nearly 1.5 million experts, which significantly benefits employees by fostering a knowledge-rich environment and promoting continuous learning. This unique setup not only facilitates extensive professional growth but also ensures that team members are at the forefront of market trends and insights.

Company Stage

N/A

Total Funding

N/A

Headquarters

New York City, New York

Founded

2003

Growth & Insights
Headcount

6 month growth

0%

1 year growth

0%

2 year growth

0%

Benefits

Competitive salary.

Medical, Dental, and Vision Insurance.

401(k) with company matching.

Life Insurance (100% Employer Sponsored)

Paid vacation plus 10 legal holidays.

Light snacks and beverages.

Discounted gym memberships.

Commuter Benefits.