R

RevStar

Data & AI Engineer - Databricks Specialist

Full-Time
No salary listed
Mid
Remote in USA+1 moreMore locations: Florida, USA
RemoteMust be based in the US; Eastern or Central Time Zone preferred.
Data & AnalyticsData Engineering

About the job

Requirements
  • At least 3 years of experience in cloud-native data engineering.
  • At least 2 years of dedicated, hands-on experience with Databricks, Apache Spark, Delta Lake, and MLflow.
  • High proficiency in Python, SQL, Spark frameworks, continuous integration and continuous delivery, and Infrastructure-as-Code using Terraform or Databricks CLI.
  • A proven track record operating in fast-paced Agile/DevOps consulting environments.
  • Experience delivering cloud-agnostic architectures.
  • An active Databricks Certified Data Engineer Associate or Professional certification, or Databricks ML Professional certification, is preferred.
Responsibilities
  • Design, build, and optimize scalable ETL/ELT pipelines using Apache Spark and Delta Lake across AWS, Azure, and Google Cloud Platform environments.
  • Implement Lakehouse architectures that process structured and unstructured data at enterprise scale.
  • Automate data ingestion, storage, and feature engineering workflows for downstream analytics and real-time AI workloads.
  • Tune Spark jobs for low latency, high throughput, and cloud cost efficiency across client environments.
  • Partner with machine learning engineers and data scientists to operationalize AI models inside Databricks using MLflow for tracking, versioning, and deployment.
  • Implement continuous integration and continuous delivery pipelines and Infrastructure-as-Code with Terraform and Databricks CLI for automated, production-grade deployments.
  • Enforce enterprise data security, access controls, and compliance standards including GDPR, HIPAA, and SOC 2 within Unity Catalog and cloud ecosystems.
  • Collaborate with client technology leaders, product managers, and engineering teams to translate complex AI data requirements into business outcomes.
  • Author technical documentation and lead solution handoffs to client engineering teams upon project completion.
Desired Qualifications
  • An active Databricks Certified Data Engineer Associate or Professional certification, or Databricks ML Professional certification.
  • Experience operating in fast-paced Agile/DevOps consulting environments and delivering cloud-agnostic architectures with exceptional client communication.

About the company

Company Size

N/A

Company Stage

N/A

Total Funding

N/A

Headquarters

N/A

Founded

N/A