R

RevStar

Data & AI Engineer

Applied Machine LearningConfirmed live in the last 24 hours
Full-timeNo salary listed

About the Job

Requirements

  • Have at least 3 years of experience in cloud-native data engineering, including at least 2 years of dedicated hands-on experience with Databricks, Apache Spark, Delta Lake, and MLflow.
  • Have high proficiency in Python, SQL, Spark frameworks, continuous integration and continuous delivery, and Infrastructure as Code using Terraform or Databricks CLI.
  • Have a proven track record working in fast-paced Agile/DevOps consulting environments and delivering cloud-agnostic architectures.
  • Be able to communicate with clients effectively.

Responsibilities

  • Design, build, and optimize scalable extract, transform, and load/extract, load, and transform pipelines using Apache Spark and Delta Lake across multi-cloud environments, including AWS, Azure, and Google Cloud Platform.
  • Implement Lakehouse architectures that process structured and unstructured data at enterprise scale.
  • Automate data ingestion, storage, and feature engineering workflows to support downstream analytics and real-time AI workloads.
  • Tune Spark jobs for low latency, high throughput, and cloud cost-efficiency across client environments.
  • Partner with machine learning engineers and data scientists to operationalize AI models inside Databricks using MLflow for tracking, versioning, and deployment.
  • Implement continuous integration and continuous delivery pipelines and Infrastructure as Code using Terraform and Databricks CLI to establish automated, production-grade deployments.
  • Enforce enterprise data security, access controls, and compliance standards, including GDPR, HIPAA, and SOC 2, within Unity Catalog and cloud ecosystems.
  • Collaborate with client technology leaders, product managers, and engineering teams to translate AI data requirements into business outcomes.
  • Write technical documentation and lead solution handoffs to client engineering teams upon project completion.

Desired Qualifications

  • An active Databricks Certified Data Engineer (Associate or Professional) certification or Databricks Machine Learning Professional certification is strongly preferred.

About the Company

Company size
Not listed
Company stage
Not listed
Total funding
Not listed
Headquarters
Not listed
Founded
Not listed

Recently Posted Jobs

Explore more opportunities at RevStar

See more jobs