Full-Time

Lead Data Engineer (Databricks)

Rearc

Rearc

11-50 employees

Engineering services for GenAI, data, AWS

No salary listed

Remote in USA

Remote

Category
Data & Analytics (1)
Required Skills
Redshift
Airflow
BigQuery
Apache Spark
Apache Kafka
ETL
Data Engineering
Databricks
Requirements
  • 10+ years of experience in data engineering, data architecture, or related technical fields, with a proven ability to design, build, and optimize large-scale data ecosystems.
  • A strong track record of leading complex data engineering initiatives, architecting end-to-end data solutions that are scalable, reliable, and aligned with business strategy.
  • Deep hands-on expertise in ETL/ELT design, data warehousing, and data modeling, enabling the creation of efficient, high-quality data pipelines and analytical foundations.
  • Extensive experience with data integration frameworks and best practices, ensuring seamless, performant data movement across diverse systems and platforms.
  • Advanced knowledge of cloud-based data services and architectures, including platforms such as Amazon Web Services Redshift, Microsoft Azure Synapse Analytics, Google Cloud BigQuery, or equivalent technologies.
  • Strong strategic and analytical thinking, allowing you to tackle complex data challenges, drive architectural decisions, and influence long-term data strategy.
  • Proficiency with modern data engineering frameworks, including Databricks, Spark, and lakehouse technologies like Delta Lake for managing and processing large-scale datasets.
  • Exceptional communication and interpersonal skills, enabling effective collaboration with engineers, product teams, executives, and customers—while influencing technical direction and decision-making.
Responsibilities
  • Engage deeply with stakeholders to understand data needs, business challenges, and technical constraints, translating them into scalable, high-quality data solutions.
  • Implement with a DataOps mindset, applying modern engineering practices and leveraging tools such as Apache Airflow, Databricks/Spark, Kafka, or similar technologies to build reliable, automated, and efficient data pipelines and architectures.
  • Lead and execute complex projects, providing technical direction, setting engineering standards, and ensuring alignment with customer goals and Rearc’s principles.
  • Mentor and develop data engineers, offering guidance, code reviews, and hands-on support to help them grow technically and professionally.
  • Promote knowledge sharing and thought leadership by contributing to internal and external content—writing technical blogs, sharing best practices, and fostering a culture of continuous learning and innovation.

Rearc provides engineering-driven services to help enterprises accelerate GenAI, data platforms, and cloud development, with a focus on AWS as an Advanced Consulting Partner. Teams assess current data and AI goals and design and implement end-to-end AWS-based solutions, including data pipelines, GenAI tooling, MLOps, and security/compliance. It differentiates itself through deep engineering in the AWS ecosystem and a proven track record with regulated industries, offering bespoke, end-to-end services rather than off-the-shelf software. The goal is to enable enterprises to rapidly adopt scalable, secure GenAI and cloud platforms that drive measurable business outcomes while meeting regulatory constraints.

Company Size

11-50

Company Stage

N/A

Total Funding

N/A

Headquarters

New York City, New York

Founded

2016

Simplify Jobs

Simplify's Take

What believers are saying

  • Financial firms deploy proprietary LLMs, boosting MLOps demand to $15B by 2026.
  • Healthcare AI diagnostics scale under FDA 2024 guidance, needing compliance consulting.
  • Data mesh architectures standardize, requiring federated platform design services.

What critics are saying

  • AWS expands consulting, compressing Rearc margins within 6-12 months.
  • GenAI commoditization via Bedrock erodes bespoke premiums in 6-12 months.
  • Talent attrition to Accenture and Deloitte hits within 12-24 months.

What makes Rearc unique

  • Rearc specializes in bespoke LLM and MLOps for financial services enterprises.
  • Engineers from Wall Street Journal founding drive cloud-native expertise since 2016.
  • AWS Advanced Partner status enables specialized GenAI platform acceleration.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health Insurance

401(k) Retirement Plan

401(k) Company Match

Paid Vacation

Parental Leave

Professional Development Budget

Remote Work Options