D

Databricks

Builds cloud software for data analysis and AI

Staff Software Engineer Search Quality

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeBengaluru, Karnataka, IndiaNo salary listedIn-person

About the Job

Requirements

  • Experience with Lucene or Elasticsearch, embeddings, and ranking algorithms.
  • Understanding of relevance as a subjective measure and experience building evaluation frameworks, including human-in-the-loop and large language model-based evaluation.
  • Knowledge of relevance metrics, including nDCG, MRR, and Precision@K.
  • Interest in applying traditional Information Retrieval principles to Retrieval-Augmented Generation.

Responsibilities

  • Own the quality of search results for AI agents and human users.
  • Optimize retrieval that enables large language models to reason over data they were not trained on and access ground truth for accurate business actions.
  • Improve the traditional search experience so employees can find assets and answers through intuitive, high-recall interfaces.
  • Balance keyword-based search with semantic vector search.
  • Fine-tune ranking models for human readability and large language model-ready context.
  • Build guardrails and relevance scoring to improve accuracy and ground results in reality.
  • Connect structured SQL tables, unstructured documents, and real-time business metrics.

About the Company

Databricks

Builds cloud software for data analysis and AI

Databricks builds cloud software that businesses use to organize data, analyze it, and develop AI applications. Its lakehouse architecture brings the flexible storage of a data lake together with the querying and management tools of a data warehouse. Data engineers prepare and update datasets, analysts build reports, and developers train models or create applications in a shared workspace with controls over who can use the data. The platform runs on Amazon, Microsoft, and Google clouds, and customers pay for computing usage or commit to longer contracts for discounted rates. Databricks was founded in 2013 and is headquartered in San Francisco, California.

Company size
10,001+
Company stage
Late Stage VC
Total funding
$32.1B
Headquarters
San Francisco, CA
Founded
2013

Recently Posted Jobs

Explore more opportunities at Databricks

See more jobs