Data Engineer
Tavily
Data Engineer
Tavily
Search API for LLMs and RAG
Tavily is a cutting-edge company focused on providing a powerful and efficient Search API. We empower developers and businesses by delivering high-quality, relevant search results quickly and reliably. Join our team to help build the data infrastructure that supports and scales our core product.
We are seeking a highly motivated and experienced Data Engineer to join our growing team. You will be responsible for designing, constructing, installing, testing, and maintaining highly scalable data management systems. You will work closely with our engineering and devops teams to build and optimize the data pipelines that are crucial to the performance and accuracy of our Search API.
Design, build, and maintain efficient and reliable ETL/ELT pipelines for data warehousing.
Develop and improve our data infrastructure.
Ensure data quality, integrity, and security across all data platforms.
Optimize data systems for performance and scalability.
Troubleshoot and resolve issues related to data pipelines and data infrastructure.
Collaborate with cross-functional teams to understand data needs and deliver solutions.
A degree in Computer Science, Statistics, Engineering, or a related quantitative field.
3+ years of professional experience as a Data Engineer or in a similar role focused on data infrastructure.
Proficiency in Python.
Solid experience with relational databases (SQL) and NoSQL databases.
Experience with AWS and their data services.
Proven experience in building and optimizing data pipelines and data architectures.
Experience with Mongo/Snowflake/Redis/S3 General/S3 Express.
Experience with big data technologies
Experience with Airflow.
Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes).
Experience working in a company focused on API services or search technology.
Knowledge of data governance and data security best practices.
Tavily provides a search API for large language models (LLMs) and Retrieval-Augmented Generation (RAG) to access up-to-date, verifiable information. Its API returns optimized, contextually relevant results from multiple online sources, helping AI agents research and answer questions while reducing hallucinations, and it scales via a usage-based pricing model with a free tier. It stands out by pairing a commercial API with an open-source project (GPT Researcher) to showcase capabilities and build adoption, while prioritizing real-time data over general web search. Its goal is to become a core tool for AI development by delivering reliable external knowledge and scalable, verifiable data access for developers building AI agents and applications.
Explore more opportunities at Tavily