Full-Time

Data Engineer

Institute of Foundation Models

Institute of Foundation Models

Researches and develops foundation models

No salary listed

Sunnyvale, CA, USA

In Person

Bachelor's, Master's, PhD

Category
Data & Analytics (1)
Required Skills
Kubernetes
Python
Apache Spark
SQL
Apache Kafka
Data Engineering
AWS
REST APIs
Data Analysis

Get referred to Institute of Foundation Models

See people who can refer or advise you

Requirements
  • Bachelor's degree in Computer Science, Data Science, Engineering, or a related technical field required.
  • Extensive experience in data engineering, data processing, and automation using Python.
  • Demonstrated proficiency in designing and deploying web crawling solutions, automated data extraction, and processing pipelines.
  • Strong understanding of data structures, algorithms, databases, SQL, and performance optimization.
  • Experience working with cloud infrastructure and distributed data processing frameworks (e.g., Amazon Web Services, Apache Spark, Apache Kafka, Kubernetes).
  • Excellent problem-solving abilities, attention to detail, and the capability to rapidly address technical challenges.
  • Strong communication and collaboration skills with cross-functional teams.
Responsibilities
  • Rapidly collect, curate, and preprocess datasets based on detailed specifications provided by NLPresearchers, delivering data within tight timelines.
  • Develop and maintain efficient web crawling solutions, APIs, and automated workflows to continuously improve data collection processes.
  • Refine and evaluate outputs from Large Language Models (LLMs) to generate structured datasets suitable for model training and benchmarking.
  • Implement scalable data pipelines, ensuring efficient data processing, storage, retrieval, and distribution to research teams.
  • Collaborate closely with researchers and engineers to ensure collected data meets specified quality and relevance criteria.
  • Document data collection methodologies, dataset characteristics, and pipeline architecture clearly and effectively.
  • Engage with peer teams and participate in technical reviews to uphold best practices and data quality standards.
  • Represent MBZUAI at industry and research forums, showcasing technical capabilities in large-scale data processing and AI data infrastructure.
Desired Qualifications
  • Master’s degree or PhD degree or equivalent experience in Computer Science, Data Engineering, or related technical fields preferred.
  • Proven track record of supporting NLP or AI research teams with rapid and reliable data delivery.
  • Experience working with large language models, including evaluation, efficient inference, and prompt engineering.
  • Experience with refining outputs from large-scale AI models, such as LLM-generated data.
  • Contributions to open-source projects, coding competitions, or high visibility in coding communities (e.g., GitHub, Stack Overflow).
  • Familiarity with the latest advancements in NLP data processing and large language model technologies.
  • Visa sponsorship eligibility when applicable.
Institute of Foundation Models

Institute of Foundation Models

View

IFM builds and studies foundation models—large AI models designed to learn broadly from diverse data and be used across many tasks. Its work centers on academic research to create open, fast, and practical models that address real-world societal needs, rather than narrow applications. The models are developed by a global team across Abu Dhabi, Paris, and Silicon Valley, with a strong emphasis on openness and collaboration to advance AI science and accessibility. Unlike typical private labs that lock models behind paywalls, IFM aims to provide publicly accessible, efficient models that can be used by researchers and developers to solve real problems. The overarching goal is to push the science of foundation models forward while ensuring their benefits reach society at large.

Company Size

N/A

Company Stage

N/A

Total Funding

N/A

Headquarters

United Arab Emirates

Founded

N/A

Get referred to Institute of Foundation Models

See people who can refer or advise you

Simplify Jobs

Simplify's Take

What believers are saying

  • K2-V2 launched January 2026 as the UAE's first fully sovereign base model.
  • K2 Think V2 launched January 2026 on K2-V2, validating IFM's stack.
  • ICML 2026 booth recruiting signals active demand for researchers and engineers.

What critics are saying

  • OpenAI, Google, and Anthropic outspend IFM, compressing its talent-retention window.
  • K2-V2 depends on MBZUAI and UAE state priorities; policy shifts threaten funding.
  • If sovereign-model demand stalls, IFM becomes an academic lab without durable commercial leverage.

What makes Institute of Foundation Models unique

  • MBZUAI's IFM ships fully open K2-V2 with weights, data, and recipes.
  • Richard Morton says IFM is a sovereign AI factory for UAE systems.
  • Teams in Abu Dhabi, Paris, and Sunnyvale span research, engineering, and applied science.

Help us improve and share your feedback! Did you find this helpful?

Benefits

Health Insurance

Dental Insurance

Vision Insurance

Paid Vacation

Paid Holidays

Parental Leave

Employee Assistance Program

Life Insurance

Disability Insurance

401(k) Plan

Wellness Program

Flexible Work Hours

Remote Work Options

Hybrid Work Options

Stock Options

Company Equity