Postdoctoral: Edge Vision Language Models and Foundation Models

Job Details

New ideas are all around us, but only a few will change the world. That’s our focus at JPL. We ask the biggest questions, then search the universe for answers—literally. We build upon ideas that have guided generations, then share our discoveries to inspire generations to come. Your mission—your opportunity—is to seek out the answers that bring us one step closer. If you’re driven to discover, create, and inspire something that lasts a lifetime and beyond, you’re ready for JPL.

Located in Pasadena, California, JPL has a campus-like environment situated on 177 acres in the foothills of the San Gabriel Mountains and offers a work environment unlike any other: we inspire passion, foster innovation, build collaboration, and reward excellence.

New ideas are all around us, but only a few will change the world. That’s our focus at JPL. We ask the biggest questions, then search the universe for answers—literally. We build upon ideas that have guided generations, then share our discoveries to inspire generations to come. Your mission—your opportunity—is to seek out the answers that bring us one step closer. If you’re driven to discover, create, and inspire something that lasts a lifetime and beyond, you’re ready for JPL.

Located in Pasadena, California, JPL has a campus-like environment situated on 177 acres in the foothills of the San Gabriel Mountains and offers a work environment unlike any other: we inspire passion, foster innovation, build collaboration, and reward excellence.

We are recruiting a Postdoctoral scholar to conduct research in edge Vision Language Models and Foundation models. The successful candidate will play a key role in advancing the deployment and capabilities of state-of-the-art AI on edge devices. See more information at https://ai.jpl.nasa.gov

Responsibilities

* Conduct research in edge Vision Language Models (VLMs) and Foundation models.

* Deploy complex foundation models to embedded platforms (e.g., Nvidia NX, AGX, and others).

* Fine-tune foundation models using techniques such as LoRA (Low-Rank Adaptation) and SFT (Supervised Fine-Tuning).

* Develop and integrate multiple vision heads for tasks including segmentation, object recognition (e.g., YOLO), and open vocabulary object detection.

* Design, implement, and run evaluation and benchmark pipelines, including LLM-driven evaluation methodologies.

* Publish research results in peer-reviewed journals and present results at scientific conferences.

**Required Qualifications**

* Ph.D. in Computer Science, Artificial Intelligence, Computer Vision, Robotics, or a closely related field.

* Research expertise in one or more of the following: Vision Language Models, Foundation models, or embedded AI.

* Experience deploying AI algorithms and models to embedded platforms (e.g., Nvidia NX, AGX).

* Hands-on experience with fine-tuning techniques (LoRA, SFT) and working with multiple vision heads (segmentation, YOLO, open vocabulary object detection).

* Experience with evaluation and benchmark pipelines, specifically involving LLM-driven evaluation.

* Demonstrated record of peer-reviewed scientific publications.

The appointee will carry out research in collaboration with JPL advisor, resulting in publications in the open literature. Applicants may be subject to additional program requirements by NASA. Postdoc positions are awarded for a minimum of one-year period and may be renewed up to a maximum of three years. Candidates should submit the following to this site: CV, representative publications, contact information for three references, and a cover letter stating their research accomplishments and interests.

JPL has a catalog of benefits and perks that span from the traditional to the unique. This includes a variety of health, dental, vision, wellbeing, and retirement plans, paid time off, learning, rideshare, childcare, flexible schedule, parental leave and many more. Our focus is on work-life balance, and living healthy, fulfilling lives as we Dare Mighty Things Together. For benefits eligible positions, benefits are effective the first day of the month coincident with or immediately following the employee’s start date.

For further benefits information click Benefits and Perks

The hiring range displayed below is specifically for those who will work in or reside in the location listed. In extending an offer, Jet Propulsion Laboratory considers factors including, but not limited to, the candidate’s job related skills, experience, knowledge, and relevant education/training.

The typical full time equivalent annual hiring range for this job in Pasadena, California.

$83,820 - $83,820

JPL is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to sex, race, color, religion, national origin, citizenship, ancestry, age, marital status, physical or mental disability, medical condition, genetic information, pregnancy or perceived pregnancy, gender, gender identity, gender expression, sexual orientation, protected military or veteran status or any other characteristic or condition protected by Federal, state or local law.

In addition, JPL is a VEVRAA Federal Contractor.

EEO is the Law.

EEO is the Law Supplement

Pay Transparency Nondiscrimination Provision

The Jet Propulsion Laboratory is a federal facility. Due to rules imposed by NASA, JPL will not accept applications from citizens of designated countries or those born in a designated country unless they are U.S. Citizens, Legal Permanent Residents of the U.S or have other protected status under 8 U.S.C. 1324b(a)(3). The Designated Countries List is available here.