Simplify Logo

Full-Time

Prompt Engineering Fellow

Posted on 7/18/2024

Khan Academy

Khan Academy

501-1,000 employees

Provides free online educational resources

Social Impact
Education

Compensation Overview

$98k - $120kAnnually

+ Incentives + Benefits

Junior, Mid

Mountain View, CA, USA

Category
Natural Language Processing (NLP)
AI & Machine Learning
Required Skills
Python
Data Structures & Algorithms
Natural Language Processing (NLP)
Data Analysis
Requirements
  • Technical Proficiency: You have 2+ years of experience utilizing relevant programming languages (such as Python) to build software solutions, and you are familiar with tools relevant to emerging best practices in generative AI implementation.
  • Prompt design and evaluation: You understand what generative AI models are good at and how to elicit the best performance from them. You have an engineer’s knack for structured, analytical thought, and you’re detail-oriented with high standards for quality. You understand techniques—including chaining, RAG, agents, and fine-tuning—for guiding generative AI outputs in service of a robust and performant enterprise product.
  • Testing and quality assurance: You’re committed to a careful, iterative, data-driven approach for optimization, innovation, and continuous experimentation. You have experience developing evaluation data sets for benchmarking model fit and prompt performance. You have a solid understanding of classrooms and learning science and/or an eagerness to learn.
  • Data Analysis: You know how to analyze interaction data, both programmatically and manually, to identify actionable insights to optimize the user experience.
  • Strategic thinking: You have experience using data to inform strategic decisions.
  • Research: You keep informed about developments in AI, and take an active interest in emerging research and industry trends, and you understand their implications for our product’s competitiveness and performance.
  • Communication: Your strong communication skills help you collaborate effectively with cross-functional teams, including educators, developers, and designers. You can teach technical concepts and create high quality documentation.
  • Collaboration: You have a history of working cross-functionally to achieve shared success in organization-wide goals and projects.
  • Growth mindset: You’re adaptable to a fast-paced environment, and open to learning new tools and tech.
  • Ethical Considerations and Bias Mitigation: You’re aware of ethical considerations in AI and machine learning, especially in an educational context, and are familiar with strategies for mitigating bias.
  • Bachelor’s degree, with a concentration in Computer Science or learning science preferred; Master’s degree preferred.
  • 2-3 years of relevant or transferrable experience (for example: software engineering, MLops, machine translation, other development of AI-powered experiences through feedback, testing, and data)
  • 1+ years instructional design experience, combining disciplinary expertise, pedagogical research, and teacher and learner empathy
  • Proficiency in logic, control flows, data structures, and algorithms.
  • A solid grasp of AI, machine learning, and natural language processing concepts.
  • A high level familiarity with the architecture and operation of large language models, and a clear and nuanced understanding of their capabilities and limitations.
  • A motivation for Khan Academy's mission 'to provide a free world-class education for anyone, anywhere.'
Responsibilities
  • Discover, develop, test, and document best practices for prompt development and evaluation.
  • Work with User Research and Product Management to prioritize and implement high impact prompt engineering projects.
  • Collaborate with designers, product managers, and engineers to create prompt-driven features that support education use cases.

Khan Academy offers free online educational resources and courses for students of all ages. The platform provides instructional videos, practice exercises, and a personalized learning dashboard that allows users to learn at their own pace. Students can access a wide range of subjects, including math, science, history, and more, making it a comprehensive learning tool. Unlike traditional educational institutions, Khan Academy focuses on accessibility, allowing anyone with an internet connection to benefit from its resources. The goal of Khan Academy is to democratize education and ensure that high-quality learning materials are available to everyone, regardless of their background or location.

Company Stage

Series A

Total Funding

$23.4M

Headquarters

Palo Alto, California

Founded

2006

Growth & Insights
Headcount

6 month growth

36%

1 year growth

0%

2 year growth

36%
Simplify Jobs

Simplify's Take

What believers are saying

  • The collaboration with Microsoft and the introduction of Khanmigo can significantly enhance the teaching and learning experience, making it more efficient and engaging.
  • Khan Academy's continuous innovation, such as the new essay feedback feature and text-to-speech technology, demonstrates its commitment to improving educational tools.
  • Partnerships with companies like Intuit to offer free financial education resources expand Khan Academy's impact and resource offerings.

What critics are saying

  • Reliance on partnerships with large corporations like Microsoft could pose a risk if these partnerships were to end or change terms.
  • The rapid integration of advanced technologies like GPT-4 may face resistance from educators and institutions not ready to adopt such tools.

What makes Khan Academy unique

  • Khan Academy's partnership with Microsoft to offer the AI tutor Khanmigo for free to K-12 educators sets it apart from other educational platforms that charge for similar services.
  • The integration of GPT-4 technology in Khanmigo provides a cutting-edge, interactive learning experience that is not commonly found in other free educational resources.
  • Khan Academy's non-profit status and mission to provide free, world-class education globally differentiates it from for-profit competitors.

Benefits

Competitive salaries

Health and wellness benefits

Flexible time off

401(k) + matching

Affinity groups

Paid parental leave

Fun virtual events

INACTIVE