Full-Time
Senior Research Engineer
Applied Research
Confirmed live in the last 24 hours
Luma AI
51-200 employees
Develops multimodal AI technologies for creativity
Compensation Overview
$175k - $300kAnnually
Senior, Expert
Palo Alto, CA, USA
- Strong generalist Python skills including significant experience with PyTorch
- Recent experience in, and understanding of, visual AI, including diffusion models and transformers (note: can be from professional work, academic research experience, or hobby work with open source models like Stable Diffusion)
- Passion for experimenting with multi-modal generative AI, including familiarity with recent research work and ideas for implementing research into usable products.
- Implement cutting-edge generative AI features for inclusion in our product
- Work with Research and Product to fine-tune models, including dataset creation, model fine-tuning and evaluation
- Build tools & methods for evaluating our models and identify & implement solutions
- Train and run ML classifiers & embeddings to categorize by data quality and other attributes
- Good to have experience with cluster orchestration tools like SLURM
- Good to have experience with high performance large scale ML systems (>100 GPUs)
Luma AI develops multimodal artificial intelligence technologies that enhance human creativity and capabilities. Their main product, the Dream Machine, allows users to interact with various types of data and media, making it easier for creative professionals, businesses, and developers to explore innovative applications. Unlike many competitors, Luma AI focuses on integrating multiple modes of interaction, which helps users to expand their imaginative potential. The company operates on a subscription model, providing access to its AI tools and services, and aims to lead the way in AI-driven creativity and productivity.
Company Size
51-200
Company Stage
Late Stage VC
Total Funding
$84.9M
Headquarters
San Francisco, California
Founded
2021
Simplify's Take
What believers are saying
- Luma AI raised $90 million to accelerate AI model development.
- Growing demand for AI in gaming and VR benefits Luma AI's 3D capabilities.
- Collaboration with film studios offers new opportunities for AI-generated content.
What critics are saying
- Competition from Google and OpenAI may overshadow Luma AI's offerings.
- High demand for Ray2 model causes delays, risking user frustration.
- Subscription model vulnerable to economic downturns affecting revenue.
What makes Luma AI unique
- Luma AI transforms text into 3D models, enhancing mixed-reality experiences.
- The Dream Machine integrates multimodal AI for creative professionals and developers.
- Luma AI's Ray2 model offers fast, natural motion in video generation.
Help us improve and share your feedback! Did you find this helpful?
Benefits
Company Equity
Stock Options
Growth & Insights and Company News
6 month growth
↑ 0%1 year growth
↓ -3%2 year growth
↑ 6%Luma Labs launches new AI video model with improved motion and physics.
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More. Luma AI made waves with the launch of its Dream Machine generative AI video creation platform last summer.Of course, while that was only seven short months ago, the AI video space has advanced rapidly with the release of many new AI video creation models from rival startups in the U.S. and China, including Runway, Kling, Pika 2.0, OpenAI’s Sora, Google’s Veo 2, MiniMax’s Hailuo and open source alternatives such as Hotshot and Genmo’s Mochi 1, to name but a few. Even Luma itself recently updated its Dream Machine platform to include new still image generation and brainstorming boards, and also debuted an iOS app.But the updates continue: Today, the San Francisco-based startup released Ray2, its newest video AI generation model, available now through its Dream Machine website and mobile apps for paying subscribers (to start).The model offers “fast, natural coherent motion and physics,” according co-founder and CEO Amit Jain says on his X account, and was trained with 10 times more compute than the original Luma AI video model, Ray1.“This skyrockets the success rate of usable production-ready generations and makes video storytelling accessible to a lot more people,” he added.Luma’s Dream Machine web platform offers a free tier with 720 pixel generations capped at a variable number each month: Paid plans begin at $6.99 per month: From “Lite,” which offers 1080p visuals, to Plus ($20.99/month), to Unlimited ($66.49/month) and Enterprise ($1,672.92/year).A leap forward in video genRight now, Ray2 is limited to tex-to-video, allowing users to type in descriptions that are transformed into 5 or 10 second video clips. The model can generate new videos in a matter of seconds, although right now it can take minutes at a time due to a crush of demand from new users.Examples shared by Luma and early testers in its Creators program showcase the model’s versatility, including a man running through an Antarctic snowstorm surrounded by explosions, and a ballerina performing on an ice floe in the Arctic.Impressively, all the motions in the example videos appear lifelike and fluid — and often, with subjects moving much faster and more naturally than videos from rival AI generators, which often appear to generate in slow motion.The model can even create realistic versions of surreal ideas such as a giraffe surfing, as X user @JeffSynthesized demonstrated
「Veo 2」Image credit: Google. Google は、より写実的な映像を生成すると主張する、動画生成モデルの最新バージョン「Veo 2」で、OpenAI の「Sora」に対抗している。. 同社は、画像生成モデル Imagen 3 も更新し、より豊かで詳細な写真を作成するようにした。
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More. Google is going head to head against OpenAI’s Sora with the newest version of its video generation model, Veo 2, which it says makes more realistic-looking videos.The company also updated its image generation model Imagen 3 to produce richer, more detailed photos. Google said Veo 2 has “a better understanding of real-world physics and the nuances of human movement and expression.” It is available on Google Labs’ VideoFX platform — but only on a waitlisted basis. Users will need to sign up through a Google Form and wait for access to be granted provisionally by Google at a time of its choosing.“Veo 2 also understands the language of cinematography: Ask it for a genre, specify a lens, suggest cinematic effects and Veo 2 will deliver — at resolutions up to 4K,” Google said in a blog post. Video generated with Veo 2While Veo 2 is available only to select users, the original Veo remains available on Vertex AI. Videos created with Veo 2 will contain Google’s metadata watermark SynthID to identify these as AI-generated. Google admits, though, that Veo 2 may still hallucinate extra fingers and the like, but it promises the new model produces fewer hallucinations. Veo 2 will compete against OpenAI’s recently released Sora video generation model to attract filmmakers and content creators. Sora had been in previews for a while before OpenAI made it available to paying subscribers. Impressively, Google says that on its own internal tests gauging “overall preference” (i.e
OpenAI has officially released Sora Turbo, its artificial intelligence (AI)-powered text-to-video generation software, marking a new milestone in the landscape of AI content creation. The launch comes nearly ten months after the technology was first unveiled to the public in February 2024. The latest version of Sora, announced Monday (Dec. 9) is now accessible through sora.com to subscribers of ChatGPT Plus and Pro plans, with availability extending to most countries outside the European Union and the United Kingdom. The announcement is part of the company’s “12 Days of OpenAI” holiday series