Decrypt’s Art, Fashion, and Entertainment Hub. Discover SCENEOpenAI's upcoming artificial intelligence model is delivering smaller performance gains than its predecessors, sources familiar with the matter told The Information.Employee testing reveals Orion achieved GPT-4 level performance after completing only 20% of its training, The Information reports.The quality increase from GPT-4 to the current version of GPT-5 seems to be smaller than that of GPT-3 to GPT-4.“Some researchers at the company believe Orion isn’t reliably better than its predecessor in handling certain tasks, according to the (OpenAI) employees,” The Information reported. “Orion performs better at language tasks but may not outperform previous models at tasks such as coding, according to an OpenAI employee.”While Orion getting closer to GPT-4 at 20% of its training might sound impressive to some, it is important to note that the early stages of AI training typically deliver the most dramatic improvements, with subsequent phases yielding smaller gains.So, the remaining 80% of training time isn’t likely to produce the same magnitude of advancement seen in previous generational leaps, sources said.The limitations emerge at a critical juncture for OpenAI following its recent $6.6 billion funding round.The company now faces heightened expectations from investors while grappling with technical constraints that challenge traditional scaling approaches in AI development. If these early versions don't meet expectations, the company’s upcoming fundraising efforts may not be met with the same hype as before—and that could be a problem for a potentially for-profit company, which is what Sam Altman seems to want for OpenAI.Underwhelming results point to a fundamental challenge facing the entire AI industry: the diminishing supply of high-quality training data and the need to remain relevant in a field as competitive as generative AI.Research published in June predicted that AI companies will exhaust available public human-generated text data between 2026 and 2032, marking a critical inflection point for traditional development approaches."Our findings indicate that current LLM development trends cannot be sustained through conventional data scaling alone," the research paper states, highlighting the need for alternative approaches to model improvement, including synthetic data generation, transfer learning from data-rich domains, and the use of non-public data.The historical strategy of training language models on publicly available text from websites, books, and other sources has reached a point of diminishing returns, with developers having "largely squeezed as much out of that type of data as they can," according to The Information.How OpenAI is Tackling This Issue: Reasoning vs. Language ModelsTo tackle these challenges, OpenAI is fundamentally restructuring its approach to AI development.“In response to the recent challenge to training-based scaling laws posed by slowing GPT improvements, the industry appears to be shifting its effort to improving models after their initial training, potentially yielding a different type of scaling law,” The Information reports.To achieve this state of continuous improvement, OpenAI is separating model development into two distinct tracks:The O-Series (which seems to be codename Strawberry), focused on reasoning capabilities, represents a new direction in model architecture. These models operate with significantly higher computational intensity and are explicitly designed for complex problem-solving tasks.The computational demands are substantial, with early estimates suggesting operational costs at six times that of current models

This week’s Product Walk Through is with V7 Labs and its genAI-driven Go capability for extracting key data from legal documents.V7 Labs is an AI development group and Go is its tool specifically designed for automating tasks in knowledge work, in this case legal data extraction from collections of deal documents to produce a due diligence report.Showing how it works are Will Mangion, Sales Lead, and Patrick Frenett, Solutions Engineer, at V7. The demo runs to about 15 mins, followed by 7 mins of QA with Artificial Lawyer on what the product can do. Please press Play to watch / listen to the video inside the page. VIDEO. AL TV Productions, 2024.The company added that: ‘V7 Go allows legal teams to build Generative AI workflows that emulate human work. With natural language-based instructions users can build flexible data extraction pipelines in minutes – enabling impactful automation processes to be created by anyone with an idea and a laptop.’You can find more information about V7 Go here.—Note: you can customise the video playback and add automated captions by using the icons.[ This is a sponsored AL TV Product Walk Through with V7 Labs