Forward Deployed Engineer

V7 and PitchBook Partner to Put Private Market Data Inside AI Workflows

Decrypt’s Art, Fashion, and Entertainment Hub. Discover SCENEOpenAI's upcoming artificial intelligence model is delivering smaller performance gains than its predecessors, sources familiar with the matter told The Information.Employee testing reveals Orion achieved GPT-4 level performance after completing only 20% of its training, The Information reports.The quality increase from GPT-4 to the current version of GPT-5 seems to be smaller than that of GPT-3 to GPT-4.“Some researchers at the company believe Orion isn’t reliably better than its predecessor in handling certain tasks, according to the (OpenAI) employees,” The Information reported. “Orion performs better at language tasks but may not outperform previous models at tasks such as coding, according to an OpenAI employee.”While Orion getting closer to GPT-4 at 20% of its training might sound impressive to some, it is important to note that the early stages of AI training typically deliver the most dramatic improvements, with subsequent phases yielding smaller gains.So, the remaining 80% of training time isn’t likely to produce the same magnitude of advancement seen in previous generational leaps, sources said.The limitations emerge at a critical juncture for OpenAI following its recent $6.6 billion funding round.The company now faces heightened expectations from investors while grappling with technical constraints that challenge traditional scaling approaches in AI development. If these early versions don't meet expectations, the company’s upcoming fundraising efforts may not be met with the same hype as before—and that could be a problem for a potentially for-profit company, which is what Sam Altman seems to want for OpenAI.Underwhelming results point to a fundamental challenge facing the entire AI industry: the diminishing supply of high-quality training data and the need to remain relevant in a field as competitive as generative AI.Research published in June predicted that AI companies will exhaust available public human-generated text data between 2026 and 2032, marking a critical inflection point for traditional development approaches."Our findings indicate that current LLM development trends cannot be sustained through conventional data scaling alone," the research paper states, highlighting the need for alternative approaches to model improvement, including synthetic data generation, transfer learning from data-rich domains, and the use of non-public data.The historical strategy of training language models on publicly available text from websites, books, and other sources has reached a point of diminishing returns, with developers having "largely squeezed as much out of that type of data as they can," according to The Information.How OpenAI is Tackling This Issue: Reasoning vs. Language ModelsTo tackle these challenges, OpenAI is fundamentally restructuring its approach to AI development.“In response to the recent challenge to training-based scaling laws posed by slowing GPT improvements, the industry appears to be shifting its effort to improving models after their initial training, potentially yielding a different type of scaling law,” The Information reports.To achieve this state of continuous improvement, OpenAI is separating model development into two distinct tracks:The O-Series (which seems to be codename Strawberry), focused on reasoning capabilities, represents a new direction in model architecture. These models operate with significantly higher computational intensity and are explicitly designed for complex problem-solving tasks.The computational demands are substantial, with early estimates suggesting operational costs at six times that of current models