Research Engineer

Graphon reels in $8.3M for its persistent relational memory platform. Graphon Inc., a startup with technology that makes artificial intelligence models better at processing large datasets, launched today with $8.3 million in funding. Novera Ventures led the seed round. It was joined by more than a half dozen others including the venture capital arms of Perplexity AI Inc., Samsung Electronics Co and Hitachi Ltd. Today's most advanced large language models have a context window of 1 million tokens. That means a single prompt can only contain up to 1 million tokens worth of data, which corresponds to a few thousand pages of text. LLMs' context window limits their ability to process larger datasets. AI developers get around the context window limit using RAG, or retrieval-augmented generation, tools. Those are software modules that can analyze a dataset with more than 1 million tokens, extract key records and make them available to an LLM. RAG tools can also prioritize the records they extract based on their relevance to a given prompt. However, they struggle to identify connections between records, which limits their usefulness. For example, a RAG system that extracts malware signals from a large cybersecurity dataset may not be capable of determining whether those signals describe different cyberattacks or a single hacking campaign. Graphon has developed a software platform that addresses the challenge. It can analyze a dataset with more than 1 million tokens, identify key patterns and save them to a so-called persistent relational memory. LLMs can then extract the patterns from the persistent memory without hitting their context limits. Graphon's platform reportedly identifies patterns in datasets using small AI models with about 200 million parameters. Those models carry out processing with the help of graphs. A graph is a data structure that contains information about relationships between objects. Such data structures lend themselves well to, among other tasks, representing useful patterns in business datasets processed by LLMs. Graphon's platform also makes use of mathematical objects called graphon functions. They can be used to scan a business dataset stored as a graph for records that are connected to one another. Christian Borgs, a computer scientist who helped invent graphons, is a technical adviser to Graphon. "AI has spent the last decade learning to mimic language," said Graphon founder and Chief Executive Officer Arbaaz Khan. "But the world isn't made of tokens, it's made of relationships. By preserving that structure, we make foundation models more accurate and more useful at enterprise scale." Graphon is one of several venture-backed startups working to increase the amount of data that LLMs can ingest. Subquadratic Inc., which raised $29 million last week, has developed a version of the transformer architecture that can process up to 14 million tokens per prompt. The company claims that its LLM design is also significantly more hardware-efficient than its predecessors. Another recently funded startup, Standard Intelligence Inc., is using a different technology called a masked compression objective. It increases LLMs' effective processing capacity by removing unimportant data from prompts. A message from John Furrier, co-founder of SiliconANGLE: Support its mission to keep content open and free by engaging with theCUBE community. Join theCUBE's Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities. * 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more * 11.4k+ theCUBE alumni - Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network. About SiliconANGLE Media SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios - with flagship locations in Silicon Valley and the New York Stock Exchange - SiliconANGLE Media operates at the intersection of media, technology and AI. Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Its new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.

Graphon AI, a San Francisco-based developer of pre-model intelligence for enterprise AI, has raised $8.3 million in seed funding led by Arvind Gupta of Novera Ventures. The Perplexity Fund, Samsung Next, GS Futures, Hitachi Ventures and others participated. Founded by CEO Arbaaz Khan, Graphon develops a software layer using mathematical graphon functions to map structural connections across video, audio, documents and databases. The platform bypasses token limits of traditional context windows, enabling foundation models and autonomous agents to process massive multimodal data arrays. The company has deployed production systems with South Korean conglomerate GS Group for customer movement mapping in retail and real-time safety analytics at construction sites. The funds will support platform development and scaling infrastructure for enterprise AI agent frameworks.