
Work Here?
Kog builds a realtime AI platform that lets businesses run AI models and make instant decisions inside their apps. Its core offering is an inference stack delivered as a platform-as-a-service (PaaS) or via APIs, enabling low-latency AI processing for live applications in areas like e-commerce, fintech, and ad-tech. The product works by providing developers with ready-to-use endpoints and infrastructure to host, scale, and execute AI models in real time, without building the backend from scratch. Kog differentiates itself by focusing on real-time inference and seamless integration for B2B customers, rather than general-purpose AI tools, allowing clients to embed intelligent features directly into their digital products. The company aims to support the new digital economy by enabling instant data processing and decision-making at scale through predictable subscription tiers based on usage and features.
Industries
Data & Analytics
Enterprise Software
AI & Machine Learning
Company Size
11-50
Company Stage
N/A
Total Funding
N/A
Headquarters
Les Ulis, France
Founded
2023
See people who can refer or advise you
Help us improve and share your feedback! Did you find this helpful?
Company Equity
Conference Attendance Budget
Remote Work Options
AI roundup - august 14, 2026. AI News Machine Learning Infrastructure Model Releases Google adds option to remove visible watermarks from ai-generated content. TechCrunch reports that Google is now allowing users to remove the visible watermark from its AI-generated images and content. According to the report, disabling the visible watermark will not affect invisible watermarking - the underlying metadata used to identify files as AI-generated will remain intact. The change gives users more flexibility in how their AI-generated outputs are presented, while Google's technical identification mechanisms continue to function in the background. Meta Releases Glimmer, an open-weight AI model. Meta released a new open-weight AI model called Glimmer this week, according to TechCrunch. Glimmer can be downloaded and run locally on a user's own hardware, positioning it as an accessible option for developers and researchers who prefer on-premise deployments. The release is distinct from Meta's more powerful model, Muse Spark, which remains accessible only through the company's APIs. Alongside the release, Meta published a letter from CEO Mark Zuckerberg stating that AI should be available broadly rather than controlled by a small number of labs. TechCrunch notes the contrast between the open-weight Glimmer release and the restricted access model represented by Muse Spark. French startup Kog targets GPU efficiency for agentic AI workloads. French startup Kog is developing technology aimed at extracting more inference performance from GPUs, particularly for agentic AI workflows, TechCrunch reports. According to the article, the prevailing assumption that GPUs are poorly suited for agentic workloads may be a misconception - one that Kog is working to address directly. The startup's approach focuses on going deeper into the hardware and software stack to improve inference throughput. As agentic AI systems become more prevalent across the industry, efficient GPU utilization represents a growing area of engineering focus. Rising natural gas prices could impact AI data center operating costs. A new forecast cited by TechCrunch suggests that natural gas prices could triple in certain parts of the United States, potentially creating significant cost challenges for hyperscalers that have invested heavily in natural gas to power their AI data centers. According to the report, major cloud and infrastructure providers that have committed to natural gas as a power source for AI workloads may face substantially higher energy bills if the forecast proves accurate. The situation underscores the importance of energy sourcing decisions as AI infrastructure continues to scale. These developments reflect ongoing activity across model accessibility, hardware optimization, and infrastructure planning as the AI industry continues to mature. Check back for further updates as these stories develop.
Kog redefines GPU inference for agentic AI workflows. Tl;dr. * French startup Kog has developed a new GPU optimization stack that overturns the assumption that GPUs are inefficient for sequential, tool-heavy agentic AI workflows, delivering major gains in inference speed and utilization. * Kog's approach tackles the core bottlenecks of agentic inference - including low GPU occupancy, memory-bound KV-cache operations, and dynamic branching - through techniques like adaptive kernel fusion and intelligent speculative scheduling. * The breakthrough promises to dramatically lower the cost and latency of running autonomous AI agents at scale, making large-scale agentic deployments commercially viable without relying on specialized alternative hardware. The agentic bottleneck: why GPUs were counted out. For the last year, the consensus in AI infrastructure has been clear: GPUs are phenomenal for training and for high-throughput parallel inference, but they stumble when it comes to agentic AI. Unlike a standard chatbot prompt that can be processed in one large, parallel forward pass, agentic workflows are messy and sequential. An agent thinks, calls a tool, waits for a result, reasons again, branches, and repeats. That stop-and-start pattern leaves powerful GPUs idle, with utilization rates often dropping below 30% and memory bandwidth choked by constantly shifting KV-caches. This inefficiency has led many to argue that the future of agents would require CPUs, custom ASICs, or entirely new architectures. French startup Kog, based in Paris, is challenging that narrative head-on. Meet Kog: the startup making GPUs agentic-native. Founded by a team of former researchers from INRIA and engineers from Nvidia and Mistral AI, Kog has been operating in stealth until recently. Its mission is simple but ambitious: make the existing global fleet of GPUs natively efficient for agentic reasoning without requiring hardware changes. Rather than building a new chip, Kog has built a software-level inference engine that sits between the orchestration framework - like LangGraph or AutoGen - and the GPU itself. The platform dynamically rewrites how agentic workloads are executed at the CUDA kernel level, treating an entire multi-step agent trajectory as a single optimizable graph instead of a series of isolated LLM calls. How it works: from idle cores to full utilization. Kog's breakthrough centers on three interconnected optimizations. First is Dynamic Trajectory Fusion. Instead of launching separate kernels for each reasoning step and tool call, Kog's compiler fuses operations across the entire agentic loop. It predicts likely tool outputs and reasoning branches and pre-compiles fused kernels that keep data on-chip, drastically reducing the expensive memory transfers that typically stall GPUs between steps. Second is its Elastic KV-Cache Manager. In agentic workflows, the context window constantly grows and branches as agents explore different paths. Standard inference engines handle this by duplicating and moving massive KV-caches, which is extremely memory-bound. Kog uses a paged, copy-on-write cache system with intelligent prefix sharing, allowing multiple speculative agent paths to share the same memory blocks until they diverge. This alone cuts memory overhead by up to 70% in long-horizon tasks. Third is Speculative Agentic Scheduling. Borrowing concepts from speculative decoding, Kog's scheduler doesn't wait for a tool to return before preparing the next step. It speculatively executes multiple probable next reasoning steps in parallel on underutilized GPU cores, then instantly discards the incorrect paths once the tool result is in. This turns the inherently sequential nature of agents into a parallelizable problem, pushing GPU utilization from the typical 20-30% to over 85% in Kog's internal benchmarks. Benchmarks and real-world impact. In early benchmarks shared by the company and validated by design partners, Kog's engine delivered a 3.5x to 4.8x increase in throughput for common agentic workloads - such as multi-step research agents and code-generation agents - on standard Nvidia H100 GPUs. End-to-end latency for a 10-step agent task dropped from an average of 8.2 seconds to under 2.5 seconds, while cost-per-task fell by more than 60%. For enterprises, the implications are significant. Until now, running thousands of concurrent autonomous agents for customer support, software engineering, or data analysis was prohibitively expensive and slow. By unlocking efficiency on existing GPU infrastructure, Kog removes the need to over-provision hardware or wait for next-generation chips. What this means for the future of AI agents. Kog's work signals a broader shift in the AI infrastructure race. While much attention has focused on building faster hardware, the biggest gains for the next wave of AI may come from software that makes current hardware smarter. If agentic AI is to move from compelling demos to reliable, large-scale deployment, inference has to be both fast and cheap. By proving that GPUs - the most widely available AI accelerators in the world - can be re-architected at the software level to handle the chaotic, branching logic of agents, Kog is not just optimizing a chip. It is removing one of the last major infrastructure barriers to truly autonomous, scalable AI systems. The company is now opening its private beta to select enterprise customers in Europe and the US, with a wider general availability release expected later this year. AndroGuider Team Articles written by the AndroGuider team. Androguider try to make them thorough and informational while being easy to read.
French startup Kog is developing software to accelerate AI inference on existing datacenter GPUs. The company claims its approach can unlock significantly faster performance from chips like AMD MI300X and NVIDIA H200 without requiring new hardware. Kog's May tech preview demonstrated 3,000 tokens per second using a small 2-billion-parameter model, generating 200 business leads. CEO Gaël Delalleau said the startup is now focusing on larger language models to meet customer demand, particularly from software engineering teams frustrated by long wait times. The company's approach involves deep-level GPU optimization, dedicating weeks or months to engineering research for each chip. With an 11-person team, Kog recently closed a seed round co-led by Varsity VC and is backed by Bpifrance and Scaleway. Delalleau expects to demonstrate 10x speed improvements on major models by September, which would enable a Series A funding round.
Kog aims to revolutionize AI inference with software optimization on standard GPUs. The article details the ambitious endeavors of Kog, a French startup, in the realm of AI inference by maximizing the capabilities of standard GPUs through software optimization. Key Points: * Kog's Innovative Approach: Kog demonstrated the potential of extremely fast single-request decoding on existing datacenter GPUs, achieving 3,000 tokens per second in its demo using conventional GPUs like AMD MI300X and Nvidia H200. * Market Reception: The startup gained traction, particularly in professional software engineering sectors where inference speed is crucial. CEO Gaël Delalleau reported receiving 200 tangible business leads, illustrating significant market interest in Kog's offerings. * Challenges and Strategy: Despite technical achievements, Kog faces challenges such as the immaturity of the market for fine-tuning small models. As a result, they are focusing on accelerating larger model developments to meet demand. * Technological Philosophy: Kog's approach, informed by Delalleau's background in solid-state physics and cybersecurity, emphasizes deep-level GPU optimization. * Competition and Distinction: Kog stands apart from competitors like ZML by its unique focus akin to Stanford's Hazy Research, underpinned by their methodology involving extensive hands-on GPU engineering. * Future Plans: Despite its small team, Kog aims to expand its capabilities and has sights set on demonstrating 10x speed improvements on major models by September. Successful demonstration could lead to further funding rounds, propelling its expansion plans. * European Backing: Kog is supported by entities such as Scaleway and backed by Bpifrance and French Tech 2030, reflecting strategic interest in bolstering European technological sovereignty.
Find jobs on Simplify and start your career today
Industries
Data & Analytics
Enterprise Software
AI & Machine Learning
Company Size
11-50
Company Stage
N/A
Total Funding
N/A
Headquarters
Les Ulis, France
Founded
2023
Find jobs on Simplify and start your career today