IT Specialist

Mondo Metrics says its new trend tracker is "what CrowdTangle would have become"-and it's launching with major sports leagues. The content competition is fiercer than ever: Digital platforms like YouTube and Netflix, which have spent years steadily sapping traffic from legacy entertainment like TV and radio, are now at war with each other over who can generate the most watch time. Live sports is perhaps the mainstay of modern entertainment. TV and radio engagement may have slipped, but live sports are still going strong on both. And on the internet, leagues, teams, and tournaments have found even deeper connections with their fanbases. Netflix, meanwhile, is paying $5 billion for 10 years of WWE Raw, is exclusively airing a handful of NFL 2026-27 games, and continues investing in one-off live events like last year's Jake Paul x Mike Tyson boxing match. It says it expects live sports (and other) events to be "a small percentage of our total view hours and content expense," but that because of their cultural caché, will "result in outsized value to both our members and our business." And, speaking of creators, they are increasingly an athletic presence in sports like golf and pickleball. At the same time, sports celebrities are crossing into its realm and building their own digital channels (whattup, Ronaldo?). All this is to say that the digital world is a major and growing center for sports-and audience intelligence company Mondo Metrics is looking to capitalize. Nick Cicero, whose former measurement company Delmondo was acquired by Conviva, founded Mondo Metrics because he was working in its space with people like David Dobrik, and realized "there were a lot of creators that were creating more episodic content, more series, and podcasts were a big part of that, but there wasn't a good benchmarking solution." Some of these creators crossed into the sports arena via collabs with athletes, and Cicero saw the episodic and cross-platform nature of creators' content mirrored sports leagues airing multiple matches per week, plus dozens or even hundreds of social posts, across an entire season. Sports and entertainment, he adds, have become "more fragmented-influence now moves across teams, leagues, athletes, creators, podcasts, YouTube channels, publishers, fan communities and international formats, often faster than legacy tools can measure it." He says Meta's CrowdTangle provided a potential solution, but it shut down in 2024, "leaving a big gap in the industry for being able to have this Bloomberg Terminal kind of view of what's holding people's attention today." "There really wasn't that open benchmarking solution, especially in the world of sports and podcasts and the overlap of those creators and athlete-driven media," he says. So, he launched Mondo Metrics, and now Mondo Metrics is launching MondoTrends, a market intelligence product Cicero says has already been adopted by the Arizona Cardinals, United Football League, Underdog Sports, Los Angeles Chargers, and LOVB Volleyball. MondoTrends operates by "identifying where audience momentum is building," Mondo Metrics says. Its dashboard allows member sports teams and leagues to "search, filter and sort every post across the market by platform, keyword, account, format and performance, not just within your own channels, to view what's over and under-performing." Users can also look at content performance by format, video length, and platform; surface emerging trends; see leaderboards and rankings for social performance of individual teams, leagues, athletes, creators, publishers, shows, and content categories; get audience momentum tracking; and get "competitive benchmarking" aimed at helping brands, agencies, sponsorship teams, and media sellers better position themselves in the market. "MondoTrends gives us a clearer view into how fans are engaging with the Arizona Cardinals across platforms, formats and moments," Surf Melendez, the Arizona Cardinals' VP of Content, Creative, and Brand, said in a statement. "The value is not just seeing what performed well after the fact. It is understanding what is gaining momentum, how our content stacks up in the broader sports market and where we can make smarter decisions across content, partnerships and fan engagement." Matt Wickline, VP of Media & Content Business Development at LOVB, added that MondoTrends "has given us clarity and perspective on what content is breaking through for our teams and athletes." "[W]e've been able to quickly identify how we stack up to competitors and how our athletes stack up against each other," he said. "At the end of the day, those are the insights we need to grow our brand and tap into volleyball culture worldwide." Mondo Metrics says MondoTrends is rolling out initially through things like customer pilots, public leaderboards, and category-specific intelligence products. Its initial focus areas include women's sports (Mondo Metrics is also behind the Women's Sports Index), athlete-led media, and sports creator networks. Stay up-to-date with the latest and breaking creator and online video news delivered right to your inbox. Subscribe for daily tubefilter top stories.

A single AI agent conversation can look perfect and still be broken, leaders from LangChain, Conviva and CoreWeave said at VB Transform 2026. July 20, 2026 4 Mins Read A single AI agent conversation can look flawless scored on its own and still point to a broken product. That gap is driving a shift in how enterprises evaluate agents, away from scoring individual traces and toward comparing cohorts of users against a baseline. At VB Transform 2026, Harrison Chase, CEO of LangChain; Hui Zhang, CTO and co-founder of Conviva; and Emmanuel Turlay, director of engineering at CoreWeave, described that shift, along with a parallel move toward cheaper, narrower judge models. Agent-as-judge - judging one AI agent's output with another - hasn't replaced LLM-as-judge, which Chase said remains the default. The larger tension, Zhang said, is between automated judging, whether by LLM or agent, and human review. "You have scalable but ungrounded, whether it's agents as judge or LLMs as judge, you grade the outcome, you grade the work. It still is very difficult to ground it and then you use humans and that's just not scalable," Zhang said. "The whole industry is facing this, which poison you want to pick." Evaluation criteria now function as the product spec. That gap - a conversation that scores well but still signals a broken product - is what teams try to close by building an exhaustive evaluation suite before they ship anything. Chase said that doesn't work. "We sometimes see teams that have almost eval paralysis," Chase said. "They're like, this is an eval set, I can't launch it. The best teams launch and then iterate." Chase framed evaluation criteria as a living specification, not a one-time test suite: a product requirements document - the standard software-development spec for what an application should do. "Evals are like the new PRD," he said. "They define what your agent should and shouldn't do." Turlay described hitting the same failure from a different angle. "I was trying to reach 100% coverage for my tests, and I still had bugs in production," he said - a test suite that looked complete but still missed what mattered, the same gap Chase was describing with evals. Broad, always-on monitoring, he said, catches more real failures than an exhaustive pre-launch test suite. Teams should set up wide online checks first, use those to identify failure classes as they occur, then build a targeted offline evaluation set around the problems that surface. Why scoring traces one at a time is a mistake. Even a well-built evaluation process can still score the wrong thing. Zhang's objection is to how most teams run evaluation: sampling traces, whether 50 of them or a full population, scoring each in isolation. That approach misses a signal that only shows up when comparing cohorts of users against a baseline, a method Zhang calls contrastive analysis. Zhang illustrated it with a retail example: a shopper asks an agent for a running shoe ahead of a half marathon, the agent asks qualifying questions, and the shopper buys a shoe. Scored individually, that interaction looks fine. But the clarification ratio, how many follow-up questions an agent asks before completing a task, came in three times higher than baseline for that shoe category across the full user population. A second metric, how often shoppers finished their purchase outside the conversation, was five times higher than baseline for the same category. Neither number is visible from a single trace. Both point to a debuggable, category-specific problem. Zhang said the industry also lacks a second data source: what happens before, between and after the conversation, not just the trace itself. Sizing the judge to the job. Once contrastive analysis flags which category is actually broken, the next problem is what watches for it going forward - and at what cost. Turlay's rule was to start with the most capable model available to prove a task is solvable, then work down. If it can't be done with a top-tier model, he said, it won't work with a smaller one. Once a pattern proves viable, teams can sample a fraction of traffic instead of judging every interaction, and move simpler tasks like binary classification to smaller open source models. LangChain took that further, fine-tuning its own model to detect when a user believes the agent made a mistake, a signal Chase calls perceived error. "The model we fine-tuned was a Qwen model," he said, referring to Alibaba's open source family. Combining hand labeling with distillation, the result performed well. "Same as [Claude]Sonnet, for, depending on how we served it, either 10 to 100x cost reduction," Chase said. Not every guardrail needs a model. Chase pointed to Claude Code's own guardrails as proof: regexes, the common programming technique for finding and validating patterns in code. "A lot of the guardrails they had were just regexes," he said. "They weren't small LLMs, they were just regexes." LLM-as-judge doesn't mean human-in-the-loop disappears. The bigger question is whether using LLM as a judge removes the need for a human in the loop. Turlay pointed to accountability, drawing on his prior work at a self-driving car company. His team compressed data intake and retraining into a two-week cycle for shipping a new model to the car. Even then, someone still had to sign off. "I felt confident on behalf of the company to say this model should go into the car," he said. The same logic extends to legal, finance and healthcare. "Before we can remove a human to say, I endorse this and I take responsibility legally for it, it's going to be a while before agents can do that on their own." Zhang agreed a human has to remain the guardian on corner cases, even as automation eventually runs at a scale that beats individual human accuracy - machines can see more at the pattern level. Chase went further: that human check isn't just a safety net. "Human in the loop is really important for building trust in how these agentic systems work, and also really important for memory and learning from systems," he said. "There has to be interactions in order for the system to learn." More information & source. Have questions or feedback? Contact Us