Cathie Wood's ARK Invest sold 40,392 Shopify shares from its ARKK and ARKW ETFs following the stock's more than 25% rally in August. The sale comes after Shopify reported strong Q2 results, with revenue reaching $3.58 billion, up 34% year-on-year, and operating income climbing 68% to $488 million. ARK redirected capital elsewhere, purchasing shares in the 3iQ Solana Staking ETF and Intellia Therapeutics. Shopify's rapid appreciation has pushed its price-to-earnings ratio near 95 times, raising valuation concerns amongst investors. Phillip Securities downgraded Shopify to "Accumulate" from "Buy" last week, citing expensive valuation following the recent rally. Shopify stock has declined 7% this week despite gaining ground in after-hours trading.

Shopify introduces gisting: compressing LLM system prompts into learned tokens. Follow InfoQ on. Shopify's engineering introduced Gisting, a novel technique for compressing long LLM prompts into a smaller set of learned "gist" tokens, improving throughput and reducing inference cost. Spotify emphasizes that replacing lengthy text for concise gist tokens at inference time reduces end-to-end latency, drops infrastructure costs, and boosts token throughput without modifying the model's core weights. The company says that gisting reduced the Sidekick GraphQL agent's system prompt from about 6000 tokens to 1500 gist tokens without sacrificing prediction quality. This implies a 4:1 reduction in context size: At 350 requests per minute (RPM), the median time to first token (TTFT) dropped from 438ms to 354ms, the median end-to-end request latency dropped from 6.8s to 4.2s, and throughput rose from 20.2 to 23.4 queries per second (QPS). These improved metrics allowed Spotify to reduce the number of allocated GPUs. Gisting is based on a technique pioneered in a 2022 paper, "Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models", and consists of a two-step process to learn the embeddings of the new compressed gist token. In a first pass, the teacher pass, the model is run with the real prompt to derive the teacher logits of the response. In the student pass, the model is run with the gist tokens to derive the student logits. Finally, the gist are trained to minimize the KL divergence between the teacher logits and the student logits, that is until the student's predictions closely match the teacher's. When training finishes, InfoQ write the gist embeddings straight into the model's embedding matrix, and register the new gist tokens as special tokens in the model's tokenizer. The model loads and runs like any other at inference time: no custom attention mask, extra encoder, or special serving path. The key advantage of gisting is that the model does not process a conventional summary of the original prompt, but rather a learned representation designed to make the LLM to behave as close as possible to how it would if it had seen the original prompt. Gisting can reduce latency and increase throughput. In Shopify's case, Time to First Token (TTFT) dropped from 438ms to 354ms, and end-to-end latency fell from 6.8s to 4.2s. At the same time, queries per second (QPS) increased from 20.2 to 23.4, allowing engineering teams to scale down overall GPU allocation. As a final note, Shopify also emphasizes that gisting is complementary to other optimization techniques, such as prefix caching. Prefix caching avoids recomputing the KV tensors for cached prompt sequences, but the model must still process those cached tensors during the decoding phase. Gisting further reduces this overhead by replacing a long prompt with a shorter sequence of learned gist tokens. The two optimizations therefore compound, and Shopify uses them together. There is much more to gisting than can be covered here. Make sure to read the original article if you are interested in the full details, which covers topics such as the role of autosearch in tuning the Gisting process and other implementation details that significantly affect performance. Sergio De Simone. Sergio De Simone is a software engineer. Sergio has been working as a software engineer for over twenty five years across a range of different projects and companies, including such different work environments as Siemens, HP, and small startups. For the last 10+ years, his focus has been on development for mobile platforms and related technologies. He is currently working for BigML, Inc., where he leads iOS and macOS development. Related sponsors. A round-up of last week's content on InfoQ sent out every Tuesday. Join a community of over 250,000 senior developers. View an example

Amazon and Shopify present contrasting investment profiles for 2026. Amazon reported nearly $717 billion in revenue for FY 2025, up 12.4%, with net income of $77.7 billion. However, the company plans to spend approximately $200 billion in capital expenditure for 2026 to expand AI and cloud infrastructure, pressuring free cash flow. Shopify achieved $11.6 billion in revenue for FY 2025, growing 30.1%, with $1.2 billion in net income. The company generated $2 billion in free cash flow whilst carrying zero debt and maintaining a 6.0x current ratio. Amazon faces regulatory scrutiny, including Federal Trade Commission antitrust lawsuits. Shopify contends with class action suits over consumer data practices and depends on third-party partners for payments and cloud hosting. The Motley Fool analyst favours Shopify, citing faster growth, capital efficiency, and financial flexibility despite Amazon's diversification and scale.