Database Engineering Manager

From custom Sitemaps to llms.txt: latest Squarespace experiments with Cloudflare. Wednesday, 5 August 2026 Introduction & background. Earlier, I published a tutorial on How to Add llms.txt to Squarespace. Since then, Squarespace introduced native support for llms.txt on Squarespace 7.1 sites. However, native support is still lacking on Squarespace 7.0, and site owners have zero control over custom HTTP response headers, markdown content negotiation, or Content-Signal declarations. Honestly, the actual business utility of llms.txt remains controversial in the SEO and web dev community. Is it genuinely driving AI citations, or is it just another trendy file crawlers ignore? To find out, I set up a live experiment on Beyondspace Studio to test how AI bots and scrapers interact with llms.txt, robots.txt, and sitemap.xml under real-world conditions. In this post, I will walk through how I used Cloudflare Workers to proxy Squarespace's native robots.txt and sitemap.xml, serve a custom /llms.txt, and track AI crawler activity. markdown // Beyondspace Studio - AI & Crawler Discovery Experience // Intercept endpoint responses for /llms.txt, /robots.txt and sitemap.xml on www.beyondspace.studio // Robots.txt signals follow Cloudflare https://contentsignals.org/ const LLM_CONTEXT_DOCUMENT = `# Beyondspace Studio > Specialized web development agency and Squarespace Circle Platinum Partner crafting custom extensions, workflow utilities, and advanced interactive UI components. Servicing 10,000+ active sites to enhance front-end site performance and content editor productivity. ## Primary Tooling - [Lightbox Studio](https://www.beyondspace.studio/lightbox-studio): Feature-rich modal & media lightbox system supporting pan/zoom, responsive video galleries, inline PDF rendering, and granular caption management. ## Extended Product Directory - [Ground Control](https://www.beyondspace.studio/freebies/ground-control) (Free / PWYW): Consolidated dashboard for configuring site extensions and managing active Squarespace plugins. - [Synced Blocks](https://www.beyondspace.studio/synced-blocks): Global content block synchronizer ensuring real-time site-wide updates from a single source edit. - [Paperless Flip](https://www.beyondspace.studio/paperless-flip): Embedded document renderer converting static PDFs into interactive, flippable digital publications. - [Macroom Viewer](https://www.beyondspace.studio/macroom-viewer): High-fidelity canvas viewer engineered for gigapixel images without aggressive compression artifacts. - [Squarespace Datepicker](https://www.beyondspace.studio/datepicker): Native-looking date UI input utility for checkout funnels and custom Form Blocks. ## Verification & Metrics - Tier: Squarespace Circle Platinum Partner - Deployment Base: 10,000+ globally configured web applications - Feedback Record: 300+ validated 5-star ratings logged via [Trustpilot](https://www.trustpilot.com/review/beyondspace.studio) and store transactions ## Specialized Capabilities - Bespoke Squarespace Extension & Plugin Architecture - Tailored Web Engineering (Advanced JavaScript & CSS Injection) - Content Operations & Editor Speed Enhancements - Enterprise Site Audits, Maintenance, & System Care ## Communication Channels - Domain: https://www.beyondspace.studio - Technical Support: [email protected] ## Automated Agent Protocols - Indexing & Citation: Allowed - Model Training Usage: Allowed - Autonomous Agent Operations: Allowed `; const ROBOTS_HEADER_DECLARATION = `# Content Signals Specification Compliance # Reference: https://contentsignals.org/ User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=yes `; export default {async fetch(request) { const { pathname} = new URL(request.url); switch (pathname) {case '/llms.txt': return new Response(LLM_CONTEXT_DOCUMENT, { status: 200, headers: { 'content-type': 'text/markdown; charset=utf-8', 'cache-control': 'public, max-age=3600',},}); case '/robots.txt': {const originResponse = await fetch(request); const originContent = await originResponse.text; return new Response(ROBOTS_HEADER_DECLARATION + originContent, { status: originResponse.status, headers: { 'content-type': 'text/plain; charset=utf-8', 'cache-control': 'public, max-age=3600',},});} case '/sitemap.xml': {const agent = request.headers.get('user-agent')??? 'Unknown Agent'; const referrer = request.headers.get('referer')??? 'Direct Access'; const connectingIp = request.headers.get('cf-connecting-ip')??? '0.0.0.0'; console.log( `[Sitemap Access Log] Timestamp: ${new Date.toISOString | IP: ${connectingIp} | User-Agent: ${agent} | Referrer: ${referrer}`); return fetch(request);} default: return fetch(request);}},};

One.com just rebuilt its website builder around conversational AI - and it can modernize your old website in an instant. Published 3 hours ago Modernize your old website instantly with the power of AI * One.com has launched Aida, a new all-in-one AI website builder * You can input your website URL and Aida will instantly modernize it * Other tools include online sales, booking system, blog, custom domain email, and hosting. One.com, one of the biggest web hosting providers, recently announced the launch of its new Aida AI website builder. Aida takes an all-in-one approach to website building, leveraging conversational AI. Users can simply describe their business idea in chat, letting the AI work behind the scenes to turn it into a complete website - all without any design or coding knowledge. What's new with Aida? Aida can help small businesses bring dated websites into the modern era with an instant modern redesign. In practice, this means users can input an existing URL, and Aida will instantly transform it into a modern website. Latest Videos FromTechRadar ChatGPT vs. Claude 0 seconds of 1 minute, 29 seconds Volume 0% Tools like this offer a lifeline for some small businesses that don't have the budget to undertake major modernization projects on their websites. Removing the need to pay website agencies to build simple websites and undertake routine maintenance. Moving beyond website building, you can also use Aida to set up and manage operational tools including online stores, booking systems, blogs, custom domain email, and hosting. While Aida handles the day-to-day tasks of design and setup, One.com maintains 24/7 human support, offering a crucial safety net for any complex issues that may need a human touch. One.com joins a string of website builders including Wix, Squarespace, and GoDaddy that have launched all-in-one AI website building and business growth tools.