# Living St. Louis — Gateway Realty Group # # Matches the live WordPress site's stance (fully permissive, sitemap declared), # which is correct for a site whose entire purpose is organic search. Per-page # exclusions are handled with # rather than Disallow rules — a Disallow blocks crawling, which prevents Google # from ever SEEING the noindex directive. The two are not interchangeable. # # ⚠️ When MLS listing data goes live: IDX Rules §5 explicitly permits indexing — # "does not require the Member Participant to prevent indexing of listings by # recognized search engines" — so do NOT add a blanket Disallow for listing # pages. The staged-indexing plan (listing pages noindex for weeks 1-2, then # flipped in batch) is handled per-page in the meta tag, not here. # Content-Signal (contentsignals.org): search, answering AND training are welcome. Nathan # Gotch's guidance (call 495, 2026-07-14): let the training crawlers in, CCBot above all, # because a brand baked into the next model is the long game of AI visibility. This is a # stated preference, not access control; the MLS listing data on /home/ pages stays # licensed and may not be republished or stored, which /llm-info/ says in words. Keep this # file, that page and llms.txt in step. Content-Signal: search=yes, ai-input=yes, ai-train=yes # Named explicitly rather than left to the wildcard, so no crawler has to guess. User-agent: CCBot Allow: / User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: * Disallow: Sitemap: https://livingstlouismo.com/sitemap-index.xml