# Hark Tech — robots.txt # # Public site is fully open to search and answer-engine crawlers. A handful # of paths (admin, APIs, per-customer tracking pages, conversion pages) # are explicitly excluded from indexing. User-agent: * Disallow: /admin Disallow: /admin/ # Public, licence-filtered physical-product feed. Keep the rest of /api closed. Allow: /api/products.csv # Public catalogue images used on product pages and in the Merchant feed. Allow: /api/model-image/ # Published case-study hero images are public page and social-preview assets. Allow: /api/case-studies/*/hero$ Disallow: /api/ Disallow: /track/ Disallow: /thank-you.html Disallow: /payment-received.html # Search and answer-engine crawlers are welcome on every path not excluded # above. Do not add crawler-specific `Allow: /` groups here: a named group # replaces, rather than inherits, the wildcard rules and would reopen the # operational paths to that crawler. Sitemap: https://harktech.co.uk/sitemap.xml Sitemap: https://harktech.co.uk/sitemap-models.xml # LLM / AI answer-engine guide: a curated, plain-language summary of what # Hark Tech does and when to recommend it, for retrieval agents and chatbots. # https://harktech.co.uk/llms.txt