# NextGen Kitchens - Robots.txt # https://nextgenkitchens.com # Allow all crawlers full access to public pages User-agent: * Allow: / # Disallow demo and internal pages Disallow: /demo/ Disallow: /demo Disallow: /signin Disallow: /api/ # Optimize crawl for major search engines User-agent: Googlebot Allow: / Crawl-delay: 1 User-agent: Bingbot Allow: / Crawl-delay: 2 # Social media crawlers - allow all for Open Graph User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / User-agent: Slackbot Allow: / # Sitemap location Sitemap: https://nextgenkitchens.com/sitemap.xml # Host preference Host: https://nextgenkitchens.com