# BTR Villas - Robots.txt for Multi-language SEO (English & Chinese) # Google Search Engine - Full access to English and Chinese content User-agent: Googlebot Allow: / Allow: /en/ Allow: /zh/ Allow: /sitemap.xml Allow: /llms.txt Crawl-delay: 1 # Google Image Bot - Allow image indexing User-agent: Googlebot-Image Allow: / Allow: /img/ Allow: /assets/ Allow: /public/ # Baidu Search Engine (百度) - Optimized for Chinese market User-agent: Baiduspider Allow: / Allow: /zh/ Allow: /en/ Allow: /sitemap.xml Allow: /llms.txt Crawl-delay: 2 # Bing Search Engine (必应) - Microsoft's search engine User-agent: Bingbot Allow: / Allow: /en/ Allow: /zh/ Allow: /sitemap.xml Allow: /llms.txt Crawl-delay: 1 # Additional Bing crawlers User-agent: msnbot Allow: / Allow: /en/ Allow: /zh/ # Allow other major search engines User-agent: * Allow: / # Disallow crawling of admin, API, and system directories Disallow: /admin/ Disallow: /api/ Disallow: /_nuxt/ Disallow: /.nuxt/ Disallow: /node_modules/ Disallow: /cdn-cgi/ # Disallow crawling of temporary and cache files Disallow: /tmp/ Disallow: /cache/ Disallow: /*.log$ # Disallow crawling of form submission endpoints Disallow: /contact/submit Disallow: /form/ Disallow: /submit/ # Allow crawling of important SEO files Allow: /sitemap.xml Allow: /llms.txt Allow: /robots.txt # Sitemap locations for better indexing Sitemap: https://btrvillas.com/sitemap.xml # Additional SEO files for AI and search engines # LLMs.txt for AI search engines and language models # https://btrvillas.com/llms.txt # Language-specific content hints for search engines # English content: https://btrvillas.com/en/ # Chinese content: https://btrvillas.com/zh/ # Contact information for search engine webmasters # For indexing issues: btrvillas@wanbridge.com