# Allow all bots to crawl the site User-agent: * Disallow: /cgi-bin/ Disallow: /assets/ Disallow: /scyug/ # Sitemap URL to help bots index the site more efficiently Sitemap: https://www.solutioncone.com/sitemap.xml # Block specific bots (if needed) User-agent: Googlebot Disallow: User-agent: Googlebot-Image Disallow: User-agent: Googlebot-Mobile Disallow: User-agent: Bingbot Disallow: User-agent: Slurp Disallow: User-agent: Baiduspider Disallow: