# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Disallow: /simple_captcha Disallow: /chicago/615-S-Pine-Ave,-Arlington-Heights,-IL-60005,-USA Disallow: /vancouver/5466+killarney+st%3B%3B/1300+king+albert+avenue User-agent: msnbot Crawl-Delay: 10 User-agent: bingbot Crawl-Delay: 10 User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: /