# This file is used to tell web spiders which files are not worth indexing. # This file is only a suggestion, and can not force spiders from visiting the # pages anyway. Deadly, evil spiders can use this file to find resources we may # not want them to know about. Therefore, the files specified should either # be authenticated, or be of no concern if discovered. # For more information, visit: http://www.robotstxt.org/ User-agent: * Disallow: /display/ Disallow: /enrollnet/ Disallow: /graduate/ Disallow: /guru/ Disallow: /office/ Disallow: /recruiter/ Disallow: /welcomecall/ # Google, Yahoo and Microsoft agreed to retrieve sitemaps from this file. Sitemap: http://go2.bgsu.edu/sitemap.xml