# Allows only major search engines and known friendly spiders # Major Search Engines and Known Friendly Spiders (allowed) User-agent: Googlebot Disallow: User-agent: MSNBot Disallow: User-agent: Slurp Disallow: User-agent: Teoma Disallow: User-agent: Twiceler Disallow: User-agent: Gigabot Disallow: User-agent: Scrubby Disallow: User-agent: Robozilla Disallow: # Everyone Else (NOT allowed) User-agent: * Disallow: Disallow: /cgi-bin/ Disallow: /img/ Disallow: /apptmp/ Disallow: /sitemap/ Disallow: /top_ads.txt Disallow: /header.txt Disallow: /footer.txt Disallow: /navigation.txt Sitemap: http://www.free-link-exchange/sitemap.xml