# All robots will spider the domain go software standards ie User-agent: Googlebot User-agent: * Disallow: /ad-links/ Disallow: /acupuncture/ Disallow: /ashton/ Disallow: /baitrix-form/ Disallow: /cgi-bin/ Disallow: /crossbow/ Disallow: /digitex/ Disallow: /englishlessonsforyou/ Disallow: /ewc.files/ Disallow: /flash/ Disallow: /form_backups/ Disallow: /harrys_garden/ Disallow: /MapIcons/ Disallow: /precision_steel/ Disallow: /dtek.html Disallow: /robnat/ Disallow: /scripts/ Disallow: /sounds/ Disallow: /SpryAssets/ Disallow: /twindeer/ Disallow: /zebec/ Disallow: /seoexamples.html Disallow: /dragon.html Disallow: /kts_new/ #Disallow: /pricing.html Disallow: /ewcblog/ Disallow: /grovetelecom/ Disallow: /wavetrak/ User-agent: MSNbot Disallow: /twin_deer/ User-agent: Slurp Disallow: /twin_deer/