# Robots.txt for www.wormportal.com # User-agent: Mediapartners-Google* Disallow: # User-agent: * #Disallow: /_ disabled 8/5/06 22 in url Disallow: /test.html #Disallow: /s.pl ##added this 11/27/07 Disallow: /go.pl Disallow: /cgi-bin/ # ## 07/12/06 Google 22 for site:wormportal.com ## added the remove /s.pl?keywords= in the google remove thing last week and it really made the difference ## also removed googlebot entry ## commenting the /s.pl?keywords= line now to try to get search results back on there ## 06/19/06 Google 158 for site:wormportal.com ## Added Disallow: /cgi-bin/include.cgi ## Changed from // to ## comments ## Added Googlebot entry ## ## 01/05/06 Google 234 for allinurl: wormportal.com. ## Added Disallow: /s.pl?keywords=*&username* ## 09/06/2007 Added Disallow: /s.pl, 198 allinurl ## 01/19/2008 Removed Googlebot section and /s.pl listings, 154 site:www.wormportal.com ## 06/26/2008 185 site:www.wormportal.com but no s.php ones :/ ## 09/05/2008 3340 site:www.wormportal.com, fixed html formatting ## 12/11/2008 Added User-agent: Mediapartners-Google* Disallow: