# Robots.txt file from http://www.perrymarshall.com # # All robots will spider the domain User-agent: * Disallow: User-agent: GooglebotDisallow: /*.pdf$ User-agent: * Disallow: /mp3/ Disallow: /docs/ Disallow: /downloads/ Disallow: /admin_tools/ Disallow: /members/ Disallow: /google/ Disallow: /adwords/ # Disallow: /google/dg29ren_zk/