# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-Agent: * # Disallow: / Disallow: /admin Disallow: /admin/ Disallow: /audio_books/show/ Disallow: /add-to-cart Disallow: /add-to-cart/ Disallow: /about/plans_pricing Disallow: /about/plans_pricing/