Document

Robots.txt

You must be logged in to download this document
Reviews
Shared by: Victoria Colligan
Categories
Tags
Stats
views:
62
rating:
not rated
reviews:
0
posted:
3/17/2009
language:
English
pages:
0
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-Agent: * # Disallow: /

Related docs
robots.txt Tutorial
Views: 60  |  Downloads: 0
A Larger Scale Study of Robots.txt
Views: 10  |  Downloads: 0
Robots.txt
Views: 1  |  Downloads: 0
Robots.txt
Views: 44  |  Downloads: 0
Robots.txt
Views: 10  |  Downloads: 0
Robots.txt
Views: 5  |  Downloads: 0
Robots.txt
Views: 8  |  Downloads: 0
Robots.txt
Views: 4  |  Downloads: 0
Robots.txt
Views: 16  |  Downloads: 1
Robots.txt
Views: 9  |  Downloads: 0
Robots.txt
Views: 22  |  Downloads: 0
Robots.txt
Views: 3  |  Downloads: 0
Robots.txt
Views: 10  |  Downloads: 0
premium docs
Other docs by Victoria Colli...
Robots.txt
Views: 92  |  Downloads: 0
Media Kit
Views: 96  |  Downloads: 14
Advertising Rate Card
Views: 684  |  Downloads: 0
Media Kit
Views: 877  |  Downloads: 3
The Art and Commerce of Copywriting
Views: 247  |  Downloads: 11
Sell Your Service
Views: 375  |  Downloads: 19
Rules for Raising Capital
Views: 420  |  Downloads: 56
Making Speaking Work For You
Views: 178  |  Downloads: 15
How To Write a Book Proposal
Views: 465  |  Downloads: 30
How To Work With A Factor
Views: 131  |  Downloads: 0
How To Use a Non-Disclosure Agreement
Views: 809  |  Downloads: 58
How To Use a Newsletter to Build Business
Views: 146  |  Downloads: 7
How to Sell On Ebay
Views: 278  |  Downloads: 22
How To Screen Job Aplicants Using Technology
Views: 153  |  Downloads: 3
How To Pitch Yourself To A Magazine Editor
Views: 532  |  Downloads: 13