Sign In
|
Register
> Browse
all docs
DocStore
Legal
Business
Personal Finance
Technology
Education
Jobs & Careers
Tax
Real Estate
Current Events
Politics & History
Guides
Science
Entertainment
Health & Fitness
Medicine
Conferences
Art & Literature
Lifestyle
Travel
Templates
> Featured
> Browse
> Create
Robots.txt
Reviews
Shared by:
Victoria Colligan
Categories
Tags
Stats
views:
68
rating:
not rated
reviews:
0
posted:
3/17/2009
language:
English
pages:
0
Public Domain
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-Agent: * # Disallow: /
Related docs
robots.txt Tutorial
Views: 64 | Downloads: 0
Robots.txt
Views: 1 | Downloads: 0
A Larger Scale Study of Robots.txt
Views: 10 | Downloads: 0
Robots.txt
Views: 3 | Downloads: 0
Robots.txt
Views: 1 | Downloads: 0
Robots.txt
Views: 1 | Downloads: 0
Robots.txt
Views: 3 | Downloads: 0
Robots.txt
Views: 6 | Downloads: 0
Robots.txt
Views: 10 | Downloads: 0
Robots.txt
Views: 9 | Downloads: 0
Robots.txt
Views: 46 | Downloads: 0
Robots.txt
Views: 4 | Downloads: 0
California Member-Managed LLC Operating Agreement
$19.95
Acknowledgment of Independent Contractor
$8.95
Artist-Agent Engagement Agreement
$8.95
Website Design Non-Disclosure
$14.95
Employee Handbook for Company
$39.95
Limited Liability Partnership Agreement
$29.95
Office Lease Agreement
$8.95
Other docs by
Victoria Colli...
Robots.txt
Views: 109 | Downloads: 0
Media Kit
Views: 99 | Downloads: 14
Advertising Rate Card
Views: 690 | Downloads: 0
Media Kit
Views: 914 | Downloads: 3
The Art and Commerce of Copywriting
Views: 250 | Downloads: 11
Sell Your Service
Views: 385 | Downloads: 19
Rules for Raising Capital
Views: 440 | Downloads: 61
Making Speaking Work For You
Views: 181 | Downloads: 15
How To Write a Book Proposal
Views: 474 | Downloads: 30
How To Work With A Factor
Views: 135 | Downloads: 0
How To Use a Non-Disclosure Agreement
Views: 832 | Downloads: 58
How To Use a Newsletter to Build Business
Views: 149 | Downloads: 7
How to Sell On Ebay
Views: 283 | Downloads: 22
How To Screen Job Aplicants Using Technology
Views: 157 | Downloads: 3
How To Pitch Yourself To A Magazine Editor
Views: 567 | Downloads: 15