Robots.txt File Generator
Default robot access
|
Additional rules |
| Robot |
Action |
|
Googlebot
|
|
| Googlebot-Mobile |
|
| Googlebot-Image |
|
| Mediapartners-Google |
|
| Adsbot-Google |
|
| Slurp |
|
| msnbot |
|
| msnbot-media |
|
| Teoma |
|
|
|
|
Your Robots.txt File
Copy and paste the generated text into a blank text file called "robots.txt" and put it in your root directory.
|