|
|
| Platform : |
windows 98/ME/NT/2000/XP |
| Price : |
Free to try,$99.9 to buy |
| File Size : |
2.8 MB |
| Screenshot : |
 Screenshot |
| Date Added : |
Wednesday, September 14, 2005 |
| Last Update: |
Wednesday, September 14, 2005 |
| User Reviews: |
 User Reviews |
|
|
|
|
 |
|
|
Robots.txt - A tool to create and manage Robots.txt files
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions
|
|
|
