| |
|
This page contains all of the posts and discussion on MemeStreams referencing the following web page: The Purpose Of Robots.txt. You can find discussions on MemeStreams as you surf the web, even if you aren't a MemeStreams member, using the Threads Bookmarklet.
|
The Purpose Of Robots.txt
by GavinTW at 4:02 pm EDT, Jul 18, 2007 |
I found the post to be a useful introduction to what a robots.txt file is and isn't. I'd read some forum posts etc about the "SEO benefits" so it's good to have that one cleared up. |
|
|
