|
| Iniciado por guest, 08,ago. 2016 10:24 - 2 respuestas |
| |
| | | |
|
| |
| Publicado el 08,agosto 2016 - 10:24 |
Hi All
In a WebDev 21 Dynamic site - can one use a robots.txt to tell search engine indexing spiders to not attempt indexing the site? I sometimes see Googblebot try for 40+ minutes to index my site which I have no interest in them doing ...
If yes, where does one put the robots.txt file, which folder? |
| |
| |
| | | |
|
| | |
| |
| Publicado el 08,agosto 2016 - 11:03 |
| |
| |
| | | |
|
| | |
| |
| Publicado el 08,agosto 2016 - 11:10 |
Hi Darren,
Yup I know that. But what is that directory for a WebDev site - But I did some tests and I figured it out 
Thanks! |
| |
| |
| | | |
|
| | | | |
| | |
|