pcsoft.us.windevCopyright 2026, PC SOFT8 Aug 2016 11:10:00 Z8 Aug 2016 10:24:00 ZHi All In a WebDev 21 Dynamic site - can one use a robots.txt to tell search engine indexing spiders to not attempt indexing the site? I sometimes see Googblebot try for 40+ minutes to index my site which I have no interest in them doing ... If yes, where does one put the robots.txt file, which folder?30WEBDEVen_UShttps://forum.pcsoft.fr/es-ES/pcsoft.us.windev/59004-wd21-robots-txt/read.awpmoderateur@pcsoft.fr (El moderador)webmaster@pcsoft.fr (El webmaster)guestpcsoft.us.windevhttps://forum.pcsoft.fr/es-ES/pcsoft.us.windev/59004-wd21-robots-txt-59006/read.awp8 Aug 2016 11:10:00 ZHi Darren, Yup I know that. But what is that directory for a WebDev site - But I did some tests and I figured it out :) Th…https://forum.pcsoft.fr/es-ES/pcsoft.us.windev/59004-wd21-robots-txt-59006/read.awphttps://forum.pcsoft.fr/es-ES/pcsoft.us.windev/59004-wd21-robots-txt-59006/read.awp[WD21] - Robots.txtguestpcsoft.us.windevhttps://forum.pcsoft.fr/es-ES/pcsoft.us.windev/59004-wd21-robots-txt-59005/read.awp8 Aug 2016 11:03:00 ZHi, It needs to go in the highest level directory or the root of your domain. ...but for a more comprehensive description …https://forum.pcsoft.fr/es-ES/pcsoft.us.windev/59004-wd21-robots-txt-59005/read.awphttps://forum.pcsoft.fr/es-ES/pcsoft.us.windev/59004-wd21-robots-txt-59005/read.awp[WD21] - Robots.txt