I am searching my site. I have put in my robots.txt: User-agent: * Disallow: /cat/ User-agent: htdig Disallow: /cat/ but htdig doesn't pay attention on that, it still indexes pages like /cat/add_new_entry.php3?cat_id=121 maybe i am doing something wrong? VAldas ------------------------------------ To unsubscribe from the htdig3-dev mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this.
- [htdig3-dev] [ANNOUNCE] ht://Dig 3.2.0b1 Geoff Hutchison
- [htdig3-dev] [ANNOUNCE] ht://Dig 3.2.0b1 loic
- Re: [htdig3-dev] [ANNOUNCE] ht://Dig 3.2.0b1 Geoff Hutchison
- Re: [htdig3-dev] [ANNOUNCE] ht://Dig 3.2.0... loic
- Re: [htdig3-dev] [ANNOUNCE] ht://Dig 3... Valdas Andrulis
- Re: [htdig3-dev] [ANNOUNCE] ht://... Valdas Andrulis
- Re: [htdig3-dev] [ANNOUNCE] h... Geoff Hutchison
- [htdig3-dev] size of dyna... Valdas Andrulis
- Re: [htdig3-dev] size of ... Geoff Hutchison
- Re: [htdig3-dev] size of ... Gilles Detillieux
- Re: [htdig3-dev] size of ... loic
- Re: [htdig3-dev] size of ... Gabriele Bartolini
- Re: [htdig3-dev] size of ... Gilles Detillieux
- Re: [htdig3-dev] size of ... Gabriele Bartolini
- Re: [htdig3-dev] size of ... Gilles Detillieux
