I am searching my site. I have put in my robots.txt:

User-agent: *
Disallow: /cat/
User-agent: htdig
Disallow: /cat/

but htdig doesn't pay attention on that, it still indexes pages like
/cat/add_new_entry.php3?cat_id=121

maybe i am doing something wrong?

VAldas


------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
[EMAIL PROTECTED] 
You will receive a message to confirm this. 

Reply via email to