>>>>> "Jeff" == Jeff Breidenbach <[EMAIL PROTECTED]> writes:
Jeff> The intended behaviour for robots is to record the message
Jeff> pages and not the index pages. I do want the search engines
Jeff> to follow the links, which lead to meta-tag free message
Jeff> pages. This is what the internal search enine does. I didn't
Jeff> realize altavista and friends might act differently.
One lives and learns.
Jeff> What's the problem with index pages? If the subject of the
Jeff> email is "cactus" and someone searches for "cactus"... a
Jeff> search engine will produce a double hit, one on the message
Jeff> page and one on the index page. Double matches are annoying.
Agreed.
Jeff> I'll take a look and see if I can change the meta tags /
Jeff> htdig settings so that both the internal search engine and
Jeff> the Altavista's of the world do the same thing. (If you
Jeff> happen to have a configuration setting to suggest I'll
Jeff> implement it that much quicker.)
Sorry, like I said I'm no HTML guru. However, there is an
alternative, which is to get Altavista and friends to index one of the
actual message pages. Since the messages are all linked to each
other, the engine should then automatically index all the messages in
the list.
Let me try this out...
http://www.mail-archive.com/[email protected]/msg01271.html
OK, it works. Here's what Altavista says:
You have submitted the following URL:
http://www.mail-archive.com/[email protected]/
msg01271.html
The page was fetched in 0.536 seconds and will be indexed within a day
or two.
This URL has been recorded by our robot.
If you adopt this (perhaps as a stop-gap measure) maybe you'd like to
add this to the FAQ.
Jeff> Thanks for the heads up, Jeff
Jeff> PS. If you do a search for "mail-archive.com" on Altavista,
Jeff> you should see a fair number of matches.
Regards,
-- Raju
