On Wed, 2 Feb 2000, Gilles Detillieux wrote:
> > type returned in the HTTP header. Of course to do this would mean
> > sending a HEAD request first, and then only a GET if the content-type is
> > one we can index. Of course this has a significant latency impact, but
> > we can live with that.
>
> In 3.2, htdig will support persistant connections and head before get as
> options. I haven't taken the time to get familiar with the new code, but
> it does seem to detect and reject documents that are "not parsable".
I'll echo Gilles's comments here, the 3.2.0b1 beta will have a
head_before_get attribute, which I believe will do what you want.
Cheers,
-Geoff
------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
