> I have a sneaking suspicion that these questions have been raised > before, but I've gone through the FAQ and documents on the site, as well > as Google Groups, and I really haven't found definitive answers. So if > these are well known problems, just point me to the URLs please.
> My basic problem is that I want to spider secure urls (https://). I > gather that htdig 3.1.6 can handle https url's if ssl has been included > in the make. I also gather that there was (or is) some sort of OpenSSL > patch for 3.1.6, and that the ssl implementation on version 3.2 is > unreliable if not broken. > > So if anyone could point me to some answers to the following questions, > I would really appreciate it. > > - Does the current stable htDig really support indexing https urls and > is there any special requirements to set this up, other than pointing > to the urls in htdig.conf? Yes, and no. > - Does the makefile for building 3.1.6 have to be modified to support > https urls? Is this documented somewhere? Of course, and no (except in the patch itself - use the source, Luke). > - What's the story on this OpenSSL patch? First there was an ssl.9 patch which used the old SSLeay interface. This I integrated into my VMS port, changing it to use the more recent interface. Mari Sepp� picked this up and integrated it back into 3.1.6 (his patch can be found at ftp://ftp.ccsf.org/htdig-patches/3.1.6/ssl.10). Finally I got enough time to clean up Mari's patch, made it conditional under the HAVE_SSL macro (implemented and tested on my Linux machine), and improved SSL error handling a bit: http://sourceforge.net/tracker/index.php?func=detail&aid=605517&group_id=4593&at id=304593 The only thing is that it isn't integrated with autoconf, so it's hardcoded in Makefile.config.in. OPENSSL should point to your OpenSSL installation directory. That should be about it. > - Will this ssl-enabled htdig fail if the certificate information does > not match the site url (not untypical when dealing with a self > generated certificate.)? I only used self-signed certificates in my tests and it did work. cu, Martin -- OpenVMS: | Martin Vorlaender VMS & WNT programmer When you KNOW | work: [EMAIL PROTECTED] where you want | http://www.pdv-systeme.de/users/martinv/ to go today. | home: [EMAIL PROTECTED] ------------------------------------------------------- This SF.NET email is sponsored by: SourceForge Enterprise Edition + IBM + LinuxWorld = Something 2 See! http://www.vasoftware.com _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
