On Sep 16, 2009, at 9:13 PM, Walter Underwood wrote:

I would use the RSS feed (hopefully in Atom format) as a source of links, then use a regular web spider to fetch the content.

I seriously doubt that DIH is up to the task of general fetching from the Wild Wild Web. That is a dirty and difficult job and DIH is designed for cooperating data stores.


This is just for a quick demo thing, not production.

Reply via email to