Solr only manages the indexing/search side, it does not do any
crawling like nutch.
For crawling a small site, you may want to check out:
http://aperture.sourceforge.net/ (mature, but RDF heavy)
Or Droids: http://people.apache.org/~thorsten/droids/
Droids is new, and will change a lot soon, but it is/will be focused
on exactly what you are talking about.
ryan
On Sep 17, 2008, at 8:39 AM, convoyer wrote:
Hi all.
I am quite new to solr. I am just checking whether this tool suits my
application.
I am developing a search application that searches all publically
available
websites and also some selective websites. Can I use solr for this
purpose.
If yes how can I get started.
All the tutorials are pointing to load data from a xml file and
search those
values..:-(:-( . Instead how can I give the URL of website and search
contents of that site(just like in nutch)..
Expecting reply
thanks in advance
con
--
View this message in context:
http://www.nabble.com/Can-Solr-be-used-to-search-public-websites%28Newbie%29.-tp19531227p19531227.html
Sent from the Solr - User mailing list archive at Nabble.com.
