Dear Con,
Searching the entire Internet is a non-trivial computer science
problem. It's kind of like asking a brain surgeon the best way to
remove a tumor. The answer should be "First, spend 16 years becoming
a neurosurgeon". My point is, there is a whole lot you need to know
beyond "is Solr the correct tool for the job".
However, the short answer is that Nutch is probably better suited for
what you want to do, when you get the funding, hardware and expertise
to do it.
I'm not mocking or denigrating you in any way, but I think you need to
do a bit more basic research in how search engines work.
I found this very readable and accurate site the other day:
http://www.tbray.org/ongoing/When/200x/2003/07/30/OnSearchTOC
Regards,
George
On Sep 17, 2008, at 8:39 AM, convoyer wrote:
Hi all.
I am quite new to solr. I am just checking whether this tool suits my
application.
I am developing a search application that searches all publically
available
websites and also some selective websites. Can I use solr for this
purpose.
If yes how can I get started.
All the tutorials are pointing to load data from a xml file and
search those
values..:-(:-( . Instead how can I give the URL of website and search
contents of that site(just like in nutch)..
Expecting reply
thanks in advance
con
--
View this message in context:
http://www.nabble.com/Can-Solr-be-used-to-search-public-websites%28Newbie%29.-tp19531227p19531227.html
Sent from the Solr - User mailing list archive at Nabble.com.