Hi, You can have a look at www.crawl-anywhere.com A web crawler on top of Solr. Used for following vertical search engines :
http://www.hurisearch.org/ http://www.searchamnesty.org/ Regards Dominique 2015-01-06 15:22 GMT+01:00 Ahmet Arslan <iori...@yahoo.com.invalid>: > Hi, > > http://manifoldcf.apache.org is another option to consider. > It is useful to crawl projected pages. > > Free resources : > > http://www.manning.com/wright/ManifoldCFinAction_manuscript.pdf > https://manifoldcfinaction.googlecode.com/svn/trunk/pdfs/ > > Ahmet > > > > On Tuesday, January 6, 2015 1:56 PM, Jack Krupansky < > jack.krupan...@gmail.com> wrote: > Consider the Fusion product from LucidWorks: > http://lucidworks.com/product/fusion/ > > Structuring of your data should be driven by your queries and access > patterns - what are the most common queries and what are the most extreme > and complex queries that you expect to handle, both tin terms of the > queries are expressed and the results being returned. > > -- Jack Krupansky > > > On Tue, Jan 6, 2015 at 3:39 AM, klunwebale <klunweb...@gmail.com> wrote: > > > hello > > > > i want to create a vertical search engine like trovit.com. > > > > I have installed solr and solarium. > > > > What else to i need can you recommend a suitable crawler > > and how to structure my data to be indexed > > > > > > > > -- > > View this message in context: > > http://lucene.472066.n3.nabble.com/Vertical-search-Engine-tp4177542.html > > Sent from the Solr - User mailing list archive at Nabble.com. > > >
