Solr 3.6.2 or 4.0

2013-01-04 Thread vijeshnair
We are starting a new e-com application from this month onwards, for which I am trying to identify the right SOLR release. We were using 3.4 in our previous project, bu I have read in multiple blogs and forums about the improvements that SOLR 4 has in terms of efficient memory management, less OOMs

Re: Solr 3.6.2 or 4.0

2013-01-05 Thread vijeshnair
Thanks guyz, it really helps. I will now go ahead with my original plan of using 4.0 for this project, I should be able to update you guyz soon on this. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-3-6-2-or-4-0-tp4030527p4030842.html Sent from the Solr - User mailing

DIH fails after processing roughly 10million records

2013-01-08 Thread vijeshnair
Solr version : 4.0 (running with 9GB of RAM) MySQL : 5.5 JDBC : mysql-connector-java-5.1.22-bin.jar I am trying to run the full import for my catalog data which is roughly 13million of products. The DIH ran smoothly for 18 hours, and processed roughly 10million of records. But all of a sudden it b

SOLR 4 getting stuck during restart

2013-01-19 Thread vijeshnair
I have my index based spell checker configured, and the select request handlers are configured with collation i.e. true For my testing I have indexed 2 million records there after generated the index based dictionary (I am evaluating the DirectSpellChecker, I am seeing my memory consumption is mor

Data import handler start bulging the memory after completing 1 million

2013-01-20 Thread vijeshnair
You may refer this snapshot to get an understanding of the resource consumption. I am trying to index a total number of 13 million documents from MySQL to SOLR. First 1 million document's got completed very smoothly in the first

Full import through DIH leaving documents as uncommited

2013-01-21 Thread vijeshnair
I am using SOLR 4.0 , and using DIH to import and index the catalog data from my MySQL database. The DIH took around 55minutes to complete the indexing, but my max documents processed and actual documents which got indexed were not matching. So when I checked the update handler statistics, it's sho

Re: Full import through DIH leaving documents as uncommited

2013-01-21 Thread vijeshnair
I saw the following in the IndexWriter Java doc page NOTE: if you hit an OutOfMemoryError then IndexWriter will quietly record this fact and block all future segment commits. This is a defensive measure in case any internal state (buffered documents and deletions) were corrupted. Any subsequent ca

RE: SOLR 4 getting stuck during restart

2013-01-24 Thread vijeshnair
Thanks James for the heads up and apologies for a delayed response.Here's the full details about this issue. Mine is an e-com app so the index contains the product catalog comprising roughly 13million products. At this point I thought of using the index based dictionary as the bet option for the "D

Question on Facet field constraints sort order

2013-01-31 Thread vijeshnair
It could be a foolish question or concern, but I have no option :-) . We do have an e-com site where we consuming the feed from the CSE partners and indexing it in to SOLR for our search. Instead of the traditional auto-suggest, the predictive search in the header search box recommends the categori