Hi, We have 500K web document and usind solr (trunk) to index it. We have special anaylizer which little bit heavy cpu . Our machine config:
32 x cpu 32 gig ram SAS HD We are sending document with 16 reduce client (from hadoop) to the stand alone solr server. the problem is we couldnt get speedier than the 500 doc / per sec. 500K document tooks 7-8 hours to index :( While indexin the the solr server cpu load is around : 5-6 (32 max) it means %20 of the cpu total power. We have plenty ram ... I turned of auto commit and give 8198 rambuffer .. there is no io wait .. How can I make it faster ? PS: solr streamindex is not option because we need to submit javabin... thanks..
