Hello, I am using solr 1.3 with jdk 1.5.0_14 and weblogic 10MP1 application server on Solaris. I use embedded solr server. More details : Number of docs in solr index : 1.4 million Physical size of index : 640MB Total number of fields in the index : 700 (99% of these are dynamic fields) Total number of fields enabled for faceting : 440 Avg number of facet fields participating in a faceted query : 50-70 Total RAM allocated to weblogic appserver : 3GB (max possible)
In a multi user environment with 3 users using this application for a period of around 40 minutes, the application runs out of memory. Analysis of the heap dump shows that almost 85% of the memory is retained by the FieldCache. Now I understand that the field cache is out of our control but would appreciate some suggestions on how to handle this issue. Some questions on this front : - some mail threads on this forum seem to indicate that there could be some connection between having dynamic fields and usage of FieldCache. Is this true ? Most of the fields in my index are dynamic fields. - as mentioned above, most of my faceted queries could have around 50-70 facet fields (I would do SolrQuery.addFacetField() for around 50-70 fields per query). Could this be the source of the problem ? Is this too high for solr to support ? - Initially, I had a facet.sort defined in solrconfig.xml. Since FieldCache builds up on sorting, I even removed the facet.sort and tried, but no respite. The behavior is same as before. - The document id that I have for each document is quite big (around 50 characters on average). Can this be a problem ? I reduced this to around 15 characters and tried but still there is no improvement. - Can the size of the data be a problem ? But on this forum, I see many users talking of more than 100 million documents in their index. I have only 1.4 million with physical size of 640MB. The physical server on which this application is running, has sufficient RAM and CPU. - What gets stored in the FieldCache ? Is it the entire document or just the document Id ? Any help is much appreciated. Thank you. regards Rahul
