Re: Memory Leak in solr 4.8.1
I don't have a filter cache, and have completely disabled filter cache. Since I am not using filter queries. -- View this message in context: http://lucene.472066.n3.nabble.com/Memory-Leak-in-solr-4-8-1-tp4198488p4198716.html Sent from the Solr - User mailing list archive at Nabble.com.
Memory Leak in solr 4.8.1
I have a solr cloud instance with 8 nodes, 4 shards and facing memory leak on the JVMs here are the details of the instance. 1. 8 nodes, 4 shards(2 nodes per shard) 2. each node having about 55 GB of Data, in total there is 450 million documents in the collection. so the document size is not huge, 3. The schema has 42 fields, it gets reloaded every 15 mins with about 50,000 documents. Now we have primary Key for the index, so when there are any duplicates the document gets re-written. 4. The GC policy is CMS, with heap size min and max = 8 gb and perm size = 512 mb and RAM on the VM is 24 gb. when users start searching in solr and not always but often the heap keeps growing and the GC cycles are not clearing up the heap. I see GC running for almost 100,000 ms with still not clearing up the heap. Appreciate any advice on this. -- View this message in context: http://lucene.472066.n3.nabble.com/Memory-Leak-in-solr-4-8-1-tp4198488.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Disable or limit the size of Lucene field cache
Thank you.. This really helps. -- View this message in context: http://lucene.472066.n3.nabble.com/Disable-or-limit-the-size-of-Lucene-field-cache-tp4198798p4199646.html Sent from the Solr - User mailing list archive at Nabble.com.
Not able to Add docValues in Solr
I am trying to enable Doc Values for certain fields in Solr schema which helps with memory management while sorting the results and here is configuration I have And field type defined this way. I deployed this schema and started the server, but I don't see the schema.xml reflecting the docvalues from the Solr admin UI. When I check the schema.xml by going to collection Name -->Files, I just see the below entry. And, I did not find the need to re-index, the existing index is working just fine. So its clear that the docValues that I am trying to enforce is not taking any effect. Please advice what I am missing here. -- View this message in context: http://lucene.472066.n3.nabble.com/Not-able-to-Add-docValues-in-Solr-tp4204405.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Not able to Add docValues in Solr
Thanks for your reply, I was under the impression that clusterstate.json and aliases.json are the two files that the zookeeper maintains. Did not know that schema.xml is also maintained by zookeeper.Yes I am running solrCloud. should I use the zookeeper client to re-upload? -- View this message in context: http://lucene.472066.n3.nabble.com/Not-able-to-Add-docValues-in-Solr-tp4204405p4204425.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Not able to Add docValues in Solr
Never mind.. used the zkcli.sh that comes with solr to accomplish the firewall -- View this message in context: http://lucene.472066.n3.nabble.com/Not-able-to-Add-docValues-in-Solr-tp4204405p4204579.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Disable or limit the size of Lucene field cache
A follow up question, I see docValues has been there since Lucene 4.0. so can I use docValues with my current solr cloud version of 4.8.x The reason I am asking is because, I have deployment mechanism and securing the index (using Tomcat Valves) all built out based on Tomcat which I need figure out with Jetty. so thinking if I could use docValues with solr/lucene 4.8.x -- View this message in context: http://lucene.472066.n3.nabble.com/Disable-or-limit-the-size-of-Lucene-field-cache-tp4198798p4209873.html Sent from the Solr - User mailing list archive at Nabble.com.
docValues in solr/lucene 4.8.x
I see docValues has been there since Lucene 4.0. so can I use docValues with my current solr cloud version of 4.8.x The reason I am asking is because, I have deployment mechanism and securing the index (using Tomcat valve) all built out based on Tomcat which I need figure out all the way again with Jetty. so thinking if I could use docValues with solr/lucene 4.8.x in order to perform sort/facet queries effectively(consuming less heap memory) -- View this message in context: http://lucene.472066.n3.nabble.com/docValues-in-solr-lucene-4-8-x-tp4209927.html Sent from the Solr - User mailing list archive at Nabble.com.
SOLR cloud creating multiple copies of the same index
Hi , we have a solr cloud instance with 8 nodes and 4 shards. We are starting to see that index size is growing so huge and when looked at the file system solr has created several copies of the index. However using solr admin, I could see its using only on the them. This is what I see in solr admin. Index: /opt/solr/collections/aq-collection/data/index.20140725024044234 Master (Searching) 1406320016969 Gen - 81553 size -58.72 GB. But when I go in to the file system , This is how it looks. 16G index.20140527220456134 45G index.20140630001131038 4.6G index.20140630090031282 20G index.20140703192128959 1.3G index.20140703200948410 31G index.20140708162308859 52G index.20140716165801658 59G index.20140725024044234 4K index.properties 4K replication.properties it is actually pointing only to the index.20140725024044234, and using that for searching and indexing. The timstamps on other indexes are old(about a month or so) Can some one explain me why it created so many copies of the index(we did not create them manually). and how it can be prevented. Our solr instances are running on solaris VMs -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-cloud-creating-multiple-copies-of-the-same-index-tp4149264.html Sent from the Solr - User mailing list archive at Nabble.com.
