Re: How to index 20 000 files with a command line ?

2015-05-29 Thread Sergey Shvets
Hello Bruno, You can use find command with exec attribute. regards Sergey Friday, May 29, 2015, 3:11:37 PM, you wrote: Dear Solr Users, Habitualy i use this command line to index my files: >bin/post -c hbl /data/hbl-201522/*.xml but today I have a big update, so there are 20 000 xml files (

Re: Indexing gets significantly slower after every batch commit

2015-05-21 Thread Sergey Shvets
Hi Angel We also noticed that kind of performance degrade in our workloads. Which is logical as index growth and time needed to put something to it is log(n) четверг, 21 мая 2015 г. пользователь Angel Todorov написал: > hi Shawn, > > Thanks a bunch for your feedback. I've played with the heap

Re: Solr hangs / LRU operations are heavy on cpu

2015-03-20 Thread Sergey Shvets
Hello Shawn, In that case it makes it a bit strange the behavior as it was noticed. LRU was heavy on the CPU in threads dump, and I don't have any reasonable explanation for that. However switch to LFU seemingly solved the case. -- Best regards, Sergeymail

Re: Solr hangs / LRU operations are heavy on cpu

2015-03-20 Thread Sergey Shvets
Hello Umesh, Thank you, indeed that gave positive results so far. we changed completely to LFU. Today it went quite okay. We wait till it shows more stability and then work out the optimal cache size. Below is a summary of the changes. - - - - + + + + + -- Best regards, Sergey

Solr hangs / LRU operations are heavy on cpu

2015-03-19 Thread Sergey Shvets
Hi, we have quite a problem with Solr. We are running it in a config 6x3, and suddenly solr started to hang, taking all the available cpu on the nodes. In the threads dump noticed things like this can eat lot of CPU time - org.apache.solr.search.LRUCache.put​(LRUCache.java:116) - org.a