Re: Solr Logging files get high

2015-02-03 Thread Nitin Solanki
Thanks Michael Della Bitta. Hi. Mike Sokolov, There is no DEBUG appears inside logs.. On Tue, Feb 3, 2015 at 10:06 PM, Michael Della Bitta < michael.della.bi...@appinions.com> wrote: > If you're trying to do a bulk ingest of data, I recommend committing less > frequently.

Re: Solr Logging files get high

2015-02-03 Thread Michael Della Bitta
If you're trying to do a bulk ingest of data, I recommend committing less frequently. Don't soft commit at all until the end of the batch, and hard commit every 60 seconds. Michael Della Bitta Senior Software Engineer o: +1 646 532 3062 appinions inc. “The Science of Influence Marketing” 18 E

Re: Solr Logging files get high

2015-02-03 Thread Nishanth S
I feel the tlog size is perfectly fine since your hard commit interval is low.You can try increasing your hard commit and soft commit values.Soft commit of 1 sec is very low.Soft commit is about visibility of documents,so you can try and increase this as far your slas. -Nishanth On Mon, Feb 2,

Re: Solr Logging files get high

2015-02-02 Thread Nitin Solanki
Hi Michael Della and Michael Sokolov, *size of tlog :-* 56K/mnt/nitin/solr/node1/solr/wikingram_shard3_replica1/data/tlog/ 56K/mnt/nitin/solr/node1/solr/wikingram_shard7_replica1/data/tlog/ 56K/mnt/nitin/solr/node2/solr/wikingram_shard4_replica1/data/tlog/ 52K/mnt/nitin/solr/node2/

Re: Solr Logging files get high

2015-02-02 Thread Michael Della Bitta
Good call, it could easily be the tlog Nitin is talking about. As for which definition of high, I was making assumptions as well. :) Michael Della Bitta Senior Software Engineer o: +1 646 532 3062 appinions inc. “The Science of Influence Marketing” 18 East 41st Street New York, NY 10017 t:

Re: Solr Logging files get high

2015-02-02 Thread Michael Sokolov
I was tempted to suggest rehab -- but seriously it wasn't clear if Nitin meant the log files Michael is referring to, or the transaction log (tlog). If it's the transaction log, the solution is more frequent hard commits. -Mike On 2/2/2015 11:48 AM, Michael Della Bitta wrote: If you'd like

Re: Solr Logging files get high

2015-02-02 Thread Michael Della Bitta
If you'd like to reduce the amount of lines Solr logs, you need to edit the file example/resources/log4j.properties in Solr's home directory. Change lines that say INFO to WARN. Michael Della Bitta Senior Software Engineer o: +1 646 532 3062 appinions inc. “The Science of Influence Marketing”