Solr file size limit?

2012-04-18 Thread Bram Rongen
ight direction? I've already asked my question on stackoverflow without receiving a solution: http://stackoverflow.com/questions/9993633/apache-solr-3-5-hangs-when-indexing. Maybe it can provide you with some more information. Kind regards! Bram Rongen

Re: Solr file size limit?

2012-04-19 Thread Bram Rongen
p://pastebin.com/GeBrB903 http://pastebin.com/Su8q1WAh Kind regards, Bram Rongen On Wed, Apr 18, 2012 at 10:54 PM, Shawn Heisey wrote: > On 4/18/2012 6:17 AM, Bram Rongen wrote: > >> I've been using Solr for a very short time now and I'm stuck. I'm trying >> to &

Re: Solr file size limit?

2012-04-19 Thread Bram Rongen
I've discovered some documents are 100+MB in size.. Could this be the problem? On Thu, Apr 19, 2012 at 3:49 PM, Bram Rongen wrote: > Hello Shawn, > > Thanks very much for your answer. > > Yesterday I've started indexing again but this time on Solr 3.6.. Again > Sol

Re: Solr file size limit?

2012-04-20 Thread Bram Rongen
gt; Good point! Do you store the large file in your documents, or just index > them? > > Do you have a "largest file" limit in your environment? Try this: > ulimit -a > > What is the "file size"? > > On Thu, Apr 19, 2012 at 8:04 AM, Shawn Heisey wrote: &g

Re: Solr file size limit?

2012-04-20 Thread Bram Rongen
Hmm, reading your reply again I see that Solr only uses the first 10k tokens from each field so field length should not be a problem per se.. It could be my document contain very large tokens and unorganized tokens, could this startle Solr? On Fri, Apr 20, 2012 at 2:03 PM, Bram Rongen wrote

Re: Solr file size limit?

2012-05-10 Thread Bram Rongen
Hi Guys! I've removed the two largest documents which were very large. One of which consisted of 1 field and was around 4MB (text).. This fixed my issue.. Kind regards, Bram Rongen On Fri, Apr 20, 2012 at 2:09 PM, Bram Rongen wrote: > Hmm, reading your reply again I see that Solr o