RE: Data Import Handler Stays Idle

2015-08-28 Thread Allison, Timothy B.
ll the contents of those zips and concatenate the extracted text into one string. -Original Message- From: Shawn Heisey [mailto:apa...@elyograg.org] Sent: Tuesday, July 21, 2015 10:41 AM To: solr-user@lucene.apache.org Subject: Re: Data Import Handler Stays Idle On 7/21/2015 8:17 AM, Pade

RE: Data Import Handler Stays Idle

2015-08-28 Thread Allison, Timothy B.
Tuesday, July 21, 2015 10:41 AM To: solr-user@lucene.apache.org Subject: Re: Data Import Handler Stays Idle On 7/21/2015 8:17 AM, Paden wrote: > There are some zip files inside the directory and have been addressed > to in the database. I'm thinking those are the one's it's jumping

Re: Data Import Handler Stays Idle

2015-07-21 Thread Paden
Hey shawn when I use the -m 2g command in my script I get the error a 'cannot open [path]/server/logs/solr.log for reading: No such file or directory' I do not see how this would affect that. -- View this message in context: http://lucene.472066.n3.nabble.com/Data-Import-Handler-Stays-Idle-tp4

Re: Data Import Handler Stays Idle

2015-07-21 Thread Paden
Okay. I'm going to run the index again with specifications that you recommended. This could take a few hours but I will post the entire trace on that error when it pops up again and I will let you guys know the results of increasing the heap size. -- View this message in context: http://lucene

Re: Data Import Handler Stays Idle

2015-07-21 Thread Shawn Heisey
On 7/21/2015 8:17 AM, Paden wrote: > There are some zip files inside the directory and have been addressed to in > the database. I'm thinking those are the one's it's jumping right over. They > are not the issue. At least I'm 95% sure. And Shawn if you're still watching > I'm sorry I'm using solr-5

Re: Data Import Handler Stays Idle

2015-07-21 Thread Paden
There are some zip files inside the directory and have been addressed to in the database. I'm thinking those are the one's it's jumping right over. They are not the issue. At least I'm 95% sure. And Shawn if you're still watching I'm sorry I'm using solr-5.1.0. -- View this message in context:

Re: Data Import Handler Stays Idle

2015-07-20 Thread Raja Pothuganti
>Yes the number of unimported matches (with IOExceptions) What is the IOException about? On 7/20/15, 5:10 PM, "Paden" wrote: >Yes the number of unimported matches. No I did not specify "false" to >commit >on any of my dataimporthandler. Since it defaults to true I really didn't >take it into ac

Re: Data Import Handler Stays Idle

2015-07-20 Thread Paden
Yes the number of unimported matches. No I did not specify "false" to commit on any of my dataimporthandler. Since it defaults to true I really didn't take it into account though. -- View this message in context: http://lucene.472066.n3.nabble.com/Data-Import-Handler-Stays-Idle-tp4218250p42182

Re: Data Import Handler Stays Idle

2015-07-20 Thread Raja Pothuganti
Number of Ioexceptions , are they equal to un-imported/un processed documents? By any chance commit set to false in import request example: http://localhost:8983/solr/db/dataimport?command=full-import&commit=false Thanks Raja On 7/20/15, 4:51 PM, "Paden" wrote: >I was consistently checking th

Re: Data Import Handler Stays Idle

2015-07-20 Thread Paden
I was consistently checking the logs to see if there were any errors that would give me any idling. There were no errors except for a few skipped documents due to some Illegal IOexceptions from Tika but none of those occurred around the time that solr began idling. A lot of font warnings. But again

Re: Data Import Handler Stays Idle

2015-07-20 Thread Shawn Heisey
On 7/20/2015 3:03 PM, Paden wrote: > I'm currently trying to index about 54,000 files with the Solr Data Import > Handler and I've got a small problem. It fetches about half (28,289) of the > 54,000 files and it process about 14,146 documents before it stops and just > stands idle. Here's the statu