Re: Recover crashed solr index

2009-05-28 Thread Wang Guangchen
hi Mike and Yonik , There is no other exceptions other than missing segments_cje. the disk still have 160G more spaces when the disk crash. current these is only one solr core that accessing this index directory. so it can't be the file lock problem. I am not sure is considered as unusual config

Re: Recover crashed solr index

2009-05-28 Thread Yonik Seeley
On Wed, May 27, 2009 at 5:49 AM, Michael McCandless wrote: > Hmm... so in fact it looks like Solr had done a number of commits > already (especially, given how large your generation is -- the "cje" > in segments_cje means there were a number of commits). > > Were there any other exceptions leading

Re: Recover crashed solr index

2009-05-27 Thread Michael McCandless
Hmm... so in fact it looks like Solr had done a number of commits already (especially, given how large your generation is -- the "cje" in segments_cje means there were a number of commits). Were there any other exceptions leading up to this? Disk full? Anything unusual in your Solr configuration?

Re: Recover crashed solr index

2009-05-26 Thread Wang Guangchen
Hi Mike, The index is autoCommit every 1000 docs. I set this to increase the indexing speed. What is the best configuration do you suggest for each commit cycle? Thank you very much for your help. Following is the original exception: java.lang.RuntimeException: java.io.FileNotFoundException: /s

Re: Recover crashed solr index

2009-05-26 Thread Michael McCandless
It sounds like you had never committed while building the original index? Unfortunately, it's not easy to recover an index in that state. It's best to periodically commit if you're building such a large index. Do you have the original exception you hit? I'll fix CheckIndex to be more sane if it

Re: Recover crashed solr index

2009-05-25 Thread Wang Guangchen
Hi peter, Thank you very much for your quick reply. I tried the CheckIndex method. It can't work on my crashed index. In the error message, it says the segments file in the directory is missing. and when I use the -fix param, new segments file still can't be write. I even try the CheckIndex witho

Re: Recover crashed solr index

2009-05-25 Thread Peter Wolanin
you can use the lucene jar with solr to invoke the CheckIndex method - this will possibly allow you to recover if you pass the -fix param. You may lose some docs, however, so this is only viable if you can, for example, query to check what's missing. The command looks like (from the root of the

Recover crashed solr index

2009-05-25 Thread Wang Guangchen
Hi everyone, I have 8m docs to index, and each doc is around 50kb. The solr crashed in the middle of indexing. error message said that one of the file in the data directory is missing. I don't know why this is happened. So right now I have to find a way to recover the index to avoid re-index. Is