Re: Can we retrieve deleted records before optimized

2012-10-17 Thread Dmitry Kan
You could split your index. There are some tools available, e.g. this one on github https://github.com/HON-Khresmoi/hash-based-index-splitter does hash based index splitting. You could probably start with the tool and modify it for your needs (like moving docs with certain timestamp criteria to ano

Re: Can we retrieve deleted records before optimized

2012-10-16 Thread Zeng Lames
Thanks kan for your prompt help. It is really a great solution to recovery those deleted records. Another question is about Solr history data housekeep problem. the scenario is as below: we have a solr core to store biz records, which is large volume that the index files is more than 50GB in one

Re: Can we retrieve deleted records before optimized

2012-10-16 Thread Dmitry Kan
Hello, One approach (not a solrish one, but still) would be to use Lucene API and set up an IndexReader onto the solr index in question. You can then do: [code] Directory indexDir = FSDirectory.open(new File(pathToDir)); IndexReader input = IndexReader.open(indexDir, true); FieldSelector fieldSe