Re: Indexing multiple cores simultaneously

2015-10-25 Thread Erick Erickson
Let's back up a bit and ask what your primary goal is. Just indexing a bunch of stuff as fast as possible? By and large, I'd index to a single core with multiple threads rather than the approach you're taking (I'm assuming that there's a MERGEINDEXES somewhere in this process). You should be able t

Indexing multiple cores simultaneously

2015-10-25 Thread Peri Subrahmanya
Hi, I wanted to check if the following would work; 1. Spawn n threads 2. Create n-cores 3. Index n records simultaneously in n-cores 4. Merge all core indexes into a single master core I have been able to successfully do this for 5 threads (5 cores) with 1000 documents each. However, I wanted