Re: MongoDB and Solr - Massive re-indexing

2016-06-02 Thread Shawn Heisey
On 6/2/2016 11:56 AM, Robert Brown wrote: > My question is whether sending batches of 1,000 documents to Solr is > still beneficial (thinking about docs that may not change), or if I > should look at the MongoDB connector for Solr, based on the volume of > incoming data we see. > > Would the connec

MongoDB and Solr - Massive re-indexing

2016-06-02 Thread Robert Brown
Hi, Currently we import data-sets from various sources (csv, xml, json, etc.) and POST to Solr, after some pre-processing to get it into a consistent format, and some other transformations. We currently dump out to a json file in batches of 1,000 documents and POST that file to Solr. Rough