RE: Importing Big Data From Berkeley DB to Solr

2011-11-09 Thread Carey Sublette
@lucene.apache.org Subject: Re: Importing Big Data From Berkeley DB to Solr Carey, Some options: * Just read your BDB and use SolrJ to index to Solr in batches and in parallel * Dump your BDB into csv format and use Solr's ability to import csv files fast * Use Hadoop MapReduce to index to Lucene or

Re: Importing Big Data From Berkeley DB to Solr

2011-11-09 Thread Otis Gospodnetic
Carey, Some options: * Just read your BDB and use SolrJ to index to Solr in batches and in parallel * Dump your BDB into csv format and use Solr's ability to import csv files fast * Use Hadoop MapReduce to index to Lucene or Solr in parallel Yes, you can index using Lucene APIs directly, but you