RE: Importing Big Data From Berkeley DB to Solr

2011-11-09 Thread Carey Sublette
@lucene.apache.org Subject: Re: Importing Big Data From Berkeley DB to Solr Carey, Some options: * Just read your BDB and use SolrJ to index to Solr in batches and in parallel * Dump your BDB into csv format and use Solr's ability to import csv files fast * Use Hadoop MapReduce to index to Lucene or

Re: Importing Big Data From Berkeley DB to Solr

2011-11-09 Thread Otis Gospodnetic
blette >To: "solr-user@lucene.apache.org" >Sent: Wednesday, November 9, 2011 3:06 PM >Subject: Importing Big Data From Berkeley DB to Solr > >Hi: > >I have a massive data repository (hundreds of millions of records) stored in >Berkeley DB with Java code to access i

Importing Big Data From Berkeley DB to Solr

2011-11-09 Thread Carey Sublette
Hi: I have a massive data repository (hundreds of millions of records) stored in Berkeley DB with Java code to access it, and I need an efficient method to import it into Solr for indexing. I cannot find a straightforward Java data import API that I can load the data with. There is no JDBC for