Re: Indexing and searching of sharded/ partitioned databases and tables

2009-10-07 Thread Jayant Kumar Gandhi
Thanks guys. Now I can easily search thru 10TB of my personal photos, videos, music and other stuff :) At some point I had split them into multiple db and tables and inserts to a single db/ table were taking too much time once the index grew beyond 1gig. I was storing all the possible metadata abo

Re: Indexing and searching of sharded/ partitioned databases and tables

2009-10-07 Thread Shalin Shekhar Mangar
On Wed, Oct 7, 2009 at 5:09 PM, Sandeep Tagore wrote: > > You can write an automated program which will change the DB conf details in > that xml and fire the full import command. You can use > http://localhost:8983/solr/dataimport url to check the status of the data > import. > > Also note that fu

Re: Indexing and searching of sharded/ partitioned databases and tables

2009-10-07 Thread Shalin Shekhar Mangar
On Wed, Oct 7, 2009 at 5:09 PM, Sandeep Tagore wrote: > > Hi Jayant, > You can use Solr to achieve your objective. > The data-config.xml which you posted is incomplete. > > Sandeep, the data-config that Jayant posted is not incomplete. The declaration is not necessary if the name of the column in

Re: Indexing and searching of sharded/ partitioned databases and tables

2009-10-07 Thread Sandeep Tagore
-sharded--partitioned-databases-and-tables-tp25782544p25783916.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Indexing and searching of sharded/ partitioned databases and tables

2009-10-07 Thread Shalin Shekhar Mangar
Comments inline: On Wed, Oct 7, 2009 at 2:01 PM, Jayant Kumar Gandhi wrote: > > Lets say I have 3 mysql databases each with 3 tables. > > Db1 : Tbl1, Tbl2, Tbl3 > Db2 : Tbl1, Tbl2, Tbl3 > Db3 : Tbl1, Tbl2, Tbl3 > > All databases have the same number of tables with same table names as > shown abov

Indexing and searching of sharded/ partitioned databases and tables

2009-10-07 Thread Jayant Kumar Gandhi
Hi All, I am new to Solr. I looking forward for Solr to index data that is partitioned into multiple databases and tables and have questions regarding dataconfig.xml. I have given the doubts at the end. Lets say I have 3 mysql databases each with 3 tables. Db1 : Tbl1, Tbl2, Tbl3 Db2 : Tbl1, Tbl2