Re: DataImportHandler Questions-Load data in parallel and temp tables

2009-11-16 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Mon, Nov 16, 2009 at 6:25 PM, amitj wrote: > > Is there also a way we can include some kind of annotation on the schema > field and send the data retrieved for that field to an external application. > We have a requirement where we require some data fields (out of the fields > for an entity def

Re: DataImportHandler Questions-Load data in parallel and temp tables

2009-11-16 Thread amitj
Is there also a way we can include some kind of annotation on the schema field and send the data retrieved for that field to an external application. We have a requirement where we require some data fields (out of the fields for an entity defined in data-config.xml) to act as entities for entity e

Re: DataImportHandler Questions-Load data in parallel and temp tables

2009-04-28 Thread Noble Paul നോബിള്‍ नोब्ळ्
writing to a remote Solr through SolrJ is in the cards. I may even take it up after 1.4 release. For now your best bet is to override the class SolrWriter and override the corresponding methods for add/delete. On Wed, Apr 29, 2009 at 2:06 AM, Amit Nithian wrote: > I do remember LuSQL and a discus

Re: DataImportHandler Questions-Load data in parallel and temp tables

2009-04-28 Thread Amit Nithian
I do remember LuSQL and a discussion regarding the performance implications of using it compared to the DIH. My only reason to stick with DIH is that we may have other data sources for document loading in the near term that may make LuSQL too specific for our needs. Regarding the bug to write to t

Re: DataImportHandler Questions-Load data in parallel and temp tables

2009-04-28 Thread Glen Newton
Amit, You might want to take a look at LuSql[1] and see if it may be appropriate for the issues you have. thanks, Glen [1]http://lab.cisti-icist.nrc-cnrc.gc.ca/cistilabswiki/index.php/LuSql 2009/4/27 Amit Nithian : > All, > I have a few questions regarding the data import handler. We have some

Re: DataImportHandler Questions-Load data in parallel and temp tables

2009-04-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
there is an issue already to write to the index in a separate thread. https://issues.apache.org/jira/browse/SOLR-1089 On Tue, Apr 28, 2009 at 4:15 AM, Shalin Shekhar Mangar wrote: > On Tue, Apr 28, 2009 at 3:43 AM, Amit Nithian wrote: > >> All, >> I have a few questions regarding the data impor

Re: DataImportHandler Questions-Load data in parallel and temp tables

2009-04-27 Thread Shalin Shekhar Mangar
On Tue, Apr 28, 2009 at 3:43 AM, Amit Nithian wrote: > All, > I have a few questions regarding the data import handler. We have some > pretty gnarly SQL queries to load our indices and our current loader > implementation is extremely fragile. I am looking to migrate over to the > DIH; however, I