Re: Interesting DIH challenge

2011-10-11 Thread Chantal Ackermann
Hi Gora, sure, glad to be of help. If you find any problems with the xslt it would be great if you could notify me. I remember having problems with empty fields (see SOLR-1790: https://issues.apache.org/jira/browse/SOLR-1790 ). I think my solution was to make sure that the response of the source

Re: Interesting DIH challenge

2011-10-10 Thread Gora Mohanty
On Mon, Oct 10, 2011 at 4:40 PM, Chantal Ackermann wrote: [...] > (2) response-to-update.xsl (this goes into > $SOLR_HOME/sourceCore/conf/xslt/): [...] Thanks for sharing that, and will check it out when possible. This looks like it would be very useful, as we once rolled our own half-baked, no

Re: Interesting DIH challenge

2011-10-10 Thread Chantal Ackermann
Hi there, I have been using cores to built up new cores (because of various reasons). (I am not using SOLR as data storage, the cores are re-indexed frequently.) This solution works for releases 1.4 and 3 as it does not use the SolrEntityProcessor. To load data from another SOLR core and populat

Re: Interesting DIH challenge

2011-10-10 Thread Ahmet Arslan
> Oh also: Does DIH have any > experimental way for folks to be reading data > from one solr core and then massaging it and importing it > into another core? SolrEntityProcessor can do that. https://issues.apache.org/jira/browse/SOLR-1499

Re: Interesting DIH challenge

2011-10-09 Thread Gora Mohanty
On Mon, Oct 10, 2011 at 6:30 AM, Pulkit Singhal wrote: > @Gora Thank You! > > I know that Solr accepts xml with Solr specific elements that are commands > that only it understands ... such as , etc. > > Question: Is there some way to ask Solr to dump out whatever it has in its > index already ...

Re: Interesting DIH challenge

2011-10-09 Thread Shawn Heisey
On 10/9/2011 7:00 PM, Pulkit Singhal wrote: I know that Solr accepts xml with Solr specific elements that are commands that only it understands ... such as, etc. Question: Is there some way to ask Solr to dump out whatever it has in its index already ... as a Solr xml document? Plan: I intend

Re: Interesting DIH challenge

2011-10-09 Thread Pulkit Singhal
Oh also: Does DIH have any experimental way for folks to be reading data from one solr core and then massaging it and importing it into another core? If not, then would that be a good addition or just a waste of time for some architectural reason? On Sun, Oct 9, 2011 at 8:00 PM, Pulkit Singhal wro

Re: Interesting DIH challenge

2011-10-09 Thread Pulkit Singhal
@Gora Thank You! I know that Solr accepts xml with Solr specific elements that are commands that only it understands ... such as , etc. Question: Is there some way to ask Solr to dump out whatever it has in its index already ... as a Solr xml document? Plan: I intend to message that xml dump (a

Re: Interesting DIH challenge

2011-10-09 Thread Gora Mohanty
On Mon, Oct 10, 2011 at 1:17 AM, Pulkit Singhal wrote: > Hello Folks, > > I'm a big DIH fan but I'm fairly sure that now I've run into a scenario > where it can't help me anymore ... but before I give up and roll my own > solution, I jsut wanted to check with everyone else. > > The scenario: > - a

Interesting DIH challenge

2011-10-09 Thread Pulkit Singhal
Hello Folks, I'm a big DIH fan but I'm fairly sure that now I've run into a scenario where it can't help me anymore ... but before I give up and roll my own solution, I jsut wanted to check with everyone else. The scenario: - already have 1M+ documents indexed - the schema.xml needs to have one m