On 4/20/2010 9:09 PM, caman wrote:
Shawn,
Is this your custom implementation?
"For a delta-import, minDid comes from
the maxDid value stored after the last successful import."
Are you updating the dataTable after the import was successful? How did you
handle this? I have similar scenario and y
Hey Shawn,
Thanks for the tip. This will work nicely.
I totally missed the ability to use request parameters using
${dataimporter.request.* }
This way, I can maintain my own last_index_time timestamp outside of the
DIH properties file.
Much appreciation
Regards,
Michael
On 21/04/10 09
will work for my
use-case as well
thanks
From: Shawn Heisey-4 [via Lucene]
[mailto:ml-node+738653-1765413222-124...@n3.nabble.com]
Sent: Tuesday, April 20, 2010 4:35 PM
To: caman
Subject: Re: DIH dataimport.properties with
Michael,
The SolrEntityProcessor looks very
Please file a JIRA asking for the ability to direct what is saved in
the DIH properties file. It should be possible to use your own
timestamp or generated id.
On 4/20/10, Shawn Heisey wrote:
> Michael,
>
> The SolrEntityProcessor looks very intriguing, but it won't work with
> the released 1.4 ve
Michael,
The SolrEntityProcessor looks very intriguing, but it won't work with
the released 1.4 version. If that's OK with you and it looks like it'll
do what you want, feel free to ignore the rest of this.
I'm also using MySQL as an import source for Solr. I was unable to use
the last_ind
I don't really understand how this will help. Can you elaborate ?
Do you mean that the last_index_time can be imported from somewhere
outside solr? But I need to be able to *set* what last_index_time is
stored in dataimport.properties, not get properties from somewhere else
On 18/04/10 10:
Because there is a lot of data, and for scalability reasons we want all
non-write operations to happen from a slave - we don't want to be using
the master unless necessary
On 17/04/10 08:28, Otis Gospodnetic wrote:
Hm, why not just go to the MySQL master then?
Otis
Sematext :: http://se
The SolrEntityProcessor allows you to query a Solr instance and use
the results as DIH properties. You would have to create your own
regular query to do the delta-import instead of using the delta-import
feature.
https://issues.apache.org/jira/browse/SOLR-1499
On 4/16/10, Otis Gospodnetic wrote:
Hm, why not just go to the MySQL master then?
Otis
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Hadoop ecosystem search :: http://search-hadoop.com/
- Original Message
> From: Michael Tibben
> To: solr-user@lucene.apache.org
> Sent: Thu, April 15, 2010 10:15:14 PM
>
