Re: Aggregated indexing of updating RSS feeds

Am 17.11.2011 11:53, schrieb sbarriba: The 'params' logging pointer was what I needed. So for reference its not a good idea to use a 'wget' command directly in a crontab. I was using: wget http://localhost/solr/myfeed?command=full-import&rows=5000&clean=false :)) I think the shell handled the

Re: Aggregated indexing of updating RSS feeds

g this into a separate shell script, wrapping the URL in quotes and calling that resolved the issue. Thanks very much. -- View this message in context: http://lucene.472066.n3.nabble.com/Aggregated-indexing-of-updating-RSS-feeds-tp3485335p3515388.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Aggregated indexing of updating RSS feeds

: ..but the request I'm making is.. : /solr/myfeed?command=full-import&rows=5000&clean=false : : ..note the clean=false. I see it, but i also see this in the logs you provided... : INFO: [] webapp=/solr path=/myfeed params={command=full-import} status=0 : QTime=8 ...which means someone somewhe

Re: Aggregated indexing of updating RSS feeds

message in context: http://lucene.472066.n3.nabble.com/Aggregated-indexing-of-updating-RSS-feeds-tp3485335p3512260.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Aggregated indexing of updating RSS feeds

-- View this message in context: http://lucene.472066.n3.nabble.com/Aggregated-indexing-of-updating-RSS-feeds-tp3485335p3495882.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Aggregated indexing of updating RSS feeds

ed. I loaded the following URL... > > http://localhost:8983/solr/rss/dataimport?clean=false&command=full-import > > ...then waited a while for the feed to cahnge, and then loaded that URL > again. The number of documents (returned by a *:* query) increased after > t

Re: Aggregated indexing of updating RSS feeds

: We've successfully setup Solr 3.4.0 to parse and import multiple news : RSS feeds (based on the slashdot example on : http://wiki.apache.org/solr/DataImportHandler) using the HttpDataSource. : The objective is for Solr to index ALL news items published on this feed : (ever) - not just the cu

Re: Aggregated indexing of updating RSS feeds

#x27; parameter was intended to control this. Regards, Shaun -- View this message in context: http://lucene.472066.n3.nabble.com/Aggregated-indexing-of-updating-RSS-feeds-tp3485335p3487969.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Aggregated indexing of updating RSS feeds

Any options that do not require adding new software? On Mon, Nov 7, 2011 at 11:11 AM, Nagendra Nagarajayya < nnagaraja...@transaxtions.com> wrote: > Shaun: > > You should try NRT available with Solr with RankingAlgorithm here. You > should be able to add docs in real time and also query them in r

Re: Aggregated indexing of updating RSS feeds

Shaun: You should try NRT available with Solr with RankingAlgorithm here. You should be able to add docs in real time and also query them in real time. If DIH does not retain the old index, you may be able to convert the rss fields to a XML format as needed by Solr and update the docs (make

Aggregated indexing of updating RSS feeds

Hi all, We've successfully setup Solr 3.4.0 to parse and import multiple news RSS feeds (based on the slashdot example on http://wiki.apache.org/solr/DataImportHandler) using the HttpDataSource. The objective is for Solr to index ALL news items published on this feed (ever) - not just the curre