Solr index
Hi , I'm using Nutch to crawl a list of web sites. Solr is my index(Nutch-1.0 integration with solr). I'm working on detecting web site defacement(if there's any changes in the text of a web page). I want to know if solr may give me the possibility to detect the changes in the Documents in the indexe before commiting or a log file or something like that(the text that has been changed between two points of time ). I'm looking for your help. Thanks a lot. -- View this message in context: http://www.nabble.com/Solr-index-tp23219842p23219842.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr index
Thanks a lot, I have made a look in these classes. But what I exactly want to do is to detect if a Document(in the index of solr)has changed when I recrawl a site with Nutch. Not to block deduplication, but to detect if a Document has changed and extract changes in a file without writing them over the old Document. After that I decide wether to rewrite the Document or to keep both of them the old and the new one. I wish I am more precise. Thanks and permit my poor english. -- View this message in context: http://www.nabble.com/Solr-index-tp23219842p23254601.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr search by segment
Hi,
I have an index in wich I am always indexing the same documents
(re-indexing).
So I need to search for them by their number of segment.
When I ask solrj for the documents by their segment [for example:
solrj.query("segment:20090603142546");] , he doesn't return any thing. I
checked the schema.xml and the field segment is stored and indexed.
What may I do?
I am looking for your help. Thanks.
--
View this message in context:
http://www.nabble.com/Solr-search-by-segment-tp23856569p23856569.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr search by segment
Yes it's already defined as String: When I make query by id or url it works but not the segment... -- View this message in context: http://www.nabble.com/Solr-search-by-segment-tp23856569p23859699.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr search by segment
I must precise that I am running nutch-solr-integration and both schema.xml are the same in nutch or in solr. -- View this message in context: http://www.nabble.com/Solr-search-by-segment-tp23856569p23859728.html Sent from the Solr - User mailing list archive at Nabble.com.
