Re: Full index xreation is deleting documents

2019-03-04 Thread Erick Erickson
rwood.org] > Gesendet: Montag, 4. März 2019 17:29 > An: solr-user@lucene.apache.org > Betreff: Re: Full index xreation is deleting documents > > Do you update documents? That deletes the old and adds the new. > > wunder > Walter Underwood > wun...@wunderwood.org > htt

AW: Full index xreation is deleting documents

2019-03-04 Thread Juergen Melzer (DPDHL IT Services)
@lucene.apache.org Betreff: Re: Full index xreation is deleting documents Do you update documents? That deletes the old and adds the new. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Mar 4, 2019, at 8:27 AM, Juergen Melzer (DPDHL IT Services) > wrote: &

Re: Full index xreation is deleting documents

2019-03-04 Thread Walter Underwood
Do you update documents? That deletes the old and adds the new. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Mar 4, 2019, at 8:27 AM, Juergen Melzer (DPDHL IT Services) > wrote: > > Hi all > > We have a strange situation. When we are creating t

Full index xreation is deleting documents

2019-03-04 Thread Juergen Melzer (DPDHL IT Services)
Hi all We have a strange situation. When we are creating the index we see a lot of documents that are marked as deleted. But we don't delete any document while we are adding documents. We are thinking about the uniquekey that might be that problem. Is there any restriction regarding using a uni

Re: Adding and deleting documents in the same update request

2019-01-27 Thread Luiz Armesto
__ > From: Shawn Heisey > Sent: Wednesday, January 23, 2019 3:33 PM > To: solr-user@lucene.apache.org > Subject: Re: Adding and deleting documents in the same update request > > On 1/23/2019 5:58 AM, Andreas Nilsson wrote: > > Related: in the case where I cannot rely on

Re: Adding and deleting documents in the same update request

2019-01-27 Thread Andreas Nilsson
ache.org Subject: Re: Adding and deleting documents in the same update request On 1/23/2019 5:58 AM, Andreas Nilsson wrote: > Related: in the case where I cannot rely on the operations order in a single > update request, is there a recommended way to do these kinds of updates > "atomicall

Re: Adding and deleting documents in the same update request

2019-01-23 Thread Shawn Heisey
On 1/23/2019 5:58 AM, Andreas Nilsson wrote: Related: in the case where I cannot rely on the operations order in a single update request, is there a recommended way to do these kinds of updates "atomically" in a single request? Ideally, I obviously don't want the collection to be left in a stat

Adding and deleting documents in the same update request

2019-01-23 Thread Andreas Nilsson
Hi all, I am updating a Solr Collection (Solr 7.3.1 in Cloud mode using SolrJ Java API) with requests that include both adding new documents as well as deleting existing ones (by query). The deletion part is meant to make sure any earlier revisions of the indexed source are deleted as part of t

Re: Facet cache issue when deleting documents from the index

2014-02-18 Thread Marius Dumitru Florea
In the end the problem was actually in my code.. sorry for the noise. The documents were deleted from my database but not from the Solr index and I have a display filter that filters out search results that correspond to documents that don't exist any more in the database, but this filter doesn't u

Re: Facet cache issue when deleting documents from the index

2014-02-17 Thread Marius Dumitru Florea
I tried to set the expungeDeletes flag but it didn't fix the problem. The SolrServer doesn't expose a way to set this flag so I had to use: new UpdateRequest().setAction(UpdateRequest.ACTION.COMMIT, true, true, 1, true).process(solrServer); Any other hints? Note that I managed to run my test in

Re: Facet cache issue when deleting documents from the index

2014-02-17 Thread Marius Dumitru Florea
On Mon, Feb 17, 2014 at 2:00 PM, Ahmet Arslan wrote: > Hi, > > Also I noticed that in your code snippet you have server.delete("foo"); which > does not exists. deleteById and deleteByQuery methods are defined in > SolrServer implementation. Yes, sorry, I have a wrapper over the SolrInstance th

Re: Facet cache issue when deleting documents from the index

2014-02-17 Thread Ahmet Arslan
Hi, Also I noticed that in your code snippet you have server.delete("foo"); which does not exists. deleteById and deleteByQuery methods are defined in SolrServer implementation. On Monday, February 17, 2014 1:42 PM, Ahmet Arslan wrote: Hi Marius, Facets are computed from indexed terms. Can

Re: Facet cache issue when deleting documents from the index

2014-02-17 Thread Ahmet Arslan
Hi Marius, Facets are computed from indexed terms. Can you commit with expungeDeletes=true flag? Ahmet On Monday, February 17, 2014 12:17 PM, Marius Dumitru Florea wrote: Hi guys, I'm using Solr 4.6.1 (embedded) and for some reason the facet cache is not invalidated when documents are dele

Facet cache issue when deleting documents from the index

2014-02-17 Thread Marius Dumitru Florea
Hi guys, I'm using Solr 4.6.1 (embedded) and for some reason the facet cache is not invalidated when documents are deleted from the index. Sadly, for me, I cannot reproduce this issue with an integration test like this: --8<-- SolrInstance server = getSolrInstance(); SolrInputDoc

RE: Solr 4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete by ID

2013-10-17 Thread Akkinepalli, Bharat (ELS-CON)
deleting documents using Delete by ID Thanks Bharat. This is a bug. I've opened LUCENE-5289. https://issues.apache.org/jira/browse/LUCENE-5289 On Wed, Oct 16, 2013 at 9:35 PM, Akkinepalli, Bharat (ELS-CON) < b.akkinepa...@elsevier.com> wrote: > Hi Shalin, > I am not sure why

Re: Solr 4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete by ID

2013-10-16 Thread Shalin Shekhar Mangar
Bharat Akkinepalli. > > -Original Message- > From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] > Sent: Wednesday, October 16, 2013 11:28 AM > To: solr-user@lucene.apache.org > Subject: Re: Solr 4.4 - Master/Slave configuration - Replication Issue > with Commit

RE: Solr 4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete by ID

2013-10-16 Thread Akkinepalli, Bharat (ELS-CON)
rat Akkinepalli. -Original Message- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Wednesday, October 16, 2013 11:28 AM To: solr-user@lucene.apache.org Subject: Re: Solr 4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete

Re: Solr 4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete by ID

2013-10-16 Thread Shalin Shekhar Mangar
October 11, 2013 2:16 PM > To: solr-user@lucene.apache.org > Subject: RE: Solr 4.4 - Master/Slave configuration - Replication Issue > with Commits after deleting documents using Delete by ID > > Hi Otis, > Thanks for the response. The log files can be found here. > >

RE: Solr 4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete by ID

2013-10-16 Thread Akkinepalli, Bharat (ELS-CON)
@lucene.apache.org Subject: RE: Solr 4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete by ID Hi Otis, Thanks for the response. The log files can be found here. MasterLog : http://pastebin.com/DPLKMPcF Slave Log: http://pastebin.com

RE: Solr 4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete by ID

2013-10-11 Thread Akkinepalli, Bharat (ELS-CON)
4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete by ID Bharat, Can you look at the logs on the Master when you issue the delete and the subsequent commits and share that? Otis -- Solr & ElasticSearch Support -- http://sematext.com/ Per

Re: Solr 4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete by ID

2013-10-09 Thread Otis Gospodnetic
Bharat, Can you look at the logs on the Master when you issue the delete and the subsequent commits and share that? Otis -- Solr & ElasticSearch Support -- http://sematext.com/ Performance Monitoring -- http://sematext.com/spm On Tue, Oct 8, 2013 at 3:57 PM, Akkinepalli, Bharat (ELS-CON) wrot

Solr 4.4 - Master/Slave configuration - Replication Issue with Commits after deleting documents using Delete by ID

2013-10-08 Thread Akkinepalli, Bharat (ELS-CON)
Hi, We have recently migrated from Solr 3.6 to Solr 4.4. We are using the Master/Slave configuration in Solr 4.4 (not Solr Cloud). We have noticed the following behavior/defect. Configuration: === 1. The Hard Commit and Soft Commit are disabled in the configuration (we control

Re: DIH deleting documents

2013-02-25 Thread cveres
Thanks Arcadius, Excellent suggestion about the view.I'll try to simplify things and see how I go. thanks, Csaba -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-deleting-documents-tp4041811p4042663.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: DIH deleting documents

2013-02-23 Thread Arcadius Ahouansou
ta > straight from Solr. > > thanks, Csaba > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/DIH-deleting-documents-tp4041811p4042426.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: DIH deleting documents

2013-02-23 Thread cveres
://lucene.472066.n3.nabble.com/DIH-deleting-documents-tp4041811p4042426.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: DIH deleting documents

2013-02-22 Thread Gora Mohanty
On 22 February 2013 12:11, cveres wrote: > I should also add that some of the books don't have chapters, so the query > won't succeed for these books. > But in this case I expected that the document won't be added at all .. > rather than first added then deleted (which I am now suspecting is the >

Re: DIH deleting documents

2013-02-21 Thread cveres
f I could see a list of deleted documents! I was trying to look in the terminal window (Jetty) but that did not help. I don't know where else Solr might put logs. I looked in /var/log.. but did not find anything useful looking. -- View this message in context: http://lucene.472066.n3.nab

Re: DIH deleting documents

2013-02-21 Thread cveres
the config file (the relevant part): thanks, Csaba -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-deleting-documents-tp4041811p4041996.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: DIH deleting documents

2013-02-21 Thread Arcadius Ahouansou
Hi Csaba. Would you mind posting your DIHconfig/data-config.xml and the command you use for the import? Thanks. Arcadius. On 21 February 2013 17:55, Gora Mohanty wrote: > On 21 February 2013 19:30, cveres wrote: >> Thanks Gora, >> >> Sorry I might not have been sufficiently clear. >> >> I st

Re: DIH deleting documents

2013-02-21 Thread Gora Mohanty
On 21 February 2013 19:30, cveres wrote: > Thanks Gora, > > Sorry I might not have been sufficiently clear. > > I start with an empty index, then add documents. > 9000 are added and 6000 immediately deleted again, leaving 3000. > I assume this can only happen with duplicate IDs, but that should no

Re: DIH deleting documents

2013-02-21 Thread cveres
documents so that I could try and figure out why they were deleted immediately. thanks, Csaba -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-deleting-documents-tp4041811p4041887.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: DIH deleting documents

2013-02-21 Thread Gora Mohanty
On 21 February 2013 14:27, cveres wrote: > I am adding documents with data import handler from a mysql database. I > create a unique id for each document by concatenating a couple of fields in > the database. Every id is unique. > > After the import, over half the documents which were imported are

DIH deleting documents

2013-02-21 Thread cveres
documents in the database ending up in the Solr index. Is there a way to get a list of the deleted documents, so that I can start troubleshooting what went wrong? thanks, Csaba -- View this message in context: http://lucene.472066.n3.nabble.com/DIH-deleting-documents-tp4041809.html Sent

Re: Deleting documents not shown in response?

2011-11-02 Thread Jan Høydahl
?* > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Deleting-documents-not-shown-in-response-tp3473013p3473013.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: Problems of deleting documents from Solr

2011-05-01 Thread Ahmet Arslan
@lucene.apache.org Cc: Sent: Monday, May 2, 2011 5:04 AM Subject: Problems of deleting documents from Solr Hi all, I want to update some document, so first I delete these document by invoking command "java -Ddata=args -Dcommit=yes -jar post.jar "monitor" The result is that I can not sea

Re: Problems of deleting documents from Solr

2011-05-01 Thread Otis Gospodnetic
Problems of deleting documents from Solr > > Hi all, > > I want to update some document, so first I delete these document by invoking > command "java -Ddata=args -Dcommit=yes -jar post.jar > "monitor" > The result is that I can not search the deleted documents bu

Problems of deleting documents from Solr

2011-05-01 Thread Jeff Zhang
Hi all, I want to update some document, so first I delete these document by invoking command "java -Ddata=args -Dcommit=yes -jar post.jar "monitor" The result is that I can not search the deleted documents but I can still see the terms of these document in http://localhost:8983/solr/admin/schema.j

Re: Deleting Documents with null fields by query

2010-10-11 Thread Erick Erickson
"erase all the content". Oops. first, I should look more carefully. You don't want the AND in there, use *:* -content:[* TO *] In general, don't mix and match booleans and native Lucene query syntax... Before sending this to Solr, what do you get back when you try just the query in, say, the adm

Re: Deleting Documents with null fields by query

2010-10-11 Thread Claudio Devecchi
yes.. dont work, doing it I erase all the content. :( or, another thing that will help me is to make a query that doesnt bring the null one. tks On Mon, Oct 11, 2010 at 5:27 PM, Erick Erickson wrote: > Have you tried something like: > > '*:* AND > -content:[* TO *] > > > On Mon, Oct 11, 2010 a

Re: Deleting Documents with null fields by query

2010-10-11 Thread Erick Erickson
Have you tried something like: '*:* AND -content:[* TO *] On Mon, Oct 11, 2010 at 4:01 PM, Claudio Devecchi wrote: > Hi everybody, > > I'm trying to delete by query some documents with null content (this > happened because I crawled my intranet and somethings came null) > > When I try this work

Deleting Documents with null fields by query

2010-10-11 Thread Claudio Devecchi
Hi everybody, I'm trying to delete by query some documents with null content (this happened because I crawled my intranet and somethings came null) When I try this works fine (I'm deleting from my solr index every document that dont have wiki on the field content) curl http://localhost:8983/solr/

Re: DIH - deleting documents, high performance (delta) imports, and passing parameters

2010-08-30 Thread Tommy Chheng
re goes... First off, this is not to say DIH is bad, I think it's great and it works really well for my uses, but it has a few undocumented quirks which cost me a lot of time. Deleting documents - several options: 1. the deletedPkQuery in delta import - you'll need to make a DB que

DIH - deleting documents, high performance (delta) imports, and passing parameters

2010-08-30 Thread Ephraim Ofir
has a few undocumented quirks which cost me a lot of time. Deleting documents - several options: 1. the deletedPkQuery in delta import - you'll need to make a DB query which generates the IDs to be deleted (something like: SELECT id FROM yourTable WHERE deletedFlag = 1). Make sure that you ha

Re: DIH - Deleting documents

2010-03-23 Thread André Maldonado
; >> Hy all. > >> > >> How can I delete documents when using DataImportHandler on a delta > >> import? > >> > >> Thank's > >> > >> "Então aproximaram-se os que estavam no barco, e adoraram-no, dizendo: > És >

Re: DIH - Deleting documents

2010-03-23 Thread blargy
documents when using DataImportHandler on a delta >> import? >> >> Thank's >> >> "Então aproximaram-se os que estavam no barco, e adoraram-no, dizendo: És >> verdadeiramente o Filho de Deus." (Mateus 14:33) >> > > -- View this message

Re: DIH - Deleting documents

2010-03-23 Thread Mauricio Scheffer
Take a look at the DIH special commands: http://wiki.apache.org/solr/DataImportHandler#Special_Commands Some other options: http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents Cheers, Mauricio 2010/3/2

DIH - Deleting documents

2010-03-23 Thread André Maldonado
Hy all. How can I delete documents when using DataImportHandler on a delta import? Thank's "Então aproximaram-se os que estavam no barco, e adoraram-no, dizendo: És verdadeiramente o Filho de Deus." (Mateus 14:33)

Re: Deleting documents

2009-03-31 Thread Chris Hostetter
r, but for now since you aren't sending *any* content type, it doesn't even know to look at the POST body) : Date: Thu, 26 Mar 2009 10:27:16 + : From: Rui Pereira : Reply-To: solr-user@lucene.apache.org : To: solr-user@lucene.apache.org : Subject: Re: Deleting documents : : Here

Re: Deleting documents

2009-03-26 Thread Noble Paul നോബിള്‍ नोब्ळ्
I can't make out what the obvious mistake is BTW why don't you use SolrJ? http://wiki.apache.org/solr/SolrJ --Noble On Thu, Mar 26, 2009 at 3:57 PM, Rui Pereira wrote: > Here is the code where I make the request: > Document xmlDocument = this.constructDeleteXml(); > >            try { >      

Re: Deleting documents

2009-03-26 Thread Rui Pereira
Here is the code where I make the request: Document xmlDocument = this.constructDeleteXml(); try { URL url = new URL(this.solrPath + "/update"); HttpURLConnection connection = (HttpURLConnection) url.openConnection(); connection.setDoOut

Re: Deleting documents

2009-03-25 Thread Noble Paul നോബിള്‍ नोब्ळ्
how are you posting the xml ? missing content stream means that the POST data is missing On Wed, Mar 25, 2009 at 7:03 PM, Rui Pereira wrote: > I'm trying to delete documents based on the following type of update > requests: > topologyid:3140topologyid:3142 > > This doesn't cause any changes on i

Deleting documents

2009-03-25 Thread Rui Pereira
I'm trying to delete documents based on the following type of update requests: topologyid:3140topologyid:3142 This doesn't cause any changes on index and if I try to read the response, the following error ocurs: 13:32:35,196 ERROR [STDERR] 25/Mar/2009 13:32:35 org.apache.solr.update.processor.Log

Re: solr 1.3 - did something with deleting documents change?

2009-03-01 Thread Ryan McKinley
On Feb 28, 2009, at 5:56 PM, Stephen Weiss wrote: Yeah honestly I don't know how it ever worked either. my guess is that the XPP parser did not validate anything -- when we switched to StAX it validates something... ryan

Re: solr 1.3 - did something with deleting documents change?

2009-03-01 Thread Chris Hostetter
: The notes in the wiki seem to indicate that syntax (with multiple nodes) : will be supported in Solr 1.4, not 1.3 - but I guess it really just means that : you can't combine those with a node yet. correct -- the wiki is pointing out htat you can't combine and deletes until 1.4 -- 1.3 suppo

Re: solr 1.3 - did something with deleting documents change?

2009-02-28 Thread Stephen Weiss
Yeah honestly I don't know how it ever worked either. The notes in the wiki seem to indicate that syntax (with multiple nodes) will be supported in Solr 1.4, not 1.3 - but I guess it really just means that you can't combine those with a node yet. I'll miss the deletesPending stat, I think

Re: solr 1.3 - did something with deleting documents change?

2009-02-27 Thread Chris Hostetter
: image.1image.2 etc... (one : delete node for each image we wanted to delete) : : And that worked in 1.2. that is really suprising ... it's not a legal XML doc (multiple root nodes) so it should have been an error. Support was added in Solr 1.3 to support multiple elements in a single elem

solr 1.3 - did something with deleting documents change?

2009-02-25 Thread Stephen Weiss
Hi, This might be a very silly question that's documented everywhere but I just can't find an answer right now. When we first implemented solr we used version 1.2 (of course, 1.3 was released days afterwards). In the brief period we used 1.2, whenever we wanted to delete a bunch of docum

Re: Deleting documents

2006-04-15 Thread Marcus Stratmann
Yonik Seeley wrote: > OK, I think I fixed this bug. Haven't added a test case yet... In our test case everything works properly now. Thanks for the quick bugfix! Marcus

Re: Deleting documents

2006-04-12 Thread Chris Hostetter
: OK, I think I fixed this bug. Haven't added a test case yet... : I'll get to that sometime unless someone beats me to it. : It does sort of require a separate schema to test though (which out : test harness doesn't really handle yet, I think) actually the test harness *can* handle differnet sc

Re: Deleting documents

2006-04-12 Thread Yonik Seeley
OK, I think I fixed this bug. Haven't added a test case yet... I'll get to that sometime unless someone beats me to it. It does sort of require a separate schema to test though (which out test harness doesn't really handle yet, I think) -Yonik On 4/12/06, Yonik Seeley <[EMAIL PROTECTED]> wrote:

Re: Deleting documents

2006-04-12 Thread Yonik Seeley
On 4/12/06, Chris Hostetter <[EMAIL PROTECTED]> wrote: > > : Could it be the problem is that my unique key field > : is of type slong (as defined in the tutorial)? > > I just tried modifying the example schema to use type slong for the "id" > field, and i can reproduce what you are describing -- nu

Re: Deleting documents

2006-04-12 Thread Chris Hostetter
: Could it be the problem is that my unique key field : is of type slong (as defined in the tutorial)? I just tried modifying the example schema to use type slong for the "id" field, and i can reproduce what you are describing -- numDocs doesn't go down, ... because the delete isn't working. I'm

Re: Deleting documents

2006-04-12 Thread Yonik Seeley
On 4/12/06, Marcus Stratmann <[EMAIL PROTECTED]> wrote: > > Yes, I believe the Wiki has an example like this (a uniqueKey field > > not named "id") > Right, I should have looked there, too. > > > > But after a I found the number of documents unchanged > > > in the stats. If numDocs didn't change,

Re: Deleting documents

2006-04-12 Thread Marcus Stratmann
> Yes, I believe the Wiki has an example like this (a uniqueKey field > not named "id") Right, I should have looked there, too. > > But after a I found the number of documents unchanged > > in the stats. > What stat? maxDoc may be unchanged since it doesn't reflect deleted > documents that haven

Re: Deleting documents

2006-04-11 Thread Yonik Seeley
On 4/11/06, Marcus Stratmann <[EMAIL PROTECTED]> wrote: > Okay, so "id" seems to be a keyword, rather than a field name. Yes, I believe the Wiki has an example like this (a uniqueKey field not named "id") > With my next try > 113976235 > the query worked fine: > > But after a I found the numb

Deleting documents

2006-04-11 Thread Marcus Stratmann
Hello, I have a problem deleting documents from the index. In the tutorial "SP2514N" is used as an example for deleting. I was wondering if "" is some kind of keyword or the name of a field (in the example, a unique field named "id" is used). In my config I have