RE: UpdateProcessor as a batch

2016-11-04 Thread Markus Jelsma
Thanks all for sharing your thoughts! -Original message- > From:Joel Bernstein > Sent: Friday 4th November 2016 1:28 > To: solr-user@lucene.apache.org > Subject: Re: UpdateProcessor as a batch > > This might be useful. In this scenario you load you content into Solr

Re: UpdateProcessor as a batch

2016-11-03 Thread Joel Bernstein
oc being > >> indexed in the current UpdateProcessor. This is still fast. But the > remote > >> backend supports batched lookups, which are faster. > >> > > >> > This is why i'd love to be able to buffer documents in an > >> UpdateProcessor,

Re: UpdateProcessor as a batch

2016-11-03 Thread Alexandre Rafalovitch
ich are faster. >> > >> > This is why i'd love to be able to buffer documents in an >> UpdateProcessor, and if there are enough, i do a remote lookup for all of >> them, do some processing and let them be indexed. >> > >> > Thanks, >> > M

Re: UpdateProcessor as a batch

2016-11-03 Thread mike st. john
sor, and if there are enough, i do a remote lookup for all of > them, do some processing and let them be indexed. > > > > Thanks, > > Markus > > > > > > > > -Original message- > >> From:Erick Erickson > >> Sent: Thursday 3rd N

Re: UpdateProcessor as a batch

2016-11-03 Thread Erick Erickson
em be indexed. > > Thanks, > Markus > > > > -Original message- >> From:Erick Erickson >> Sent: Thursday 3rd November 2016 19:18 >> To: solr-user >> Subject: Re: UpdateProcessor as a batch >> >> I _thought_ you'd been around long eno

RE: UpdateProcessor as a batch

2016-11-03 Thread Markus Jelsma
; Sent: Thursday 3rd November 2016 19:18 > To: solr-user > Subject: Re: UpdateProcessor as a batch > > I _thought_ you'd been around long enough to know about the options I > mentioned ;). > > Right. I'd guess you're in UpdateHandler.addDoc and there's real

Re: UpdateProcessor as a batch

2016-11-03 Thread Erick Erickson
list of documents, it looked like it > works on incoming stuff, not a whole list. I've also looked if i could buffer > a batch in UpdateProcessor, work on them, and release them, but that seems > impossible. > > Thanks, > Markus > > -Original message- >> F

RE: UpdateProcessor as a batch

2016-11-03 Thread Markus Jelsma
t; Sent: Thursday 3rd November 2016 18:57 > To: solr-user > Subject: Re: UpdateProcessor as a batch > > Markus: > > How are you indexing? SolrJ has a client.add(List) > form, and post.jar lets you add as many documents as you want in a > batch > > Best, > Eri

Re: UpdateProcessor as a batch

2016-11-03 Thread Erick Erickson
Markus: How are you indexing? SolrJ has a client.add(List) form, and post.jar lets you add as many documents as you want in a batch Best, Erick On Thu, Nov 3, 2016 at 10:18 AM, Markus Jelsma wrote: > Hi - i need to process a batch of documents on update but i cannot seem to > find a point