Responding to Requests with Chunks/Streaming

2012-03-14 Thread Nicholas Ball
Hello all, I've been working on a plugin with a custom component and a few handlers for a research project. It's aim is to do some interesting distributed work, however I seem to have come to a road block when trying to respond to a clients request in multiple steps. Not even sure if this is po

Re: Responding to Requests with Chunks/Streaming

2012-03-15 Thread Nicholas Ball
might leverage > some of that. > > But I really don't understand the end goal very well here > > Best > Erick > > On Wed, Mar 14, 2012 at 7:17 PM, Nicholas Ball > wrote: >> Hello all, >> >> I've been working on a plugin with a custom com

Re: Responding to Requests with Chunks/Streaming

2012-03-16 Thread Nicholas Ball
Mikhail & Ludovic, Thanks for both your replies, very helpful indeed! Ludovic, I was actually looking into just that and did some tests with SolrJ, it does work well but needs some changes on the Solr server if we want to send out individual documents a various times. This could be done with a w

Old Google Guava library needs updating (r05)

2012-03-24 Thread Nicholas Ball
Hey all, Working on a plugin, which uses the Curator library (ZooKeeper client). Curator depends on the very latest Google Guava library which unfortunately clashes with Solr's outdated r05 of Guava. Think it's safe to say that Solr should be using the very latest Guava library (11.0.1) too right

Re: Old Google Guava library needs updating (r05)

2012-03-26 Thread Nicholas Ball
only used in the Carrot2 contrib, so >> maybe >> ask over at: http://project.carrot2.org/? >> >> Best >> Erick >> >> On Sat, Mar 24, 2012 at 3:31 PM, Nicholas Ball >> wrote: >> > >> > Hey all, >> > >> > Working on

Solr 4.0 Distributed Concurrency Control Mechanism?

2012-05-24 Thread Nicholas Ball
urrency control (MVCC) locking mechanism now exist for a single core or is it lock-free and multi-core? Many thanks, Nicholas Ball (aka incunix)

Re: Solr 4.0 Distributed Concurrency Control Mechanism?

2012-05-24 Thread Nicholas Ball
ils > > wunder > > On May 24, 2012, at 7:50 AM, Nicholas Ball wrote: > >> >> Hey all, >> >> I've been working on a SOLR set up with some heavy customization (using >> the adminHandler as a way into the system) for a research project @ >&

Re: Solr 4.0 Distributed Concurrency Control Mechanism?

2012-05-25 Thread Nicholas Ball
DistributedUpdateProcessor but not sure if I'm missing something. Has this been implemented? Cheers, Nicholas On Thu, 24 May 2012 09:53:23 -0600, Nicholas Ball wrote: > Thanks for the link, will investigate further. On the outset though, it > looks as though it's not what we want to be going

suggestions developing a multi-version concurrency control (MVCC) mechanism

2012-05-28 Thread Nicholas Ball
Hello all, For the first step of the distributed snapshot isolation system I'm developing for Solr, I'm going to need to have a MVCC mechanism as opposed to the single-version concurrency control mechanism already developed (DistributedUpdateProcessor class). I'm trying to find the very best way

Re: suggestions developing a multi-version concurrency control (MVCC) mechanism

2012-05-29 Thread Nicholas Ball
use the document id and timestamp as a compound unique id. > Then the search would also sort by id, then by timestamp. Result > grouping might let you pick the most recent document from each of the > sorted docs. > > On Mon, May 28, 2012 at 3:15 PM, Nicholas Ball > wrote: >

Atomic Multicore Operations - E.G. Move Docs

2012-06-30 Thread Nicholas Ball
Hey all, Trying to figure out the best way to perform atomic operation across multiple cores on the same solr instance i.e. a multi-core environment. An example would be to move a set of docs from one core onto another core and ensure that a softcommit is done as the exact same time. If one were

Re: Atomic Multicore Operations - E.G. Move Docs

2012-07-02 Thread Nicholas Ball
res, but do not call commit until both > report that indexing worked. If one of the cores throws an exception, > call roll back on both cores. > > On Sat, Jun 30, 2012 at 6:50 AM, Nicholas Ball > wrote: >> >> Hey all, >> >> Trying to figure out the best way to p

Redirecting SolrQueryRequests to another core with Handler

2012-07-19 Thread Nicholas Ball
What is the best way to redirect a SolrQueryRequest to another core from within a handler (custom SearchHandler)? I've tried to find the SolrCore of the core I want to redirect to and called the execute() method with the same params but it looks like the SolrQueryRequest object already has the ol

Re: Redirecting SolrQueryRequests to another core with Handler

2012-07-22 Thread Nicholas Ball
Erickson wrote: > Haven't done this in code myself, but take a look at > MutlCoreJettyExampleTest and the associated base > class, that might give you some pointers > > Best > Erick > > On Thu, Jul 19, 2012 at 9:35 PM, Nicholas Ball > wrote: >>

Re: Atomic Multicore Operations - E.G. Move Docs

2012-08-15 Thread Nicholas Ball
Haven't managed to find a good way to do this yet. Does anyone have any ideas on how I could implement this feature? Really need to move docs across from one core to another atomically. Many thanks, Nicholas On Mon, 02 Jul 2012 04:37:12 -0600, Nicholas Ball wrote: > That could work,

Re: Atomic Multicore Operations - E.G. Move Docs

2012-08-16 Thread Nicholas Ball
ug 16, 2012 at 7:41 AM, Nicholas Ball > wrote: >> >> Haven't managed to find a good way to do this yet. Does anyone have any >> ideas on how I could implement this feature? >> Really need to move docs across from one core to another atomically. >> >> Ma

Re: Atomic Multicore Operations - E.G. Move Docs

2012-08-20 Thread Nicholas Ball
on numbers on documents, and communicate a global > generation number in ZK. > > On Thu, Aug 16, 2012 at 2:22 AM, Nicholas Ball > wrote: >> >> I've been close to implementing a 2PC protocol before for something else, >> however for this it's not needed. >>