Re: UpdateProcessor as a batch

2016-11-03 Thread mike st. john
maybe introduce a distributed queue such as apache ignite, hazelcast or even redis. Read from the queue in batches, do your lookup then index the same batch. just a thought. Mike St. John. On Nov 3, 2016 3:58 PM, "Erick Erickson" wrote: > I thought we might be talking pa

Re: indexing db records via SolrJ

2015-03-16 Thread mike st. john
Take a look at some of the integrations people are using with apache storm, we do something similar on a larger scale , having created a pgsql spout and having a solr indexing bolt. -msj On Mon, Mar 16, 2015 at 11:08 AM, Hal Roberts < hrobe...@cyber.law.harvard.edu> wrote: > We import anywher

Migrating from master/slave to solrcloud.

2014-11-09 Thread mike st. john
Is there a quick way to go from single index master/slave to solrcloud without a full reindex? thanks. Msj

new collection clustering class not found.

2013-11-09 Thread mike st. john
I have a cluster with several collections using the same config in zk, when i add a new collection through the collection api it throws org.apache.solr.common.SolrException: Error loading class 'solr.clustering.ClusteringComponent' when i query all the other collections, clustering works fine, i

Re: creating collections dynamically.

2013-11-08 Thread mike st. john
thanks shawn, i'll give it a try. msj On Fri, Nov 8, 2013 at 10:29 PM, Shawn Heisey wrote: > On 11/8/2013 7:39 PM, mike st. john wrote: > >> Is there any way to create collections dynamically. >> >> >> Having some issues using collections api, need

creating collections dynamically.

2013-11-08 Thread mike st. john
Is there any way to create collections dynamically. Having some issues using collections api, need to pass dataDir etc to the cores doesn't seem to work correctly? thanks. msj

Re: collections api setting dataDir

2013-09-09 Thread mike st. john
7/2013 2:25 PM, mike st. john wrote: > > yes the collections api ignored it,what i ended up doing, was just > > building out some fairness in regards to creating the cores and calling > > coreadmin to create the cores, seemed to work ok. Only issue i'm having > >

Re: multiple update processor chains.

2013-09-09 Thread mike st. john
. Lately, it doesn't seem to be working. (Anonymous - via GTD book) > > > On Mon, Sep 9, 2013 at 1:51 PM, mike st. john wrote: > > > Alexandre, > > > > it was setup with multiple processors and working fine. I just noticed > in > > the docs, it mentio

Re: multiple update processor chains.

2013-09-08 Thread mike st. john
ughts.com/ > LinkedIn: http://www.linkedin.com/in/alexandrerafalovitch > - Time is the quality of nature that keeps events from happening all at > once. Lately, it doesn't seem to be working. (Anonymous - via GTD book) > > > On Mon, Sep 9, 2013 at 5:43 AM, mike st. john wrote:

multiple update processor chains.

2013-09-08 Thread mike st. john
is it possible to have multiple run by default? i've tried adding multiple update.chains for the UpdateRequestHandler but it didn't seem to work. wondering if its even possible. Thanks msj

Re: collections api setting dataDir

2013-09-07 Thread mike st. john
see: http://wiki.apache.org/solr/CoreAdmin#CREATE > > FWIW, > Erick > > > On Fri, Sep 6, 2013 at 4:23 PM, mike st. john wrote: > > > is there any way to change the dataDir while creating a collection via > the > > collection api? > > >

Re: Odd behavior after adding an additional core.

2013-09-06 Thread mike st. john
you sure you supplied numShards=4 while creating the collection? > > On Fri, Sep 6, 2013 at 12:20 AM, mike st. john wrote: > > using solr 4.4 , i used collection admin to create a collection 4shards > > replication - factor of 1 > > > > i did this so i could index my dat

collections api setting dataDir

2013-09-06 Thread mike st. john
is there any way to change the dataDir while creating a collection via the collection api?

Odd behavior after adding an additional core.

2013-09-05 Thread mike st. john
using solr 4.4 , i used collection admin to create a collection 4shards replication - factor of 1 i did this so i could index my data, then bring in replicas later by adding cores via coreadmin i added a new core via coreadmin, what i noticed shortly after adding the core, the leader of the

setting the collection in cloudsolrserver without using setdefaultcollection.

2013-05-21 Thread mike st. john
Is there any way to set the collection without passing setDefaultCollection in cloudsolrserver? I'm using cloudsolrserver with spring, and would like to autowire it. Thanks msj

Re: Updating clusterstate from the zookeeper

2013-04-19 Thread mike st. john
you can use the eclipse plugin for zookeeper. http://www.massedynamic.org/mediawiki/index.php?title=Eclipse_Plug-in_for_ZooKeeper -Msj. On Fri, Apr 19, 2013 at 1:53 PM, Michael Della Bitta < michael.della.bi...@appinions.com> wrote: > I would like to know the answer to this as well. > > Mich

Best way to backup solr?

2013-03-16 Thread mike st. john
Hi, Whats the best option for backing up solrcloud, replicate each shard ? Thanks msj

writing doc to another collection from UpdateReqeustProcessor

2013-03-11 Thread mike st. john
Whats the best approach in writing the current doc inside an UpdateRequestProcessor to another collection ? Would i just call up CloudSolrServer and process it as i normally would in solrj? Thanks msj

Re: inconsistent number of results returned in solr cloud

2013-03-08 Thread mike st. john
check for dup id's a quick way is to facet using the id as a field and set the mincount to 2. -Mike Hardik Upadhyay wrote: HI I am using solr 4.0 (Not BETA), and have created 2 shard 2 replica configuration. But when I query solr with filter query it returns inconsistent result count. Wi

Re: Having an issue where atomic updates are treated as new docs running in solrcloud on 4.1

2013-03-04 Thread mike st. john
thanks mark. That worked great. -Mike Mark Miller wrote: Honestly, I'm not sure. Yonik did some testing around upgrading from 4.0 to 4.1 and said this was fine - but it sounds like perhaps there are some hitches. - Mark On Mar 4, 2013, at 3:35 PM, "mike st. john" wrote

Re: Having an issue where atomic updates are treated as new docs running in solrcloud on 4.1

2013-03-04 Thread mike st. john
Mark, the odd piece here i think was, this was a 4.0 collection numShards=4 etc etc. moved to 4.1, i would assume the doc router would have been set to compositeId, not implicit, or is the move from 4.0 to 4.1 a complete rebuild from the collections up? -Mike Mark Miller wrote: On Mar 4

Re: Having an issue where atomic updates are treated as new docs running in solrcloud on 4.1

2013-03-04 Thread mike st. john
Floor New York, NY 10017-6271 www.appinions.com Where Influence Isn’t a Game On Mon, Mar 4, 2013 at 12:44 PM, mike st. john wrote: Hi, running tomcat , solr 4.1 distributed 4 shards 2 replicas per shard. Everything works fine searching, but i'm trying to use this instance as a nosql s

Having an issue where atomic updates are treated as new docs running in solrcloud on 4.1

2013-03-04 Thread mike st. john
Hi, running tomcat , solr 4.1 distributed 4 shards 2 replicas per shard. Everything works fine searching, but i'm trying to use this instance as a nosql solution as well. What i've noticed , when i send a partial update i'll receive "missing required field" if the document is not loca

atomic updates fail with solrcloud , and real time get throwing NPE

2013-03-03 Thread mike st. john
atomic updates are failing in solrcloud , unless the update is sent to the shard where the doc resides. Real time get is throwing NPE when run without distrib=false tried with 4.1 and 4.2 snapshot. Any ideas? Thanks. msj