Re: Solr cloud recovery, why does restarting leader need replicas?

2012-11-28 Thread Mark Miller
;t want to lose any updates. - Mark On Nov 28, 2012, at 10:47 AM, Daniel Collins wrote: > I was testing the basic SolrCloud test scenario from the wiki page, and > found something (I considered) unexpected. > > If the leader of the shard goes down, when it comes back up it requi

Re: Solr cloud recovery, why does restarting leader need replicas?

2012-11-28 Thread Mark Miller
On Nov 28, 2012, at 11:58 AM, Mark Miller wrote: > and we don't want to lose any updates. That's probably somewhat inaccurate - in this case it's more about consistency - we only ack updates once they are on every replica. So it's not a lost updates issue, but a consi

Re: Indexing performance with solrj vs. direct lucene API

2012-11-28 Thread Mark Miller
One difference is that Solr will call update rather than add by default. If you are willing to ensure unique id's, you can specify overwrite=false (I think thats the one) and it will use add instead. - Mark On Wed, Nov 28, 2012 at 1:02 PM, Robert Stewart wrote: > I have a project wh

Re: Odd casting error in embedded Jetty container

2012-11-28 Thread Mark Bennett
to be working. (Anonymous - via GTD book) > > > On Tue, Nov 27, 2012 at 4:49 PM, Mark Bennett > wrote: > > > Hi Alex and Erick, > > > > I added -verbose which shows every class load. > > > > From the 12,000+ lines of output, I only see 4.0.0 jar

Re: Solr cloud recovery, why does restarting leader need replicas?

2012-11-29 Thread Mark Miller
On Nov 29, 2012, at 1:26 PM, Daniel Collins wrote: > Hi Mark, > > I get that use case, if the non-leader dies, when it comes back it has to > allow for recovery, that makes perfect sense. > > I guess I was (naively!) assuming there was an optimized scenario if the > le

Re: Indexing performance with solrj vs. direct lucene API

2012-11-29 Thread Mark Bennett
Hi Robert, SolrJ is sending data over a socket so that might explain some of the lag. Are is your SolrJ app and the Solr server running on the same physical machine? I thought Mark M's idea sounded good. One other idea: When initializing SolrJ's connection for normal searching you pr

Re: Replication in SolrCloud

2012-11-30 Thread Mark Miller
both machines > are master. Did I do something wrong in my config or isit a report for manual > replication configuration? Can someone else check this? How? You don't really give anything to look at :) > > Is it poossible to link 2 collections to the same conf in zookeeper? > Yes, that is no problem. - Mark

Re: Replication fails in SolrCloud

2012-11-30 Thread Mark Miller
Need more information about your setup and config. Longer stack traces would be helpful as well. - Mark On Nov 30, 2012, at 12:35 AM, yayati wrote: > Hi All, > > I also got similar error while moving my solr 3.6 based application on solr > cloud. While setting solrcloud i go

Re: localHostContext should not contain a / ... why not?

2012-11-30 Thread Mark Miller
ng… That's all I've got. - Mark On Nov 29, 2012, at 11:20 PM, Chris Hostetter wrote: > > Can anyone shed some light on this code in ZkController... > >if (localHostContext.contains("/")) { > throw new IllegalArgumentException("localHostContex

Re: Replication in SolrCloud

2012-11-30 Thread Mark Miller
master. - Mark On Nov 30, 2012, at 10:32 AM, Arkadi Colson wrote: > This is my setup for solrCloud 4.0 on Tomcat 7.0.33 and zookeeper 3.4.5 > > hosts: > - solr01-dcg (first started) > - solr01-gs (second started so becomes replicate) > > collections: > - sms

Re: Replication fails in SolrCloud

2012-11-30 Thread Mark Miller
On Nov 30, 2012, at 11:01 AM, yayati wrote: > We have created some custom search component, where this error occur in > inform method at line > .getResourceLoader().getConfigDir())); Does your custom component try and get the config dir? What for? - Mark

Re: Exceptions in branch_4x log

2012-11-30 Thread Mark Miller
unting, we should probably just continue on. - Mark On Nov 30, 2012, at 4:15 PM, Shawn Heisey wrote: > This is branch_4x, checked out 2012-11-28. Here is my solr log, created by > log4j at WARN level: > > http://dl.dropbox.com/u/97770508/solr-2012-11-30.log > > There are a bu

Re: Exceptions in branch_4x log

2012-11-30 Thread Mark Miller
On Nov 30, 2012, at 5:04 PM, Shawn Heisey wrote: > The other exceptions in the log look more serious. My guess would be that the sizeOf exception is leading to the others. - Mark

Re: SolrCloud(5x) - Errors while recovering

2012-12-01 Thread Mark Miller
FYI, I've fixed this 5x issue a few days ago. - Mark On Nov 27, 2012, at 10:57 AM, Mark Miller wrote: > Someone else has been seeing this on 5x as well - their must be a bug in the > new file handling code (which is why it's still baking in 5x and not on 4x > yet). I tri

Re: SolrCloud : impossible to create a new collection

2012-12-04 Thread Mark Miller
Before long we will have the call itself return the results so you don't have to dig into the logs for this. - Mark

Re: Replication error and Shard Inconsistencies..

2012-12-04 Thread Mark Miller
bottom of this. - Mark On Dec 4, 2012, at 4:37 AM, Annette Newton wrote: > Hi all, > > I have a quite weird issue with Solr cloud. I have a 4 shard, 2 replica > setup, yesterday one of the nodes lost communication with the cloud setup, > which resulted in it trying to run repli

Re: SOLR4 cluster - strange CPU spike on slave

2012-12-04 Thread Mark Miller
imply helps in the NRT case and doesn't really hurt that I've seen in the std case. It's more like a help dir than a replacement. - Mark

Re: How to SWAP cores (or collections) with SolrCloud (SOLR-3866)

2012-12-04 Thread Mark Miller
please - if you could elaborate on that issue, I can help you try and get something in. - Mark

Re: setting hostPort for SolrCloud

2012-12-05 Thread Mark Miller
ou provide your solr.xml? - Mark On Dec 5, 2012, at 7:30 AM, Bill Au wrote: > Can hostPort for SolrCloud only be set in solr.xml? I tried setting the > system property hostPort and jetty.port on the Java command line but > neither of them work. > > Bill

Re: setting hostPort for SolrCloud

2012-12-05 Thread Mark Miller
also passing -Djetty.port - but you can change that to whatever you want in solr.xml (to hostPort or solr.port or whatever). The problem is that it's difficult for a webapp to find what ports it's running on - you can only do it when a request actually comes in to my knowledge. - Ma

Re: Solr Nightly build server down ?

2012-12-05 Thread Mark Miller
Looks like it… hopefully it comes back soon. - Mark On Dec 5, 2012, at 7:52 AM, shreejay wrote: > Hi All, > > Is the server hosting nightly builds of Solr down? > https://builds.apache.org/job/Solr-Artifacts-4.x/lastSuccessfulBuild/artifact/solr/package/ > > > If anyo

Re: The shard called `properties`

2012-12-05 Thread Mark Miller
See the custom hashing issue - the UI has to be updated to ignore this. Unfortunately, it seems that clients have to be hard coded to realize properties is not a shard unless we add another nested layer. Should be 100% harmless. - Mark On Dec 5, 2012, at 5:05 AM, Markus Jelsma wrote: >

Re: SolrCloud - ClusterState says we are the leader,but locally ...

2012-12-05 Thread Mark Miller
What Solr version - beta, alpha, 4.0 final, 4X or 5X? - Mark On Dec 5, 2012, at 4:21 PM, Sudhakar Maddineni wrote: > Hi, > We are uploading solr documents to the index in batches using 30 threads > and using ThreadPoolExecutor, LinkedBlockingQueue with max limit set to > 1. &

Re: SolrCloud - ClusterState says we are the leader,but locally ...

2012-12-05 Thread Mark Miller
) it will just continue anyway without the missing replica (if it doesn't show up). - Mark On Dec 5, 2012, at 4:21 PM, Sudhakar Maddineni wrote: > Hi, > We are uploading solr documents to the index in batches using 30 threads > and using ThreadPoolExecutor, LinkedBlockingQueue with ma

Re: SolrCloud - ClusterState says we are the leader,but locally ...

2012-12-05 Thread Mark Miller
round zookeeper session timeouts? - Mark On Dec 5, 2012, at 4:57 PM, Sudhakar Maddineni wrote: > Hey Mark, > > Yes, I am able to access all of the nodes under each shard from solrcloud > admin UI. > > > - *It kind of looks like the urls solrcloud is using are not accessib

Re: solr cloud node stuck at recovering for days

2012-12-05 Thread Mark Miller
Did you try restarting that node? Have you seen a successful recovery before? What exact version are you using? Can you share any related info in the logs for that node? - Mark On Dec 5, 2012, at 6:48 PM, Nathaniel Domingo wrote: > Hi, > > I'm very new to solr, less than a mon

Re: solr cloud node stuck at recovering for days

2012-12-05 Thread Mark Miller
Okay - logs from that node would help a lot then (or just the parts around when it's trying to recover). - Mark On Dec 5, 2012, at 7:11 PM, Nathaniel Domingo wrote: > yes, i tried restarting the node twice already and both times it just got > stucked in recovering. one node al

Re: Creating a collection without bootstrap

2012-12-05 Thread Mark Miller
ven before you create the collection - if you link ahead of time, once you create the collection (using the same name you linked with), it will find the link and use it. You can also auto link by naming the conf set the same name as the collection. - Mark On Tue, Dec 4, 2012 at 3:10 PM, Walter Underw

Re: Reloading config to zookeeper

2012-12-05 Thread Mark Miller
Right, solrhome is not required for upconfig, just for the bootstrap cmd. You can also just upload modified files, but the tool doesn't really let you do it in a fine grained way. But there are lots of zookeeper tools you can use to do this if you wanted. - Mark On Thu, Nov 22, 2012 at 10:

Re: solr cloud node stuck at recovering for days

2012-12-05 Thread Mark Miller
I think the list strips most attachments or something - can you try something like pastebin.com? Thanks, mark On Dec 5, 2012, at 7:46 PM, Nathaniel Domingo wrote: > attached is a log relevant to the recovery. > > Thanks > > > On Thu, Dec 6, 2012 at 11:23 AM, Mark Mil

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-05 Thread Mark Miller
ch…but FYI… - Mark On Dec 5, 2012, at 5:35 PM, sausarkar wrote: > We are using SolrCloud and trying to configure it for testing purposes, we > are seeing that the average query time is increasing if we have more than > one node in the SolrCloud cluster. We have a single shard 12 gigs >

Re: solr cloud node stuck at recovering for days

2012-12-05 Thread Mark Miller
communicating with ZooKeeper. Are you using an external ensemble, a single ZooKeeper node, embedded ZooKeeper? - Mark On Dec 5, 2012, at 7:59 PM, Nathaniel Domingo wrote: > here's a link to a portion of the log in pastebin. > > http://pastebin.com/UDBMDdMv > > Thanks >

Re: Minimum HA Setup with SolrCloud

2012-12-06 Thread Mark Miller
fine if you lost one solr node - but if you the one external zk node went down you would lose the ability to do updates until it was brought back up. - Mark On Dec 6, 2012, at 2:46 AM, Thomas Heigl wrote: > Hey all, > > I'm in the process of migrating a single Solr 4.0 instace

Re: Minimum HA Setup with SolrCloud

2012-12-06 Thread Mark Miller
or 4 ZK servers, then 3 would be the quorum? > Yup - 4 requires 3 as a quorum, same as 5. So 4 allows one to go down, 5 allows 2 to go down. - Mark

Re: The shard called `properties`

2012-12-06 Thread Mark Miller
't have a clean checkout. - mark On Dec 6, 2012, at 8:16 AM, Yonik Seeley wrote: > On Wed, Dec 5, 2012 at 5:17 PM, Mark Miller wrote: >> See the custom hashing issue - the UI has to be updated to ignore this. >> >> Unfortunately, it seems that clients have to be hard

Re: Minimum HA Setup with SolrCloud

2012-12-06 Thread Mark Miller
3 is the minimum if you want to allow a node to go down. 1 is the minimum if you want the thing to work at all - but if the 1 goes down, ZooKeeper may stop working… - Mark On Dec 6, 2012, at 2:21 PM, Jack Krupansky wrote: > Rewind. > > If 1 is the minimum, what is the 3 "mini

Re: Minimum HA Setup with SolrCloud

2012-12-06 Thread Mark Miller
oesn't > tolerate partitions? > > Michael Tie breaking happens when you lose nodes or have partitions. So if you have 3 nodes and its partitioned into 2 and 1, the 2 nodes "wins" and the 1 node is 'dead'. You can't then survive a another partition of the 2 nodes - both 1 node ensembles would be 'dead'. - Mark

Re: Minimum HA Setup with SolrCloud

2012-12-06 Thread Mark Miller
ite performance generally declines with more nodes, so you'd also gain a bit of write performance. But for Solr this should matter little to none. - Mark

Re: SolrCloud - ClusterState says we are the leader,but locally ...

2012-12-06 Thread Mark Miller
ng the leader election incorrectly triggers the code path for a fresh cluster start rather than fail over. (Mark Miller) - Mark On Dec 5, 2012, at 9:41 PM, Sudhakar Maddineni wrote: > Yep, after restarting, cluster came back to normal state.We will run couple > of more tests and see if we c

Attention Solr 4.0 SolrCloud users

2012-12-06 Thread Mark Miller
bute leaderVoteWait={whatever miliseconds} to the cores node. Sorry about this - completely my fault. - Mark

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-06 Thread Mark Miller
Ryan, my new best friend! Please, file JIRA issue(s) for these items! I'm sure you will get some feedback. - Mark On Dec 6, 2012, at 5:09 PM, Ryan Zezeski wrote: > There are some gains to be made in Solr's distributed search code. A few > weeks about I spent time profiling d

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-06 Thread Mark Miller
On Dec 6, 2012, at 5:08 PM, sausarkar wrote: > We solved the issue by explicitly adding numShards=1 argument to the solr > start up script. Is this a bug? Sounds like it…perhaps related to SOLR-3971…not sure though. - Mark

Re: SolrCloud stops handling collection CREATE/DELETE (but responds HTTP 200)

2012-12-07 Thread Mark Miller
though (collection API responses) and I hope to get it committed soon. - Mark On Dec 7, 2012, at 7:26 AM, Brett Hoerner wrote: > For what it's worth this is the log output with DEBUG on, > > Dec 07, 2012 2:00:48 PM org.apache.solr.handler.admin.CollectionsHandler > handleCr

Re: setting hostPort for SolrCloud

2012-12-07 Thread Mark Miller
Yup, solr.xml is pretty much required - especially if you want to use solrcloud. The only reason anything works without is for back compat. We are working towards removing the need for it, but's considered required these days. - Mark On Dec 7, 2012, at 11:04 AM, Bill Au wrote: > I

Re: stress testing Solr 4.x

2012-12-07 Thread Mark Miller
e you'd see one. Generally we do retries when that happens. - Mark On Dec 7, 2012, at 1:07 PM, Alain Rogister wrote: > I am reporting the results of my stress tests against Solr 4.x. As I was > getting many error conditions with 4.0, I switched to the 4.1 trunk in the > hope tha

Re: Attention Solr 4.0 SolrCloud users

2012-12-08 Thread Mark Miller
eased, so no, I don't think so. > Do we have an idea when solr 4.1 will be made available? I am just > trying to get an idea if we should wait or not. I hope very, very soon…just have to herd a few cats… - Mark > > > On Thu, Dec 6, 2012 at 9:11 PM, Mark Miller wrote:

Re: stress testing Solr 4.x

2012-12-08 Thread Mark Miller
3.4.5/zookeeperAdmin.html#Ongoing+Data+Directory+Cleanup - Mark On Dec 7, 2012, at 10:22 PM, Mark Miller wrote: > Hey, I'll try and answer this tomorrow. > > There is a def an unreported bug in there that needs to be fixed for the > restarting the all nodes case. > > Also,

Re: stress testing Solr 4.x

2012-12-08 Thread Mark Miller
After some more playing around on 5x I have duplicated the issue. I'll file a JIRA issue for you and fix it shortly. - Mark On Dec 8, 2012, at 8:43 AM, Mark Miller wrote: > Hmm…I've tried to replicate what looked like a bug from your report (3 Solr > servers stop/start ), bu

Re: stress testing Solr 4.x

2012-12-08 Thread Mark Miller
No problem! Here is the JIRA issue: https://issues.apache.org/jira/browse/SOLR-4158 - Mark On Sat, Dec 8, 2012 at 6:03 PM, Alain Rogister wrote: > Great, thanks Mark ! I'll test the fix and post my results. > > Alain > > On Saturday, December 8, 2012, Mark Miller wrote:

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-08 Thread Mark Miller
If that's true, we will fix it for 4.1. I can look closer tomorrow. Mark Sent from my iPhone On Dec 9, 2012, at 2:04 AM, sausarkar wrote: > Spoke too early it seems that SolrCloud is still distributing queries to all > the servers even if numShards=1 We are seeing POST request to

Re: SolrCloud stops handling collection CREATE/DELETE (but responds HTTP 200)

2012-12-09 Thread Mark Miller
Yeah it is - this was fixed a while ago on 4x and will be in 4.1. An exception would kill the collection manager wait loop. - Mark On Sun, Dec 9, 2012 at 9:21 PM, Brett Hoerner wrote: > Thanks, > > It looks like my cluster is in a wedged state after I tried to delete a > collection

Re: stress testing Solr 4.x

2012-12-09 Thread Mark Miller
Hmmm...EOF on the segments file is odd... How were you killing the nodes? Just stopping them or kill -9 or what? - Mark On Sun, Dec 9, 2012 at 1:37 PM, Alain Rogister wrote: > Hi, > > I have re-ran my tests today after I updated Solr 4.1 to apply the patch. > > First, the good

Re: Different schema.xml versions in the binary distribution

2012-12-10 Thread Mark Miller
Seems like a good idea. Could you open a JIRA issue for this task? Mark Sent from my iPhone On Dec 10, 2012, at 6:44 PM, Alexandre Rafalovitch wrote: > Hello, > > I lost good several hours on this, so wanted to check whether this is > fixable. > > In the (binary) dist

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-10 Thread Mark Miller
I missed this bug report! https://issues.apache.org/jira/browse/SOLR-3912 Will fix this very shortly. It's a problem with numShards=1. - Mark On Sun, Dec 9, 2012 at 4:21 PM, sausarkar wrote: > Thank you very much will wait for the results from your tests. > > From: "Mark M

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-11 Thread Mark Miller
I'm still looking into this - didn't have a lot of luck seeing it with a test and am going to look at it manually. I'm hoping 4.1 by xmas! We will see though...need to get others on board. - Mark On Tue, Dec 11, 2012 at 2:40 PM, sausarkar wrote: > Do you know when will 4.1 b

Re: Rolling Deploys and SolrCloud

2012-12-11 Thread Mark Miller
think that's enough usually? Can SolrCloud read config files from the local filesystem? Not currently. Mark On Dec 11, 2012, at 7:56 PM, Mike Schultz wrote: > Does anybody have any experience with "rolling deployments" and SolrCloud? > > We have a production en

Re: Rolling Deploys and SolrCloud

2012-12-12 Thread Mark Miller
the same config and one is not somehow off. If you have ever juggled configs that should be the same across 100 nodes, you have probably screwed things up here and there. And updating a setting means updating 100 files, etc. Be sure you didn't miss one :) - Mark

Re: Strange data-loss problem on one of our cores

2012-12-13 Thread Mark Miller
. If you are able to, you might try out a nightly build - 4.1 will be ready very soon and has numerous bug fixes for SolrCloud. - Mark On Dec 13, 2012, at 9:53 AM, John Nielsen wrote: > Hi all, > > We are seeing a strange problem on our 2-node solr4 cluster. This problem > has resu

Re: Strange data-loss problem on one of our cores

2012-12-14 Thread Mark Miller
m dist=false will do this. - Mark

Re: Strange data-loss problem on one of our cores

2012-12-14 Thread Mark Miller
Have you filed a JIRA issue for this that I don't remember Markus? We need to make sure this is fixed. Any idea around when the trunk version came from? Before or after 4.0? - Mark On Dec 14, 2012, at 6:36 AM, Markus Jelsma wrote: > We did not solve it but reindexing can remedy the

Re: Solrcloud and Node.js

2012-12-14 Thread Mark Miller
lient will not know about additions or removals from the cluster - if you are using a load balancer you will have to update it with the new state. A dumb client won't be able to optimize some updates to leaders. It's still a perfectly reasonable option to not use a 'smart' clien

Re: Solrcloud and Node.js

2012-12-15 Thread Mark Miller
There is a /zookeeper servlet that the admin UI uses for the Cloud tab. I don't know much about it, I think Ryan wrote it. The other option is to talk to zk directly. I also plan on adding an admin handler for ZooKeeper at some point. - Mark On Dec 15, 2012, at 12:33 PM, Luis Cappa

Re: Commit and OpenSearcher not working as expected.

2012-12-16 Thread Mark Miller
Try openSearcher instead? - Mark On Dec 16, 2012, at 8:18 PM, shreejay wrote: > Hello. > > I am running a commit on a solrCloud collection using a cron job. The > command is as follows: > > aa.aa.aa.aa:8983/solr/ABCCollection/update?commit=true&opensearcher=false &

Re: Solr 4.0 with Solr Cloud 404

2012-12-19 Thread Mark Miller
The default host for urls is /solr. Looks like you want to run on the root context. In Solr 4.1 this is best done by setting the host to / (either in solr.xml or with the hostContext sys prop). For 4.0 you have to use a host context of "." to run on the root context. - Mark On De

Re: SolrCloud: only partial results returned

2012-12-20 Thread Mark Miller
Does all the data have unique ids? - Mark On Dec 19, 2012, at 8:30 PM, Lili wrote: > We set up SolrCloud with 2 shards and separate multiple zookeepers. The > data added using http post with json in tutorial sample are not completely > returned in query.However, if you send the

Re: Data from deleted from Solr (Solr cloud)

2012-12-21 Thread Mark Miller
sting if you could post the logs of the node that became leader without all of the docs. - Mark On Dec 19, 2012, at 11:08 AM, shreejay wrote: > Hi All, > > I have a solrlcoud instance with 3 shards. Each shard has 2 instance (2 > servers each running a instance of solr) &g

Re: Solrcloud not reachable and after restart just a "no servers hosting shard"

2012-12-21 Thread Mark Miller
Your hitting https://issues.apache.org/jira/browse/SOLR-3939 The luck of hashing must have left the guy trying to become the leader without any docs. Due to SOLR-3939, a node with an empty index cannot become the leader. - Mark On Dec 21, 2012, at 1:41 PM, gumatias wrote: > I'm get

Re: Solrcloud not reachable and after restart just a "no servers hosting shard"

2012-12-21 Thread Mark Miller
-af07-9add49b85...@gmail.com%3E - Mark On Dec 21, 2012, at 2:10 PM, Mark Miller wrote: > Your hitting https://issues.apache.org/jira/browse/SOLR-3939 > > The luck of hashing must have left the guy trying to become the leader > without any docs. Due to SOLR-3939, a node with an empty

Re: Dynamic collections in SolrCloud for log indexing

2012-12-25 Thread Mark Miller
I've been thinking about aliases for a while as well. Seem very handy and fairly easy to implement. So far there has just always been higher priority things (need to finish collection api responses this week…) but this is something I'd def help work on. - Mark On Dec 25, 2012,

Re: Invalid version (expected 2, but 60) or the data in not in 'javabin'

2012-12-25 Thread Mark Miller
r response is corrupt, I have no guesses. This is easily repeatable? It's happening every time, or randomly? - Mark On Dec 25, 2012, at 4:23 AM, Shahar Davidson wrote: > Thanks Otis. > > I went through every piece of info that I could lay may hands on. > Most of them are about

Re: Solr 4.0 SolrCloud with AWS Auto Scaling

2013-01-02 Thread Mark Miller
s, they would need to be removed. Also, unless you are using elastic ips, https://issues.apache.org/jira/browse/SOLR-4078 may be of interest. - Mark

Re: Solr Cloud with external zookeeper ensemble not starting

2013-01-02 Thread Mark Miller
Don't use zkRun, just zkHost. zkRun is for internal. - Mark On Jan 2, 2013, at 6:44 PM, davers wrote: > When I try to start a solr server in my solr cloud I am receiving the error: > > SEVERE: null:org.apache.solr.common.SolrException: > org.apache.zookeeper.server.quorum

Re: CPU spikes on trunk

2013-01-02 Thread Mark Miller
Any chance you can hook up to a node with something like visual vm and sample some method calls or something? - Mark On Jan 2, 2013, at 10:15 AM, Markus Jelsma wrote: > Hi, > > We have two clusters running on similar machines equipped with SSD's. One > runs a 6 month old tr

Re: Exception on getMBeanInfo

2013-01-02 Thread Mark Miller
Solr 4.0? I think there is a JIRA and fix for this in for 4.1. - Mark On Dec 28, 2012, at 7:20 AM, Marcin Rzewucki wrote: > Hi, > > I found in logs that sometimes the following error (more lines at the end > of this mail) occurs on Solr startup or core reload: > > Dec 2

Re: indexing cpu utilization

2013-01-02 Thread Mark Miller
ty is in gear. Finally, make sure you are using many threads to add docs... - Mark On Jan 2, 2013, at 4:39 PM, Uwe Reh wrote: > Hi, > > while trying to optimize our indexing workflow I reached the same endpoint > like gabriel shen described in his mail. My Solr server won't ut

Re: Solr Collection API doesn't seem to be working

2013-01-02 Thread Mark Miller
CoreAdmin API or pre configure the cores in solr.xml. All you need is to specify a matching collection name for the new core. - Mark On Jan 2, 2013, at 7:58 PM, davers wrote: > Hello I have an external zookeeper ensemble and I have started 6 tomcat > servers with solr running with the de

Re: indexing cpu utilization

2013-01-03 Thread Mark Miller
ng issue number. As far as 32 cores being common, it's not common yet based on what I see. On average, I'm still seeing a lot of 4-8 core hardware. 32 or more has so far proven to be the exception when supporting Solr users. I'm sure that will continue to shift. - Mark

Re: Solr 4.0 SolrCloud with AWS Auto Scaling

2013-01-03 Thread Mark Miller
http://wiki.apache.org/solr/CoreAdmin#UNLOAD - Mark On Jan 3, 2013, at 9:06 AM, Bill Au wrote: > Mark, > What do you mean by "unload them"? > > I am using an AWS load balancer with my auto scaling group in stead of > using Solr's built-in load balancer. I

Re: Terminology question: Core vs. Collection vs...

2013-01-03 Thread Mark Miller
back and no longer be a leader. Did it change from a non replica to a replica then? Gosh I don't know. Stick a fork in my eye :) - Mark

Re: Solr Collection API doesn't seem to be working

2013-01-03 Thread Mark Miller
MAX_INT is just a place holder for a high value given the context of this guy wanting to add replicas for as many machines as he adds down the line. You are taking it too literally. - Mark On Jan 3, 2013, at 9:02 AM, Per Steffensen wrote: > On 1/3/13 2:50 AM, Mark Miller wr

Re: Terminology question: Core vs. Collection vs...

2013-01-03 Thread Mark Miller
This has pretty much become the standard across other distributed systems and in the literat…err…books. I first implemented it as you mention you'd like, but Yonik correctly pointed out that we were going against the grain. - Mark On Jan 3, 2013, at 10:01 AM, Per Steffensen wrote: >

Re: Solr Collection API doesn't seem to be working

2013-01-03 Thread Mark Miller
Happy to clarify. - Mark On Jan 3, 2013, at 10:02 AM, Per Steffensen wrote: > Ok, sorry. Easy to misunderstand, though. > > On 1/3/13 3:58 PM, Mark Miller wrote: >> MAX_INT is just a place holder for a high value given the context of this >> guy wanting to add replicas

Re: Terminology question: Core vs. Collection vs...

2013-01-03 Thread Mark Miller
I've found confirmation examples in projects and books left and right. Trying to forge our own path here seems more confusing than helpful IMO. We have enough issues with terminology right now - where we can go with the industry standard, I think we should. - Mark

Re: Terminology question: Core vs. Collection vs...

2013-01-03 Thread Mark Miller
On Jan 3, 2013, at 10:55 AM, Mark Miller wrote: > > On Jan 3, 2013, at 10:42 AM, Per Steffensen wrote: > >> "Why Solr is better than its competitors" list :-) > > The problem is that it's not just Solr competitors. It seems to be pretty > much everyo

Re: solr4.0 problem zkHost with multiple hosts throws out of range exception

2013-01-03 Thread Mark Miller
I don't really understand your question. More than one what? More than one external zk node? Start up an ensemble, and pass a comma sep list of the addresses as the zkhost - each one should have the same chroot on it. - Mark On Jan 3, 2013, at 4:32 AM, cmuarg wrote: > Hello >

Force SolrJ 4.0.0 to use XML to talk to Solr 1.4.1 server

2013-01-03 Thread Mark Bennett
and my understanding was that this was possible if using XML. -- Mark Bennett / New Idea Engineering, Inc. / mbenn...@ideaeng.com Direct: 408-733-0387 / Main: 866-IDEA-ENG / Cell: 408-829-6513

Re: Force SolrJ 4.0.0 to use XML to talk to Solr 1.4.1 server

2013-01-03 Thread Mark Bennett
Thank you Sean for the option. Your second post made me smile! -- Mark Bennett / New Idea Engineering, Inc. / mbenn...@ideaeng.com Direct: 408-733-0387 / Main: 866-IDEA-ENG / Cell: 408-829-6513 On Thu, Jan 3, 2013 at 12:21 PM, Shawn Heisey wrote: > On 1/3/2013 12:39 PM, Shawn Heisey wr

Re: solr4.0 problem zkHost with multiple hosts throws out of range exception

2013-01-03 Thread Mark Miller
Cool, we should add this to the wiki. -Mark On Thursday, January 3, 2013, cmuarg wrote: > the solution: –DzkHost=zoo1:8983,zoo2:8983,zoo3:8983/solrroot > > thanks > /C > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/solr4-0-prob

Re: Solr 4.0 SolrCloud with AWS Auto Scaling

2013-01-03 Thread Mark Miller
and see if it notes the node as active? Not quite as clean as you'd like prob. Might be worth a JIRA issue to look at further options. - Mark On Jan 3, 2013, at 5:54 PM, Bill Au wrote: > Thanks, Mark. > > That does remove the node. And it seems to do so permanently. Even whe

Re: Solr 4 (CloudSolrServer and LBHttpSolrServer question)

2013-01-04 Thread Mark Miller
7;s a good idea to get your feet wet with 4.0, but I'd hold off for 4.1 for production if you can. Huge number of bug fixes and improvements. - Mark On Jan 4, 2013, at 10:06 AM, Jay Parashar wrote: > Hi, > > I am trying to migrate to Solr 4 (from 3.6) for a > multithreaded/

Re: Solr 4 (CloudSolrServer and LBHttpSolrServer question)

2013-01-04 Thread Mark Miller
I'm going to push *hard* for a Jan release. Woe to those that get in my way :) - Mark On Jan 4, 2013, at 11:37 AM, Shawn Heisey wrote: > On 1/4/2013 8:54 AM, Luis Cappa Banda wrote: >> Any release stimation date, Mark? I heard something about January. I was >> consi

Re: Terminology question: Core vs. Collection vs...

2013-01-04 Thread Mark Miller
Currently a SolrCore is 1:1 with a low level Lucene index. There is no reason that needs to alway be that way. It's possible that we may at some point add built in micro sharding support that means a SolrCore could have multiple underlying Lucene indexes. Or we may not. - Mark On Jan 4,

Re: Terminology question: Core vs. Collection vs...

2013-01-04 Thread Mark Miller
It's basically both. If you don't explicitly specify a shard assignment on SolrCore creation, the Oveerseer will use ZooKeeper to assign a shard for you. It's up to the user which road to take. - mark

Re: search features Endeca vs Solr

2013-01-04 Thread Mark Miller
On Jan 4, 2013, at 3:41 PM, "Dyer, James" wrote: > 4. Dynamic Business Rules. There is an open JIRA issue around biz rules and drools integration. Not sure if there is any work done there, but at least some notes about it last I looked. - Mark

Re: "No live SolrServers" Solr 4 exceptions on trying to create a collection

2013-01-07 Thread Mark Miller
u, you must use the Collections API - see the wiki: http://wiki.apache.org/solr/SolrCloud#Managing_collections_via_the_Collections_API - Mark

Re: SOLR Cloud : what is the best backup/restore strategy ?

2013-01-07 Thread Mark Miller
to the point in time the backup command is received. - Mark On Jan 7, 2013, at 1:45 PM, Otis Gospodnetic wrote: > Hi, > > There may be a better way, but stopping indexing and then > using http://master_host:port/solr/replication?command=backup on each node > may do the backup t

Re: "No live SolrServers" Solr 4 exceptions on trying to create a collection

2013-01-07 Thread Mark Miller
ver is just good for querying and updating. - Mark On Jan 7, 2013, at 1:20 PM, "Jay Parashar" wrote: > Right Mark, > > I am accessing the Collections API using Solrj. This is where I am stuck. If > I just use the Collections API using http thru the browser, the behavior i

Re: SOLR Cloud : what is the best backup/restore strategy ?

2013-01-07 Thread Mark Miller
or I suppose another disk drive or something, your backup is pretty precarious. - Mark On Jan 7, 2013, at 2:21 PM, Michel Dion wrote: > Is it possible to restore an index (previously backed up) using the same > kind of http reste like request ? Something like > ...solr/replicatio

Re: Solr cloud not starting properly. Only starts leaders.

2013-01-07 Thread Mark Miller
pen JIRA issue for 4.1, and I think even a patch. - Mark

Re: Solr Cloud not electing leader properly

2013-01-07 Thread Mark Miller
Please see: http://lucene.472066.n3.nabble.com/Attention-Solr-4-0-SolrCloud-users-td4024998.html - Mark On Jan 7, 2013, at 9:16 PM, davers wrote: > I have a SolrCloud as seen here: http://d.pr/i/ya86 > > When I stop solr-shard-1 solr-shard-4 should become the new leader. Instead

<    5   6   7   8   9   10   11   12   13   14   >