Re: zk Config URL?

2013-02-24 Thread Mark Miller
You either have to specifically upload a config set or use one of the bootstrap sys props. Are you doing either? - Mark On Feb 24, 2013, at 8:15 PM, Darren Govoni wrote: > Thanks Michael. > > I went ahead and just started an external zookeeper, but my solr node throws > except

Re: Slaves always replicate entire index & Index versions

2013-02-25 Thread Mark Miller
On Feb 25, 2013, at 5:54 AM, raulgrande83 wrote: > Mark, is going to be an official 4.2 release soon? I've suggested on the dev mailing list that I will create a Lucene/Solr 4.2 release within the next few weeks unless someone beats me to it. I can't do it this week, I likel

Re: How to set the shardid?

2013-02-25 Thread Mark Miller
trol the shard names explicitly, you have to use the CoreAdmin API to create each core - that lets you set the shard id. - Mark

Re: Distributed Search and the Stale Check

2013-02-25 Thread Mark Miller
On Feb 25, 2013, at 8:14 PM, Ryan Zezeski wrote: > I would like to see a > similar fix made upstream and that is why I am posting here. Please file a JIRA issue and attach your patch. Great write up! (Saw it pop up on twitter, so I read it a little earlier). - Mark

Re: splitting big, existing index into shards

2013-02-25 Thread Mark Miller
On Thu, Feb 21, 2013 at 1:19 PM, Upayavira wrote: > A splitter that uses the same split technique but uses the shard > assignment algorithm from SolrCloud could be a useful thing. There is some on going work on shard splitting, and I assume a splitter like this is part of that. -- - Mark

Re: zk Config URL?

2013-02-26 Thread Mark Miller
On Feb 26, 2013, at 4:35 PM, varun srivastava wrote: > Do we have any ticket to simplify the > solr cloud installation ? I would love to include my suggestions in it. Please, throw some thoughts out on the list or start a new JIRA issue. - Mark

Re: Role of zookeeper at runtime

2013-02-26 Thread Mark Miller
currently in Zk. > 3) If for any reason zookeeper cluster goes offline for sometime, does solr > cloud will not be able to server any traffic ? It will stop allowing updates, but continue serving searches. - Mark > > > Thanks > Varun

Re: Role of zookeeper at runtime

2013-02-26 Thread Mark Miller
queue for update clusterstate.json, creating new collections, etc /overseer_elect - overseer voting zk nodes - Mark On Feb 26, 2013, at 6:18 PM, varun srivastava wrote: > Hi Mark, > One more question > > While doing solr doc update/add what information is required from zookeeper >

Re: zk Config URL?

2013-02-26 Thread Mark Miller
ecial syntax is used to allow them to be set as system properties though. - Mark > > > Thanks > Varun > > On Tue, Feb 26, 2013 at 3:04 PM, Mark Miller wrote: > >> >> On Feb 26, 2013, at 4:35 PM, varun srivastava >> wrote: >> >>> Do we

Re: zk Config URL?

2013-02-26 Thread Mark Miller
prop you would have to set is numShards, unless you removed the default collection and used the CoreAdmin or Collections API to create the first collection. - Mark

Re: Incorrect Version number in Solr4.1 with Master/Repeater/Slave implementation

2013-02-26 Thread Mark Miller
lso fixed (and new tests added!) I'm looking to drive a release of that in a couple weeks. If you are able to setup a recent snapshot of 4X in your dev lab, that would be great and we would have time to fix any issue you found before 4.2 is pushed out. - Mark

Re: zk Config URL?

2013-02-26 Thread Mark Miller
Yup, unless there is some bug (I'm not seeing one visually looking at the code), that should work: zkHost = cfg.get("solr/@zkHost", null); - Mark On Feb 26, 2013, at 8:26 PM, varun srivastava wrote: > Hi Mark, > specifying zkHost in solr.xml is not working. It seems o

Re: zk Config URL?

2013-02-26 Thread Mark Miller
I see. It's set for the On Feb 26, 2013, at 8:33 PM, Mark Miller wrote: > Yup, unless there is some bug (I'm not seeing one visually looking at the > code), that should work: > > zkHost = cfg.get("solr/@zkHost", null); > > - Mark > > O

Re: zk Config URL?

2013-02-26 Thread Mark Miller
You should create a new thread for a new question. If it's in solr_home/lib, make sure that's the case on every node, and make sure the shardLib option in solr.xml is turned on. - Mark On Feb 26, 2013, at 8:35 PM, varun srivastava wrote: > Hi Mark, > How to provide solr-plu

Re: Incorrect Version number in Solr4.1 with Master/Repeater/Slave implementation

2013-02-26 Thread Mark Miller
Yes, you can have the same indexes and different versions. The version is basically a timestamp added to the index at commit time. If you just do a commit, you can avoid changing data, but update the version. So if the files look the same, you should be good. - Mark On Feb 26, 2013, at 9:25

Re: Slaves always replicate entire index & Index versions

2013-02-27 Thread Mark Miller
ad better luck :) - Mark

Re: Zookeeper/Solr Cloud not replicating

2013-02-27 Thread Mark Miller
don't want it to be localhost. Next, look at the logs. They should give a clue why the replicas can't recover from the leader. - Mark On Feb 27, 2013, at 8:25 AM, Christopher Gross wrote: > I've been trying out Solr 4 -- I was able to get it working with 3 > instances

Solr 4.1 Master -> Slave Replication Issues and Solr 4.2

2013-02-27 Thread Mark Miller
lping to drive a 4.2 release the following week to address this. - Mark

Re: Solr 4.1 Master -> Slave Replication Issues and Solr 4.2

2013-02-27 Thread Mark Miller
Oh yeah, forgot to mention. This is just for master-slave replication - these issues don't affect SolrCloud's use of replication. - Mark On Feb 27, 2013, at 10:43 AM, Mark Miller wrote: > FYI > > There have been a couple issues discovered around master->slave replic

Solr 3.6.1 Query large field

2013-02-27 Thread Mark Wilson
help gratefully received. Thanks Mark -- The Wellcome Trust Sanger Institute is operated by Genome Research Limited, a charity registered in England with number 1021457 and a company registered in England with number 2742969, whose registered office is 215 Euston Road, London, NW1 2BE.

Re: Solr 4.1 Master -> Slave Replication Issues and Solr 4.2

2013-02-27 Thread Mark Miller
se of that, other changes introduced this problem and it was not detected nor noticed by users until recently. I've added testing around it with the fixes for the future. - Mark

Re: Nodes out of sync, deletes fail

2013-02-27 Thread Mark Miller
Solr 4.0 or 4.1? - Mark On Feb 27, 2013, at 12:33 PM, jimtronic wrote: > I'm not sure how it happened, but one of my nodes has different data than the > others. > > When I try to delete the offending document by posting json to the /update > url, it hangs and after a

Re: Nodes out of sync, deletes fail

2013-02-27 Thread Mark Miller
You are working off trunk? Do you have any interesting info in the logs? - Mark On Feb 27, 2013, at 12:55 PM, jimtronic wrote: > solrspec: 5.0.0.2012.12.03.13.10.02 > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Nodes-out

Re: Nodes out of sync, deletes fail

2013-02-27 Thread Mark Miller
as OOM is outta control - you really want to use the option that kills the jvm on OOMs. - Mark

Re: Nodes out of sync, deletes fail

2013-02-27 Thread Mark Miller
t why the updates failed on the replicas, but the replicas were responding to other requests. That doesn't just happen out of the blue with no logs about how generally. - Mark

Re: org.apache.solr.cloud.ZkCLI timeout

2013-02-27 Thread Mark Miller
Did you adjust ZooKeeper so that it will accept files greater than 1MB per node? That's more config files than I've ever tried to deal with... - Mark On Feb 27, 2013, at 4:02 PM, varun srivastava wrote: > Hi, > I am using org.apache.solr.cloud.ZkCLI to push some a 56MB config

Re: Role of zookeeper at runtime

2013-02-28 Thread Mark Miller
gt; solrcloud, hence loooking for work around. > > Thanks > Varun > > On Tue, Feb 26, 2013 at 3:34 PM, Mark Miller wrote: > >> ZooKeeper >> / >> /clusterstate.json - info about the layout and state of the cluster - >> collections, shards, urls, et

Re: solr 4.1 - trying to create 2 collection with 2 different sets of configurations

2013-02-28 Thread Mark Miller
On Feb 28, 2013, at 9:41 AM, Shankar Sundararaju wrote: > did having the config name same as collection name allow you to > create collections without having to link the corresponding config names? I > did not try this myself. It should work that way or there is a bug. - Mark

Re: Problems with documents that are added not showing up in index Solr 3.5

2013-02-28 Thread Mark Miller
On Feb 28, 2013, at 3:22 PM, Shawn Heisey wrote: > To the experts: Does an empty update request with commit=true work for this It should work fine. - Mark

Re: Solr 4.1 Solr Cloud Shard Structure

2013-02-28 Thread Mark Miller
hards than nodes and it will overload a node. See the documentation. Later you can start up a new replica on another machine and kill/remove the original. - Mark On Feb 28, 2013, at 7:10 PM, Chris Simpson wrote: > Dear Lucene / Solr Community- > > I recently posted this question on

Re: Role of zookeeper at runtime

2013-02-28 Thread Mark Miller
oesn't have any guarantees in terms of data loss, eg it's not part of SolrCloud per say, but it's a fast way to move an index. - Mark

Re: Solr 4.1 Solr Cloud Shard Structure

2013-02-28 Thread Mark Miller
will be faster than you think I imagine. My main concern is the number of threads - might want to mess with Xss to minimize their ram usage at least. - Mark

Re: Role of zookeeper at runtime

2013-02-28 Thread Mark Miller
Yup - nothing about it will be automatic or easy - multi dc is not really a current feature. I'm just saying it's a fast way to move the data. If you setup the same cluster on each side though, the appropriate stuff will be in ZooKeeper. - Mark On Feb 28, 2013, at 9:04 PM, varun

Re: A few operations questions about the tlog (UpdateLog)

2013-02-28 Thread Mark Miller
To add: Current best practice is to do a hard commit with openSearcher=false every minute or so. AutoCommit is great for this. It shouldn't affect your overall indexing performance and it will constrain the transaction log. - Mark On Feb 28, 2013, at 8:35 PM, Erick Erickson wrote: &g

Re: Zookeeper: Could not get shard_id for core

2013-03-01 Thread Mark Miller
SolrCloud mode - there are advantages and disadvantages to each. - Mark On Mar 1, 2013, at 9:03 AM, Martin Koch wrote: > On a host that is running two separate solr (jetty) processes and a single > zookeeper process, we're often seeing solr complain that it can't find a > particular

Re: Solr 3.6.1 Query large field

2013-03-01 Thread Mark Wilson
Hi Otis Thanks for the info. I tried 2 different ways that both seem to work okay. I added to the in the solrconfig.xml And I tried adding the To the section, in the Schema.xml file. Both ways work ok. Cheers Mark On 28/02/2013 08:05, "Otis Gospodnetic" wrote: > Mark,

Re: From a high level query call, tell Solr / Lucene to automatically apply a leaf operator?

2013-03-03 Thread Mark Bennett
Hi Mikhail, Thanks for the links, looks like interesting stuff. Sadly this project is stuck in 3.x for some very thorny reasons... Googling around, looks like this might be strictly 4.x... On Mon, Feb 25, 2013 at 12:21 PM, Mikhail Khludnev < mkhlud...@griddynamics.com> wrote:

Re: how does collections API choose nodes for CREATE command?

2013-03-04 Thread Mark Miller
SOLR-4321: Collections API will sometimes use a node more than once, even when more unused nodes are available. Fixed for 4.2. I'm going to try and drive a 4.2 release starting next week. - Mark On Mar 4, 2013, at 7:05 AM, adfel70 wrote: > I'm using solr 4.1 > . > I hav

Re: atomic updates fail with solrcloud , and real time get throwing NPE

2013-03-04 Thread Mark Miller
Sounds like you should file a JIRA so this can be looked into before 4.2 comes out shortly. Mark Sent from my iPhone On Mar 3, 2013, at 10:54 PM, "mike st. john" wrote: > atomic updates are failing in solrcloud , unless the update is sent to the > shard where the doc res

Re: Creating shards without id

2013-03-04 Thread Mark Miller
Yeah, you need numShards from 4.1 up or you are in a mode were you have to distrib updates yourself. I thought core admin ui had this field, but if not pls file a JIRA. Until then, you may need to use the http API. Mark Sent from my iPhone On Mar 4, 2013, at 12:46 AM, Arkadi Colson wrote

Re: [ANN] vifun: tool to help visually tweak Solr boosting

2013-03-04 Thread Mark Bennett
vrh, /clustering, /terms, /elevate (from default Solr 4.1 solrconfig.xml) I'm using /select -- Mark Bennett / LucidWorks: Search & Big Data / mark.benn...@lucidworks.com Office: 408-898-4201 / Telecommute: 408-733-0387 / Cell: 408-829-6513 On Feb 23, 2013, at 6:12 AM, jm

Re: Having an issue where atomic updates are treated as new docs running in solrcloud on 4.1

2013-03-04 Thread Mark Miller
s the value for "router" for that collection? Good call! - Mark

Re: Having an issue where atomic updates are treated as new docs running in solrcloud on 4.1

2013-03-04 Thread Mark Miller
o match - with the right router and hash ranges. - Mark

Re: Having an issue where atomic updates are treated as new docs running in solrcloud on 4.1

2013-03-04 Thread Mark Miller
Honestly, I'm not sure. Yonik did some testing around upgrading from 4.0 to 4.1 and said this was fine - but it sounds like perhaps there are some hitches. - Mark On Mar 4, 2013, at 3:35 PM, "mike st. john" wrote: > Mark, > > the odd piece here i think was, t

Re: Building a central index with Lucene + Solr

2013-03-05 Thread Mark Miller
And alternatively, http://yonik.com/solr/getting-started/ - Mark On Mar 5, 2013, at 6:59 AM, Otis Gospodnetic wrote: > Hi, > > See http://lucene.apache.org/solr/tutorial.html :) > > Otis > -- > Solr & ElasticSearch Support > http://sematext.com/ > > >

Re: Solr4x: Separate Indexer and Query Instances for Performance

2013-03-05 Thread Mark Miller
ternate benefits. One possible future optimization with SolrCloud may be to send pre-analzyed docs to the replicas. Just a possibility though. You look at tuning GC and or other settings to make things better. I think I've certainly seen this hold up better than you describe in the past. I'm sure this depends on a lot of factors though (data size, hardware, ram etc) Mark

Re: How to configure SolrCloud over HTTPS. Did I find a bug?

2013-03-06 Thread Mark Miller
aying they set this up before. Don't remember the details at the moment though. - Mark

Re: Dynamic schema design: feedback requested

2013-03-06 Thread Mark Miller
we gain much by switching it to JSON? I like JSON when it comes to rest, but when I think about editing a large schema doc locally, XML seems much easier to deal with. - Mark

Re: Dynamic schema design: feedback requested

2013-03-06 Thread Mark Miller
nice and happy, you might script out those rest calls, but initially, it's much faster/easier to whack the schema into place in a text editor IMO. Like I said though, I may be missing something… - Mark On Mar 6, 2013, at 11:17 AM, Steve Rowe wrote: > In response to my thoughts a

Re: Delete By Query suddenly halts indexing on SolrCloud cluster

2013-03-06 Thread Mark Miller
Which version of Solr? Can you use jconsole, visualvm, or jstack to get some stack traces and see where things are halting? - Mark On Mar 6, 2013, at 11:45 AM, Brett Hoerner wrote: > I have a SolrCloud cluster (2 machines, 2 Solr instances, 32 shards, > replication factor of 2) tha

Re: Dynamic schema design: feedback requested

2013-03-06 Thread Mark Miller
a seems like a lot harder to deal with as a human than an XML schema file. Hence the rest of my comments - just because we don't use the DOM or XML internally doesn't seem to mean we need to do JSON through the entire pipeline (eg the serialized representation) - Mark

Re: Delete By Query suddenly halts indexing on SolrCloud cluster

2013-03-06 Thread Mark Miller
Thans Brett, good stuff (though not a good problem). We def need to look into this. - Mark On Mar 6, 2013, at 1:53 PM, Brett Hoerner wrote: > Here is a dump after the delete, indexing has been stopped: > https://gist.github.com/bretthoerner/c7ea3bf3dc9e676a3f0e > > An interesti

Re: Delete By Query suddenly halts indexing on SolrCloud cluster

2013-03-06 Thread Mark Miller
waiting for a free thread. It seems the question is, why are the requests stuck in socket reads. I don't have an answer at the moment. We should probably get this into a JIRA issue though. - Mark On Mar 6, 2013, at 2:15 PM, Alexandre Rafalovitch wrote: > It does not look like a deadlock

Re: Delete By Query suddenly halts indexing on SolrCloud cluster

2013-03-06 Thread Mark Miller
Any chance you can grab the stack trace of a replica as well? (also when it's locked up of course). - Mark On Mar 6, 2013, at 3:34 PM, Brett Hoerner wrote: > If there's anything I can try, let me know. Interestingly, I think I have > noticed that if I stop my indexer, d

Re: Dynamic schema design: feedback requested

2013-03-06 Thread Mark Miller
with an easily editable file, I have no problem then requiring you stick with hand editing or move to using the rest api. - Mark

Re: Delete By Query suddenly halts indexing on SolrCloud cluster

2013-03-07 Thread Mark Miller
g. I'm away from home till this weekend, but I can try and duplicate this when I get to my home base setup. - Mark

Re: Delete By Query suddenly halts indexing on SolrCloud cluster

2013-03-07 Thread Mark Miller
No, not a poor idea at all, definitely a valid setup. - Mark On Mar 7, 2013, at 9:30 AM, Brett Hoerner wrote: > As a side note, do you think that was a poor idea? I figured it's better to > spread the master "load" around? > > > On Thu, Mar 7, 2013 a

Re: Cross Collection Queries in Solr4 w/o SolrCloud

2013-03-07 Thread Mark Miller
Yes, the collections param is only for SolrCloud. But if your not using SolrCloud, the same stuff you did on Solr3 should work on Solr4… - Mark On Mar 7, 2013, at 9:35 AM, Kenneth Baltrinic wrote: > We are in the process of upgrading a single instance Solr 3 implementation > to Solr 4

Re: Delete By Query suddenly halts indexing on SolrCloud cluster

2013-03-07 Thread Mark Miller
Cool, useful info. As soon as I can duplicate the issue I'll work out what we need to do differently for this case. - Mark On Mar 7, 2013, at 10:19 AM, Brett Hoerner wrote: > As an update to this, I did my SolrCloud dance and made it 2xJVMs per > machine (2 machines still, the sam

Re: Any documentation on Solr MBeans?

2013-03-07 Thread Mark Miller
I don't think anything survives a core reload. It looks like cumulative just rolls back the stats for a rollback. - Mark On Thu, Mar 7, 2013 at 2:25 PM, Isaac Hebsh wrote: > Hi, > > I'm trying to monitor some Solr behaviour, using JMX. > It looks like a great job was d

Re: How to add shard in 4.2-snapshot

2013-03-08 Thread Mark Miller
. Unless you control sharding yourself, you cannot currently add shards without some reindexing. Shard splitting is a feature that is coming soon though. You can easily add replicas currently, but not shards. You can control shards yourself by not using numShards. - Mark

Re: Multiple Collections in one Zookeeper

2013-03-09 Thread Mark Miller
up, it should create those for you with Solr 4.1, otherwise you have to create the root nodes ahead of time (you can use the zkcli tool we provide). - mark On Mar 9, 2013, at 2:38 AM, jimtronic wrote: > Ok, I'm a little confused. > > I had originally bootstrapped zookeeper u

Re: How to add shard in 4.2-snapshot

2013-03-10 Thread Mark Miller
A vote is happening now - it will likely be early this week. - Mark On Mar 10, 2013, at 7:17 AM, adfel70 wrote: > Mark, what's the current estimation for official 4.2 release? > > > > > -- > View this message in context: > http://lucene.472066.n3.nabbl

Re: SolrCloud index timeout

2013-03-11 Thread Mark Miller
What Solr version? Are you mixing deletes and adds? Do you have more than one shard for a collection per machine? ie are you oversharding? Can you post the stack traces (using jstack, or jconsolr, or visualvm, or…)? - Mark On Mar 11, 2013, at 11:39 AM, yriveiro wrote: > Hi, > &g

Re: writing doc to another collection from UpdateReqeustProcessor

2013-03-11 Thread Mark Miller
Sure, seems reasonable. - Mark On Mar 11, 2013, at 11:52 AM, mike st. john wrote: > Whats the best approach in writing the current doc inside an > UpdateRequestProcessor to another collection ? > > > Would i just call up CloudSolrServer and process it as i normally wo

Re: Some nodes have all the load

2013-03-11 Thread Mark Miller
ches? What version of Solr? How many shards do you have? Collections? - Mark On Mar 11, 2013, at 11:41 AM, jimtronic wrote: > I was doing some rolling updates of my cluster ( 12 cores, 4 servers ) and I > ended up in a situation where one node was elected leader by all the cores. > This

Re: Solr replication takes long time

2013-03-11 Thread Mark Miller
Are you using Solr 4.1? - Mark On Mar 11, 2013, at 1:53 PM, Victor Ruiz wrote: > Hi guys, > > I have a problem with Solr replication. I have 2 solr servers (Solr 4.0.0) 1 > master and 1 slave (8 processors,16GB RAM ,Ubuntu 11, ext3, each). In > every server, there ar

Re: Solr replication takes long time

2013-03-11 Thread Mark Miller
mirrors now. - Mark On Mar 11, 2013, at 2:00 PM, Victor Ruiz wrote: > no, Solr 4.0.0, I wanted to update to Solr 4.1 but I read that there was an > issue with the replication, so I decided not to try it for now > > > Mark Miller-3 wrote >> Are you using Solr 4.1? >>

Re: Some nodes have all the load

2013-03-11 Thread Mark Miller
res and settings - clearly you are not currently able to keep up. - Mark

Re: Some nodes have all the load

2013-03-11 Thread Mark Miller
On Mar 11, 2013, at 7:47 PM, Shawn Heisey wrote: >> > > I've just locate a previous message on this list from Mark Miller saying that > in Solr 4, commitWithin is a soft commit. Yes, that's true. > > You should definitely wait for Mark or another committer

Re: SolrException: Error opening new searcher

2013-03-12 Thread Mark Miller
exceeding max warming searchers and failing to open a searcher are entirely different things. Your problem is more severe. Have any more logs? There should likely be deeper stack traces telling why the Searcher could not be opened. - Mark On Mar 12, 2013, at 12:41 AM, mark12345 wrote: >

Re: solr.DirectUpdateHandler2 failed to instantiate

2013-03-12 Thread Mark Miller
There should be a stack trace - also, you shouldn't have to do anything special to use this class. It's the default and only truly supported implementation… - Mark On Mar 12, 2013, at 2:53 PM, Jack Park wrote: > That messages gives great, but terrible google. Zillions of hits, &g

Re: Cloud with two down replica's

2013-03-13 Thread Mark Miller
Anything else in your logs? - Mark On Mar 13, 2013, at 10:57 AM, Arkadi Colson wrote: > On one replica the logs are saying: > > Mar 13, 2013 2:55:23 PM org.apache.solr.common.SolrException log > SEVERE: null:org.apache.solr.common.SolrException: Error handling 'status&#

Re: Reusing same searcher in Solr?

2013-03-13 Thread Mark Miller
I think there is a JIRA issue for Searcher leases somewhere. If not, it's something we have talked a lot about. It's useful for a variety of reasons. I'm sure it's in the pipeline, though I don't know where. - Mark On Mar 13, 2013, at 10:09 AM, Shawn Heisey wro

Re: Scaling SolrCloud and DIH

2013-03-13 Thread Mark Miller
There is still some work to be done to make DIH play nicely with SolrCloud in terms of failover. https://issues.apache.org/jira/browse/SOLR-4058 is one of the issues that should be addressed. I think I made another issue or two, but I don't remember them offhand. - Mark On Mar 13, 201

Re: Strange log messages from Jetty when running Solr Cloud example from 4.2.0

2013-03-13 Thread Mark Miller
Yeah, I was noticing this yesterday. It doesn't seem to affect the admin functionality, but I've seen the logging. I've been meaning to look into it, but no time yet. Could you file a JIRA issue? - Mark On Mar 13, 2013, at 12:05 PM, "John, Phil (CSS)" wrote: >

Re: SolrCloud with Zookeeper ensemble in production environment: SEVERE problems.

2013-03-13 Thread Mark Miller
Could you capture some thread stack traces in the 'engine' and see if there are any blocking methods? - Mark On Mar 13, 2013, at 1:34 PM, Luis Cappa Banda wrote: > Just one correction: > > When I said: > > - I´ve checked SolrCloud via Solr Admin interface and i

Re: Is maxPendingDeletes still used in Solr 4.x?

2013-03-13 Thread Mark Miller
No, totally gone. Super outdated info. - Mark On Mar 13, 2013, at 7:31 PM, roz dev wrote: > Hi All > > In earlier versions of Solr (1.4.x), we could define maxPendingDeletes to > indicate the number of deleted docs which should be batched before applying > them. > > So

Re: Solr 4.1 monitoring with /solr/replication?command=details - indexVersion?

2013-03-14 Thread Mark Miller
On Mar 14, 2013, at 8:10 AM, Rafał Radecki wrote: > Is this a bug? Yes, 4.1 had some replication issues just as you seem to describe here. It all should be fixed in 4.2 which is available now and is a simple upgrade. - Mark

Re: Advice: solrCloud + DIH

2013-03-14 Thread Mark Miller
without your consent - in this case all docs will go to another node and then come back. SolrCloud also works best with multiple threads really - DIH will only use one to my knowledge. Still, at 3 docs/s, something sounds wrong. That's too slow. - Mark

Re: Solr 4.1 monitoring with /solr/replication?command=details - indexVersion?

2013-03-14 Thread Mark Miller
What calls are you using to get the versions? Or is it the admin UI? Also can you add any details about your setup - if this is a problem, we need to duplicate it in one of our unit tests. Also, is it affecting proper replication in any way that you can tell. - Mark On Mar 14, 2013, at 11:12

Re: Strange error in Solr 4.2

2013-03-14 Thread Mark Miller
Perhaps as a result of https://issues.apache.org/jira/browse/SOLR-4451 ? Just a guess. The root cause looks to be: > Caused by: java.io.IOException: Keystore was tampered with, or password was > incorrect - Mark On Mar 14, 2013, at 11:24 AM, Uwe Klosa wrote: > Hi > > We

Re: Strange error in Solr 4.2

2013-03-14 Thread Mark Miller
On Mar 14, 2013, at 1:27 PM, Shawn Heisey wrote: > I have been told that it is possible to override the handleError method to > fix this I'd say mitigate more than fix. I think the real fix requires some dev work. - Mark

Re: Solr 4.2 mechanism proxy request error

2013-03-14 Thread Mark Miller
I'll add a test with rows = 0 and see how easy it is to replicate. Looks to me like you should file a JIRA issue in any case. - Mark On Mar 14, 2013, at 2:04 PM, yriveiro wrote: > Hi, > > I think that in solr 4.2 the new feature to proxy a request if the > collection is not

Re: Searching across multiple collections (cores)

2013-03-14 Thread Mark Miller
Yes, with SolrCloud, it's just the collection param (as long as the schemas are compatible for this): http://wiki.apache.org/solr/SolrCloud#Distributed_Requests - Mark On Mar 14, 2013, at 2:55 PM, kfdroid wrote: > I've been looking all over for a clear answer to this question a

Re: Meaning of "Current" in Solr Cloud Statistics

2013-03-14 Thread Mark Miller
Something like 'Reader is Current' might be better. Personally, I don't even know if it's worth showing. - Mark On Mar 14, 2013, at 3:40 PM, Stefan Matheis wrote: > Perhaps the wording of "Current" is a bit too generic in that context? I'd > like to

Re: SolrCloud with Zookeeper ensemble in production environment: SEVERE problems.

2013-03-15 Thread Mark Miller
You def have to use multiple threads with it for it to be fast, but 3 or 4 docs a second still sounds absurdly slow. - Mark On Mar 15, 2013, at 2:58 PM, Luis Cappa Banda wrote: > And up! :-) > > I´ve been wondering if using CloudSolrServer has something to do here. Does > i

Re: overseer queue clogged

2013-03-15 Thread Mark Miller
What Solr version? 4.0, 4.1 4.2? - Mark On Mar 15, 2013, at 7:19 PM, Gary Yngve wrote: > my solr cloud has been running fine for weeks, but about a week ago, it > stopped dequeueing from the overseer queue, and now there are thousands of > tasks on the queue, most which

Re: overseer queue clogged

2013-03-15 Thread Mark Miller
over - they should pick up processing the queue. Any logs you might be able to share could be useful too. - Mark On Mar 15, 2013, at 7:51 PM, Gary Yngve wrote: > Also, looking at overseer_elect, everything looks fine. node is valid and > live. > > > On Fri, Mar 15, 2013 at

Re: overseer queue clogged

2013-03-15 Thread Mark Miller
it assumes something is wrong. There are a fair number of SolrCloud bug fixes in 4.2 by the way. We didn't do a 4.1.1, but I would recommend you update. I don't know that it solves this particular issue. I'm going to continue investigating. - Mark On Mar 15, 2013, at 9:53 PM,

Re: overseer queue clogged

2013-03-15 Thread Mark Miller
cluster clear things up. It shouldn't take too long for those nodes to recover though - they should have been up to date before. The couple exceptions you posted def indicate something is out of whack. It's something I'd like to get to the bottom of. - Mark > > > On Fr

Re: overseer queue clogged

2013-03-15 Thread Mark Miller
ce have no cores and then just create the core i need.. You can do this - just modify your starting Solr example to have no cores in solr.xml. You won't be able to make use of the admin UI until you create at least one core, but the core and collection apis will both work fine. - Mark >

Re: NPE when adding docs in 4.2

2013-03-16 Thread Mark Miller
lready fix that cloud server call to return an message about not finding the collection rather than an NPE (for 4.3). - Mark On Mar 16, 2013, at 9:47 AM, J Mohamed Zahoor wrote: > Hi > > I am using Solr 4.2. I created 2 collections by using > > > "http://localhost:8

Re: overseer queue clogged

2013-03-16 Thread Mark Miller
Yeah, I don't know that I've ever tried with 4.0, but I've done this with 4.1 and 4.2. - Mark On Mar 16, 2013, at 12:19 PM, Gary Yngve wrote: > Cool, I'll need to try this. I could have sworn that it didn't work that > way in 4.0, but maybe my test was bunk.

Re: Best way to backup solr?

2013-03-16 Thread Mark Miller
hat's what is there right now. - Mark On Mar 16, 2013, at 5:06 PM, mike st. john wrote: > Hi, > > Whats the best option for backing up solrcloud, > > replicate each shard ? > > > Thanks > > msj

Re: Can I run solr cluster on other ports after inital run?

2013-03-17 Thread Mark Miller
eName that can be used in solr.xml and with the core admin api. If you use this when you first start your cluster, you can start a new machine with the same coreNodeName and it will take over for that SolrCore. - Mark On Mar 17, 2013, at 10:49 AM, adfel70 wrote: > Hi, > I see that sol

Re: Can I run solr cluster on other ports after inital run?

2013-03-17 Thread Mark Miller
e-suffix for example? No, no collections API support yet. It would be good to do, though I have not thought through it yet. Feel free to make a JIRA for it. - Mark

Re: SnapPull failed - SOLR 4.1

2013-03-17 Thread Mark Miller
This is probably related to some Replication bugs that 4.1 had - 4.2 is probably your best bet for a fix. - Mark On Mar 18, 2013, at 1:48 AM, Sandeep Kumar Anumalla wrote: > SEVERE: SnapPull failed :org.apache.solr.common.SolrException: Unable to > download _xv0_Lucene41_0.doc comp

Re: Handling a closed IndexWriter in SOLR 4.0

2013-03-18 Thread Mark Miller
I'll fix it - I put up a patch last night. - Mark On Mar 18, 2013, at 1:12 AM, mark12345 wrote: > This looks similar to the issue I also have: > > * > http://lucene.472066.n3.nabble.com/Solr-4-1-4-2-SolrException-Error-opening-new-searcher-td4046543.html > <http://luce

Re: Replica is unable to recover because leader doesn't think it is the leader (Solr 4.1)

2013-03-18 Thread Mark Miller
session expiration should also cause the leader node to drop… - Mark On Mar 18, 2013, at 1:57 PM, Timothy Potter wrote: > Having an issue running on a nightly build of Solr 4.1 (tag - > 4.1.0.2013.01.10.20.44.27) > > I had a replica fail and when trying to bring it back online,

<    7   8   9   10   11   12   13   14   15   16   >