[ANNOUNCE] Apache Solr 4.10.3 released

2014-12-29 Thread Mark Miller
releases. It is possible that the mirror you are using may not have replicated the release yet. If that is the case, please try another mirror. This also goes for Maven access. Happy Holidays, Mark Miller http://www.about.me/markrmiller

Re: Garbage Collection tuning - G1 is now a good option

2015-01-02 Thread Mark Miller
all of the issues are not known or documented and that updates may introduce new issues. You face some risk like that no matter what though. - Mark On Fri Jan 02 2015 at 8:37:47 AM Shawn Heisey wrote: > On 1/1/2015 6:35 PM, William Bell wrote: > > But tons of people on this mailing li

Re: leader split-brain at least once a day - need help

2015-01-12 Thread Mark Miller
bq. ClusterState says we are the leader, but locally we don't think so Generally this is due to some bug. One bug that can lead to it was recently fixed in 4.10.3 I think. What version are you on? - Mark On Mon Jan 12 2015 at 7:35:47 AM Thomas Lamy wrote: > Hi, > > I found no

Re: Distributed unit tests and SSL doesn't have a valid keystore

2015-01-12 Thread Mark Miller
I'd have to do some digging. Hossman might know offhand. You might just want to use @SupressSSL on the tests :) - Mark On Mon Jan 12 2015 at 8:45:11 AM Markus Jelsma wrote: > Hi - in a small Maven project depending on Solr 4.10.3, running unit tests > that extend BaseDistributedSea

Re: solr cloud replicas goes in recovery mode after update

2015-01-26 Thread Mark Miller
bq. Is this the correct approach ? It works, but it might not be ideal. Recent versions of ZooKeeper have an alternate config for this max limit though, and it is preferable to use that. See maxSessionTimeout in http://zookeeper.apache.org/doc/r3.3.1/zookeeperAdmin.html - Mark On Mon Jan 26

Re: Connection Reset Errors with Solr 4.4

2015-01-27 Thread Mark Miller
Sorry, there is no great workaroud. You might try raising the max idle time for your container - perhaps that makes it less frequent. - Mark On Tue Jan 20 2015 at 1:56:54 PM Nishanth S wrote: > Thank you Mike.Sure enough,we are running into the same issue you > mentoined.Is there a qui

Re: replica never takes leader role

2015-01-28 Thread Mark Miller
Yes, after 45 seconds a replica should take over as leader. It should likely explain in the logs of the replica that should be taking over why this is not happening. - Mar On Wed Jan 28 2015 at 2:52:32 PM Joshi, Shital wrote: > When leader reaches 99% physical memory on the box and starts swapp

Re: Solrcloud (to HDFS) poor indexing performance

2015-02-03 Thread Mark Miller
by the way. - Mark http://about.me/markrmiller > On Feb 3, 2015, at 7:47 PM, Tim Smith wrote: > > Hi, > > I have a SolrCloud (Solr 4.4, writing to HDFS on CDH-5.3) collection > configured to be populated by flume Morphlines sink. The flume agent reads > data from Kafka a

Re: "Classic" 4.2 master-slave replication not completing

2013-06-27 Thread Mark Miller
Odd - looks like it's stuck waiting to be notified that a new searcher is ready. - Mark On Jun 27, 2013, at 8:58 AM, Neal Ensor wrote: > Okay, I have done this (updated to 4.3.1 across master and four slaves; one > of these is my own PC for experiments, it is not being accessed

Re: solr.DirectUpdateHandler2 failed to instantiate

2013-06-27 Thread Mark Bennett
t;> >> >> >> >> >> > class="org.apache.solr.update.TopicQuestsDocumentProcessFactory"> >>hello >> >> >> >> >> > class="solr.DirectUpdateHandler2"> >> >>

Re: solr.DirectUpdateHandler2 failed to instantiate

2013-06-27 Thread Mark Bennett
hen I removed copies of my jar from other lib directories which I had been experimenting with. -- Mark Bennett / LucidWorks: Search & Big Data / mark.benn...@lucidworks.com Office: 408-898-4201 / Telecommute: 408-733-0387 / Cell: 408-829-6513 On Mar 13, 2013, at 11:52 AM, Jack Park wrote: >

Re: Querying across multiple *identical* Collections

2013-06-27 Thread Mark Miller
http://wiki.apache.org/solr/SolrCloud#Distributed_Requests - Mark On Jun 27, 2013, at 2:34 PM, Otis Gospodnetic wrote: > Hi, > > This "search across multiple collections" question has come up a few > times recently: > > http://search-lucene.com/m/2Q1BE0IT4Y/

Re: state of new config format in 4.3.1

2013-06-27 Thread Mark Miller
There were a variety of little bugs - it will just be a bit of a land mine situation if you try and do it with 4.3.1. If it ends up working for you, that's that. - Mark On Jun 27, 2013, at 3:22 PM, shikhar wrote: > Can anyone (Eric?) outline what's changing between 4.3.1 and 4

Re: shardkey

2013-06-27 Thread Mark Miller
You might be seeing https://issues.apache.org/jira/browse/SOLR-4923 ? The commit true part of the request that add documents? If so, it might be SOLR-4923 and you should try the commit in a request after adding the docs. - Mark On Jun 27, 2013, at 4:42 PM, "Joshi, Shital" wr

Re: shardkey

2013-06-28 Thread Mark Miller
Yeah, that is what I would try until 4.4 comes out - and it should not matter replica or leader. - Mark On Jun 28, 2013, at 3:13 PM, "Joshi, Shital" wrote: > Thanks Mark. > > We use commit=true as part of the request to add documents. Something like > this: > >

Re: Shard tolerant partial results

2013-07-01 Thread Mark Miller
On Jul 1, 2013, at 6:56 AM, Phil Hoy wrote: > Perhaps an http header could be added or another attribute added to the solr > result node. I thought that was already done - I'm surprised that it's not. If that's really the case, please make a JIRA issue. - Mark

Re: Does solr cloud required passwordless ssh?

2013-07-01 Thread Mark Miller
No, SolrCloud does not currently use ssh. - Mark On Jul 1, 2013, at 12:58 PM, adfel70 wrote: > Hi > Does solr cloud on a cluster of servers require passwordless ssh to be > configured between the servers? > > > > > -- > View this message in context: > http

Re: OOM killer script woes

2013-07-02 Thread Mark Miller
Please file a JIRA issue so that we can address this. - Mark On Jul 2, 2013, at 6:20 AM, Daniel Collins wrote: > On looking at the code in SolrDispatchFilter, is this intentional or not? > I think I remember Mark Miller mentioning that in an OOM case, the best > course of action is

Re: Solr cloud date based paritioning

2013-07-03 Thread Mark Miller
een using the trick forever with Lucene. - Mark

Re: Every collection.reload makes zookeeper think shards are down

2013-07-08 Thread Mark Miller
It's a known bug, fix coming in 4.4, 4.4 likely coming within a couple weeks. https://issues.apache.org/jira/browse/SOLR-4805 - Mark On Jul 8, 2013, at 10:30 AM, adfel70 wrote: > Hi > > each time I reload a collection via collections API, zookeeper thinks that > all

Re: Solr cloud date based paritioning

2013-07-08 Thread Mark Miller
le to implement this pattern with a single collection as the custom sharding features advance. - Mark On Jul 6, 2013, at 7:23 AM, Erick Erickson wrote: > Not saying it's always one way or the other, just > that one shouldn't automatically _assume_ > putting the most recent data o

Re: SolrJ and SolrCloud

2013-07-08 Thread Mark Miller
> CloudSolrServer server = new CloudSolrServer("?"); > > right away? > > Or will point to one instance using HttpSolrServer suffice for now? Yes, it will. - Mark > > Thanks.

Re: Moving replica from node to node?

2013-07-08 Thread Mark Miller
It's simply a sugar method that no one has gotten to yet. I almost have once or twice, but I always have moved onto other things before even starting. It's fairly simple to just start another replica on the TO node and then delete the replica on the FROM node, so not a lot of urgenc

Re: Solr Live Nodes not updating immediately

2013-07-09 Thread Mark Miller
Something is wrong if it actually takes 20 minutes. - Mark On Jul 9, 2013, at 7:43 AM, Ranjith Venkatesan wrote: > Hi, > > I am new to solr. Currently i m using Solr-4.3.0. I had setup a solrcloud > setup in 3 machines. If I kill a node running in any of the machine using

Re: Is there an easy way to know if a Solr cloud node is a shard leader?

2013-07-09 Thread Mark Miller
If you call /solr/zookeeper on a specific node, that servlet would tell you - output is a bit verbose for what you want though. - Mark On Jul 9, 2013, at 10:36 AM, Robert Stewart wrote: > I would like to be able to do it without consulting Zookeeper. Is there some > variable or API

Re: Moving replica from node to node?

2013-07-11 Thread Mark Miller
Yeah, though CREATE and UNLOAD end up being kind of funny descriptors. You'd think LOAD and UNLOAD or CREATE and DELETE or something... On Wed, Jul 10, 2013 at 11:35 PM, Otis Gospodnetic < otis.gospodne...@gmail.com> wrote: > Thanks Mark. I assume you are referring to using the

Re: Norms

2013-07-14 Thread Mark Miller
On Jul 10, 2013, at 4:39 AM, Daniel Collins wrote: > QueryNorm is what I'm still trying to get to the bottom of exactly :) If you have not seen it, some reading from the past here… https://issues.apache.org/jira/browse/LUCENE-1896 - Mark

Re: Auto-sharding and numShard parameter

2013-07-20 Thread Mark Miller
start using the Collections API - preconfigured collections will be second class and possibly deprecated at some point. - Mark On Jul 20, 2013, at 10:13 PM, Erick Erickson wrote: > Flavio: > > One of the great things about having people continually using Solr > (and SolrCloud) for

Re: Auto-sharding and numShard parameter

2013-07-22 Thread Mark Miller
There is a reason of course, or else it wouldn't be like that. We addressed it recently. https://issues.apache.org/jira/browse/SOLR-3633 https://issues.apache.org/jira/browse/SOLR-3677 https://issues.apache.org/jira/browse/SOLR-4943 - Mark On Jul 22, 2013, at 10:57 AM, Michael Della

Re: SolrCloud commit process is too time consuming, even if documents are light

2013-07-25 Thread Mark Miller
with those settings. - Mark On Jul 25, 2013, at 8:36 AM, Radu Ghita wrote: > Forgot to attach server and solr configurations: > > SolrCloud 4.1, internal Zookeeper, 16 shards, custom java importer. > Server: Intel(R) Xeon(R) CPU E5-2670 0 @ 2.60GHz, 32 cores, 192gb RAM, 10tb >

Re: .lock file not created when making a backup snapshot

2013-07-29 Thread Mark Triggs
Hi Artem, I noticed this recently too. I created a JIRA issue here: https://issues.apache.org/jira/browse/SOLR-5040 Cheers, Mark Artem Karpenko writes: > Hi, > > when making a backup snapshot using "/replication?command=backup" > call, a snapshot directory is cr

Re: Performance vs. maxBufferedAddsPerServer=10

2013-07-29 Thread Mark Miller
SOLR-4816 won't address this - it will just speed up *different* parts. There are other things that will need to be done to speed up that part. - Mark On Jul 26, 2013, at 3:53 PM, Erick Erickson wrote: > This is current a hard-coded limit from what I've understood. From what

Re: SolrCloud shard down

2013-07-29 Thread Mark Miller
l free to create a JIRA issue - I'll try and get to it otherwise. - Mark

Re: Performance vs. maxBufferedAddsPerServer=10

2013-07-29 Thread Mark Miller
Yes, the internal document forwarding path is different and does not use the CloudSolrServer. It currently works with a buffer of 10. - Mark On Jul 29, 2013, at 3:10 PM, Erick Erickson wrote: > Why wouldn't it? Or are you saying that the routing to replicas > from the leader als

Re: SolrCloud commit process is too time consuming, even if documents are light

2013-07-30 Thread Mark Miller
I don't seem to be seeing a signifigant slowdown over time when I use the old defaults for merge threads and max merges. - Mark On Jul 25, 2013, at 10:17 AM, Mark Miller wrote: > I'm looking into some possible slow down after long indexing issues when I > get back from vaca

Re: Sharding with a SolrCloud

2013-08-01 Thread Mark Miller
like we want to get to the bottom of why you randomly don't see the documents in the response. - Mark

Re: Sharding with a SolrCloud

2013-08-01 Thread Mark Miller
cluster to work if possible (via proxing the request or whatever). - Mark

Re: problems running solr 4.4 with HDFS HA

2013-08-06 Thread Mark Miller
On Aug 6, 2013, at 3:15 PM, Greg Walters wrote: > -Dsolr.hdfs.confdir=/etc/hadoop/conf.cloudera.hdfs1 Have you set that up in the directoryFactory section of solrconfig.xml? Make sure you have something like: ${solr.hdfs.home:} ${solr.hdfs.confdir:} - Mark

Re: Clusterstate says "state:recovering", but Core says "I see state: null"?

2013-08-14 Thread Mark Miller
What does the cluster state and leader say? Anything interesting you can pull from the logs? - Mark On Aug 14, 2013, at 4:58 AM, Tor Egil wrote: > Setup: > 3 zk servers > 3 solr 4.4 servers (1 shard with 2 replicas) > > Every now and then Solr gets trapped recovering > &

Re: Wrong leader election leads to shard removal

2013-08-14 Thread Mark Miller
replicas. If one had no tlog, it should have recovered from the one that still had a tlog. > > How does the zookeeper compare the 2 tlogs to know which one is more > recent? does it not rely on the version number shown in the admin UI? It looks at recent id's in the tlogs of both an

Re: Clusterstate says "state:recovering", but Core says "I see state: null"?

2013-08-14 Thread Mark Miller
tened to make a JIRA issue about throwing an exception on this and one or two other core admin commands. We might want to support them in some way at some point, but currently, swap is def no good in SolrCloud. - Mark

Re: Clusterstate says "state:recovering", but Core says "I see state: null"?

2013-08-14 Thread Mark Miller
ction alias instead. - Mark

Re: Problems installing Solr4 in Jetty9

2013-08-18 Thread Mark Miller
On Aug 17, 2013, at 9:01 AM, Robert Muir wrote: > I think this is only a "test dependency" ? Right - it's only for the hdfs 'test' setup. I thought that when Steve moved it from the test module to the core, he handled it so that it would not go out in the dist. - mark

Re: Transaction log "on-disk" guarantees

2013-08-27 Thread Mark Miller
On Aug 27, 2013, at 11:08 AM, Sandro Zbinden wrote: > Can we activate the transaction log to have on disk guarantees and then use > the solr soft commit feature ? Yes you can. If you only have a single node (no replication), you probably want to turn on fsync via the config. - Mark

Re: Transaction log "on-disk" guarantees

2013-08-27 Thread Mark Miller
es to Sandro inline below: On Aug 27, 2013, at 11:43 AM, Sandro Zbinden wrote: > Hey Mark > > Thank you very much for the quick answer. We have a single node environment. > > I try to find the fsync option but was not successful. Ended up in the > UpdateLog class :-) >

Re: SolrCloud - Path must not end with / character

2013-08-29 Thread Mark Miller
m and is confusing. - Mark On Aug 29, 2013, at 5:23 AM, sathish_ix wrote: > Hi , > > Check your configuration files uploaded into zookeeper is valid and no error > in config files uploaded. > I think due to this error, solr core will not be created. > > Thanks, > Sath

Re: Data Centre recovery/replication, does this seem plausible?

2013-08-29 Thread Mark Miller
s, then it replicates the index, buffering all updates during that replication, then it replays all those updates from the buffer. No 'target' number of updates applies here. - Mark

Re: SolrCloud 4.x hangs under high update volume

2013-09-04 Thread Mark Miller
I'm going to try and fix the root cause for 4.5 - I've suspected what it is since early this year, but it's never personally been an issue, so it's rolled along for a long time. Mark Sent from my iPhone On Sep 3, 2013, at 4:30 PM, Tim Vaillancourt wrote: > Hey guys,

Re: Solr Cloud hangs when replicating updates

2013-09-04 Thread Mark Miller
Ill look at fixing the root issue for 4.5. I've been putting it off for way to long. Mark Sent from my iPhone On Sep 3, 2013, at 2:15 PM, Kevin Osborn wrote: > I was having problems updating SolrCloud with a large batch of records. The > records are coming in bursts with lu

Re: SolrCloud 4.x hangs under high update volume

2013-09-04 Thread Mark Miller
There is an issue if I remember right, but I can't find it right now. If anyone that has the problem could try this patch, that would be very helpful: http://pastebin.com/raw.php?i=aaRWwSGP - Mark On Wed, Sep 4, 2013 at 8:04 AM, Markus Jelsma wrote: > Hi Mark, > > Got an

Re: Solr Cloud hangs when replicating updates

2013-09-04 Thread Mark Miller
It would be great if you could give this patch a try: http://pastebin.com/raw.php?i=aaRWwSGP - Mark On Wed, Sep 4, 2013 at 8:31 AM, Kevin Osborn wrote: > Thanks. If there is anything I can do to help you resolve this issue, let > me know. > > -Kevin > > > On Wed, Sep 4,

Re: cleanup after OutOfMemoryError

2013-09-04 Thread Mark Miller
I don't know that there is any 'safe' thing you can do other than restart - but if I were to try anything, I would use true for rollback. - Mark On Wed, Sep 4, 2013 at 9:44 AM, Ryan McKinley wrote: > I have an application where I am calling DirectUpdateHandle

Re: SolrCloud 4.x hangs under high update volume

2013-09-04 Thread Mark Miller
ore like a workaround than a fix. The patch uses a separate 'limiting' semaphore for the two cases. - Mark On Sep 4, 2013, at 10:22 AM, Tim Vaillancourt wrote: > Thanks guys! :) > > Mark: this patch is much appreciated, I will try to test this shortly, > hopefu

Re: solrcloud shards backup/restoration

2013-09-06 Thread Mark Miller
up, you want to stop indexing and commit first. But if you just want a rough snapshot for around that time, in both cases you can still just don't hard commit and take a snapshot. Mark Sent from my iPhone On Sep 6, 2013, at 1:13 AM, Shalin Shekhar Mangar wrote: > The replication handle

Re: solrcloud shards backup/restoration

2013-09-06 Thread Mark Miller
Phone typing. The end should not say "don't hard commit" - it should say "do a hard commit and take a snapshot". Mark Sent from my iPhone On Sep 6, 2013, at 7:26 AM, Mark Miller wrote: > I don't know that it's too bad though - its always been the

Re: SolrCloud 4.x hangs under high update volume

2013-09-06 Thread Mark Miller
thing interesting change with the rest of the system? CPU usage spikes or something like that? Clamping down further on the overall number of threads night help (which would require making something configurable). How many nodes are listed in zk under live_nodes? Mark Sent from my iPhone On

Re: SolrCloud 4.x hangs under high update volume

2013-09-06 Thread Mark Miller
Okay, thanks, useful info. Getting on a plane, but ill look more at this soon. That 10k thread spike is good to know - that's no good and could easily be part of the problem. We want to keep that from happening. Mark Sent from my iPhone On Sep 6, 2013, at 2:05 PM, Tim Vaillancourt

Re: SolrCloud 4.x hangs under high update volume

2013-09-12 Thread Mark Miller
Right, I don't see SOLR-5232 making 4.5 unfortunately. It could perhaps make a 4.5.1 - it does resolve a critical issue - but 4.5 is in motion and SOLR-5232 is not quite ready - we need some testing. - Mark On Sep 12, 2013, at 2:12 PM, Erick Erickson wrote: > My take on it is this,

Re: SolrCloud liveness problems

2013-09-17 Thread Mark Miller
is coming in 4.5, which is a probably a week or so away. > > Eventually (after few minutes), leader takes over, mark collections "active" > but remains blocked on http interface, so other nodes can not synchronize. > > In further tests, we loaded 4 collections with numShards=

Re: SolrCloud liveness problems

2013-09-17 Thread Mark Miller
SOLR-5243 and SOLR-5240 will likely improve the situation. Both fixes are in 4.5 - the first RC for 4.5 will likely come tomorrow. Thanks to yonik for sussing these out. - Mark On Sep 17, 2013, at 2:43 PM, Mark Miller wrote: > > On Sep 17, 2013, at 12:00 PM, Vladimir Veljkovic &g

Searching for closed polylines that contain a given point

2013-09-23 Thread Mark Backman
I'm new to spatial search within solr.  If I have a set of records containing closed polylines describing, say, the boundaries of nations, can I use solr to build an index of these records against which I can search to see if a point is contained within any of them? Thanks, -Mark  

Re: SolrCloud High Availability during indexing operation

2013-10-08 Thread Mark Miller
The attachment did not go through - try using pastebin.com or something. Are you adding docs with curl one at a time or in bulk per request. - Mark On Oct 8, 2013, at 9:58 PM, Saurabh Saxena wrote: > Repeated the experiments on local system. Single shard Solrcloud with a > replica. Tr

Re: ALIAS feature, can be used for what?

2013-10-08 Thread Mark Miller
update as well, so I guess I figured why add it explicitly. I figured we could still do it later - and I suppose we probably should. I also intend to add a list alias command: https://issues.apache.org/jira/browse/SOLR-4968 - Mark On Oct 8, 2013, at 11:31 AM, Michael Della Bitta wrote

Re: Setting SolrCloudServer collection

2013-10-11 Thread Mark Miller
Set the collection param per request. It only uses the default if you don't set it. - Mark On Oct 11, 2013, at 5:26 PM, Mark wrote: > If using one static SolrCloudServer how can I add a bean to a certain > collection. Do I need to update setDefaultCollection() each time? I do

Re: Solr 4.1 monitoring with /solr/replication?command=details - indexVersion?

2013-03-20 Thread Mark Miller
Hmm, I'd have to look, but first to make, this subject says 4.1? In 4.1 the slave will be ahead because it commits after installing the index. In 4.2 it shouldn't. Your on? - Mark On Mar 20, 2013, at 4:03 AM, Rafał Radecki wrote: > Thanks for the info. > I understand

Re: Facets with 5000 facet fields

2013-03-20 Thread Mark Miller
faceting method that may have some better nrt characteristics than fcs. I have not played with it yet but hope to soon. - Mark

Re: Problem with Solr replication in solr 4.2

2013-03-21 Thread Mark Miller
out to go out, if we are quick, perhaps we can address something here if there is a problem. - Mark > Thanks, > Rohit

Re: Solr 4.2 - Slave Index version is higher than Master

2013-03-21 Thread Mark Miller
Can you give more details about your configuration and setup? Our best bet is to try and recreate this with a unit test. - Mark On Mar 21, 2013, at 4:08 PM, Uomesh wrote: > Hi, > > I am seeing an issue after upgrading from solr 3.6.2 to Solr 4.2. My Slave > stop replicating af

Re: Solr cloud and auto shard timeline

2013-03-21 Thread Mark Miller
Can you elaborate on what you are looking for? If you mean automatically moving shards around, it's not anything I intend to work on currently. Not sure about others. I do plan on on working on an http command for moving shards though. - Mark On Mar 21, 2013, at 7:08 PM, Jamie Johnson

Re: Solr 4.2 - Slave Index version is higher than Master

2013-03-21 Thread Mark Miller
Hmm…I guess I'll work on beefing up these tests some more tonight and see if I can stumble across it. - Mark On Mar 21, 2013, at 4:36 PM, Uomesh wrote: > Hi Mark, > > Attached is my solrconfig_slave.xml. My replication interval is 1 > minute(default). > > Please let

Re: Solr 4.2 - Slave Index version is higher than Master

2013-03-21 Thread Mark Miller
Could you attach the master as well? - Mark On Mar 21, 2013, at 4:36 PM, Uomesh wrote: > Hi Mark, > > Attached is my solrconfig_slave.xml. My replication interval is 1 > minute(default). > > Please let me know if you need any more config details > > Thanks, > umes

Re: Solr 4.2 - Slave Index version is higher than Master

2013-03-21 Thread Mark Miller
compared. Is there anything else you are putting into this mix? - Mark On Mar 21, 2013, at 11:28 PM, Uomesh wrote: > Thank you!!, > > Attached is my master solrconfig.xml. I have few custom handlers which you > might need to remove. In custom handler i have not much code just adding &

Re: SOLR - Documents with large number of fields ~ 450

2013-03-21 Thread Mark Miller
You might try using docvalues with the on disk option and try and let the OS manage all the memory needed for all the faceting/sorting. This would require Solr 4.2. - Mark On Mar 21, 2013, at 2:56 AM, kobe.free.wo...@gmail.com wrote: > Hello All, > > Scenario: > > My data m

Re: Solr 4.2 - Slave Index version is higher than Master

2013-03-21 Thread Mark Miller
I'm working on testing to try and catch what you are seeing here: https://issues.apache.org/jira/browse/SOLR-4629 - Mark On Mar 22, 2013, at 12:23 AM, Mark Miller wrote: > Let me know if there is anything else you can add. > > A test with your setup that index n docs ran

Re: Solr 4.2 - Slave Index version is higher than Master

2013-03-21 Thread Mark Miller
The other odd thing here is that this should not stop replication at all. When the slave is ahead, it will still have it's index replaced. - Mark On Mar 22, 2013, at 1:26 AM, Mark Miller wrote: > I'm working on testing to try and catch what you are seeing here: > https://i

Re: Solr 4.2 replcation whole index files mechanism.

2013-03-22 Thread Mark Miller
There are a few things going on here that caused this, all resolved in 4.2 as far as I know. - Mark On Mar 22, 2013, at 3:56 AM, bradhill99 wrote: > Hi, > I use solrcloud 4.1. > I start up two solr nodes A and B and then created a new collection using > CoreAdmin to A using o

Re: Solr 4.2 - Slave Index version is higher than Master

2013-03-22 Thread Mark Miller
Are you replicating configuration files as well? - Mark On Mar 22, 2013, at 6:38 AM, "John, Phil (CSS)" wrote: > To add to the discussion. > > We're running classic master/slave replication (not solrcloud) with 1 master > and 2 slaves and I noticed the slave hav

Re: Solr 4.2 - Slave Index version is higher than Master

2013-03-22 Thread Mark Miller
And your also on 4.2? - Mark On Mar 22, 2013, at 12:41 PM, Uomesh wrote: > Also, I am replicating only on commit and startup. > > Thanks, > Umesh > > On Fri, Mar 22, 2013 at 11:23 AM, Umesh Sharma wrote: > >> Hi Mrk, >> >> I am replicating

Re: Solr 4.2 - Slave Index version is higher than Master

2013-03-22 Thread Mark Miller
n't happen when configs don't replicate). I'll see what I can do to try and get a test to catch it. - mark On Mar 22, 2013, at 1:49 PM, Mark Miller wrote: > And your also on 4.2? > > - Mark > > On Mar 22, 2013, at 12:41 PM, Uomesh wrote: > >> Also, I am

Re: overseer queue clogged

2013-03-22 Thread Mark Miller
On Mar 22, 2013, at 5:54 PM, Gary Yngve wrote: > Thanks, Mark! > > The core node names in the solr.xml in solr4.2 is great! Maybe in 4.3 it > can be supported via API? It is with the core admin api - do you mean the collections api? Please make a JIRA for any feature requests s

Re: Did something change with Payloads?

2013-03-22 Thread Mark Miller
- if you have compiled a lot of evidence (sorry i have not had time to follow up on this myself), please create a jira issue for more prominence. - Mark > > Jim > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Did-something-change-with-Payloads-tp4049561p4050599.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: Accessing SolrZkClient instance from a plug-in?

2013-03-25 Thread Mark Miller
I don't know the ValueSourceParser from a hole in my head, but it looks like it has access to the solrcore with fp.req.getCore? If so, it's easy to get the zk stuff core.getCoreDescriptor.getCoreContainer.getZkController(.getZkClient). From memory, so perhaps with some minor misnam

Re: Solrcloud 4.1 Collection with multiple slices only use

2013-03-25 Thread Mark Miller
I'm guessing you didn't specify numShards. Things changed in 4.1 - if you don't specify numShards it goes into a mode where it's up to you to distribute updates. - Mark On Mar 25, 2013, at 10:29 PM, Chris R wrote: > I have two issues and I'm unsure if they are r

Re: Accessing multicore setup using solrj

2013-03-26 Thread Mark Miller
Are you using SolrCloud mode? - Mark On Mar 26, 2013, at 4:49 AM, J Mohamed Zahoor wrote: > Hi I am having a multi core setup with 2 core "core0" and core1". > How do i insert doc in core 1? > > I am using as below. > > searchServer =

Re: Solr 4.2 - Slave Index version is higher than Master

2013-03-26 Thread Mark Miller
That's pretty interesting. The slave should have no way of doing this without a commit… - Mark On Mar 26, 2013, at 11:07 AM, Uomesh wrote: > Hi Mark, > > Further details: My master details has not changed since last 24 hours but > Slave index version and Gen has increased.

Re: There are no SolrCores running. Using the Solr Admin UI currently requires at least one SolrCore.

2013-03-26 Thread Mark Miller
java.lang.NoSuchMethodError: There must be something off with the jars you are using - a mix of versions or something. - Mark On Mar 26, 2013, at 5:18 PM, Furkan KAMACI wrote: > I use Solr 4.2 on Centos 6.4 at AWS and I have deployed solr wars into two > different amazon instan

Re: Disc space and replication

2013-03-27 Thread Mark Miller
Use merge policy settings to control the segment count. > > Is it correct that currently the only option for now the make more shards to > reduce the disc space? ?? > > Is the any progress in the resharding option the developers are working on? Yes, see the JIRA issue on sh

Re: Solr 4.1 SolrCloud with 1 shard and 3 replicas

2013-03-27 Thread Mark Miller
They are load-balanced across the cluster unless you pass the distrib=false param. - Mark On Mar 27, 2013, at 2:51 PM, Bill Au wrote: > I am running Solr 4.1. I have set up SolrCloud with 1 leader and 3 > replicas, 4 nodes total. Do query requests send to a node only query the > r

Re: Loadtesting solr/tomcat7 and tomcat stops responding entirely

2013-03-27 Thread Mark Miller
On Mar 27, 2013, at 3:29 PM, Shawn Heisey wrote: > The maxThreads parameter in the jetty config that's included with Solr is set > to 1 Yonik raised this at some point if I remember right - it helps avoid some distrib deadlock issue. - Mark

Re: Warming queries and Solr Cloud - just curious ...

2013-03-27 Thread Mark Miller
Yup. You only want to warm locally. We should add that to the wiki. - Mark On Mar 27, 2013, at 3:54 PM, Timothy Potter wrote: > When running in SolrCloud mode, does it make sense to disable distributed > mode for warming queries? i.e. distrib=false in my warming query config > >

Re: Warming queries and Solr Cloud - just curious ...

2013-03-27 Thread Mark Miller
Ah, interesting. Forgot about doing that issue entirely. - Mark On Mar 27, 2013, at 6:25 PM, Joel Bernstein wrote: > I ran a quick test and distrib=false is being tacked on automatically. Here > is the log record: > > INFO: [collection1] webapp=null path=null > params={sort=

Re: bootstrap_conf without restarting

2013-03-28 Thread Mark Miller
do like: > java -classpath "example/solr-webapp/WEB-INF/lib/*" > org.apache.solr.cloud.ZkCLI -cmd upconfig -zkhost 127.0.0.1:9983 > -confdir example/solr/collection1/conf -confname conf1 I think the examples on the wiki should probably be updated. -solrhome is only needed with the

Re: Solr Cloud update process

2013-03-28 Thread Mark Miller
ollowing rules apply for this: 1. If there is only one config set, when you start a new collection without an explicit link, it will link to it. 2. If a collection does not have an explicit link, but shares the name of a config set, it will link to it. 3. You can set an explicit link. Also, you

Re: Solrcloud 4.1 Collection with multiple slices only use

2013-03-28 Thread Mark Miller
e back to >> the >>> Wiki example. After setting up the two shard example in the first >> tutorial >>> and indexing the three example documents, look at the shards in the Admin >>> UI. The documents are stored in the index where the update with >> directe

Re: How to shut down the SolrCloud?

2013-03-28 Thread Mark Miller
Currently, yes. Stop each web container in the normal fashion. That will do a clean shutdown. - Mark On Mar 28, 2013, at 5:48 PM, "Li, Qiang" wrote: > How to shut down the SolrCloud? Just kill all nodes? > > Regards, > Ivan > > This email message and any attachm

Re: Solrcloud 4.1 Collection with multiple slices only use

2013-03-28 Thread Mark Miller
7;s like a 20 beer event… - Mark

Re: Solrcloud 4.1 Collection with multiple slices only use

2013-03-28 Thread Mark Miller
hy I say the collections API is the way forward - it has none of these limitations. The limitations are all around pre-configuring everything in solr.xml and not using the collections API. - Mark

Re: Solr Cloud update process

2013-03-28 Thread Mark Miller
gt; those files do get deleted or renamed. > > Thanks, > Shawn > Currently, it's a straight upload - if files went away locally, they will stay in zk. It will just replace what you upload. Happy to help implement a sync option or something if you create a JIRA for it. - mark

Re: How to update synonyms.txt without restart?

2013-03-28 Thread Mark Miller
But this is fixed in 4.2 - now the index writer is rebooted on core reload. So that's just 4.0 and 4.1. - Mark On Mar 28, 2013, at 6:48 PM, Chris Hostetter wrote: > > : But solr wiki says: > : ``` > : Starting with Solr4.0, the RELOAD command is implemented in a way that &g

Re: How to update synonyms.txt without restart?

2013-03-28 Thread Mark Miller
Though I think *another* JIRA made data dir not changeable over core reload for some reason I don't recall exactly. But the other stuff is back to being changeable :) - Mark On Mar 28, 2013, at 8:04 PM, Mark Miller wrote: > But this is fixed in 4.2 - now the index writer is rebooted

<    1   2   3   4   5   6   7   8   9   10   >