RE: Solr Replication

2019-01-07 Thread Vadim Ivanov
, January 07, 2019 11:10 AM > To: solr-user@lucene.apache.org > Subject: Re: Solr Replication > > In SolrCloud there are Data Centers. > Your Cluster 1 is DataCenter 1 and your Cluster 2 is Data Center 2. > You can then use CDCR (Cross Data Center Replication). > http://lucene.a

Re: Solr Replication

2019-01-07 Thread Bernd Fehling
In SolrCloud there are Data Centers. Your Cluster 1 is DataCenter 1 and your Cluster 2 is Data Center 2. You can then use CDCR (Cross Data Center Replication). http://lucene.apache.org/solr/guide/7_0/cross-data-center-replication-cdcr.html Nevertheless I would spend your Cluster 2 another 2 zooke

Re: Solr Replication being flaky (6.2.0)

2018-01-20 Thread Erick Erickson
but since we load balance > requestsif the master/slave are out of sync the search results vary. > > The advice is MUCH appreciated! > > -Original Message- > From: Shawn Heisey [mailto:apa...@elyograg.org] > Sent: Friday, January 19, 2018 1:49 PM > To: solr-user

RE: Solr Replication being flaky (6.2.0)

2018-01-19 Thread Pouliot, Scott
Heisey [mailto:apa...@elyograg.org] Sent: Friday, January 19, 2018 1:49 PM To: solr-user@lucene.apache.org Subject: Re: Solr Replication being flaky (6.2.0) On 1/19/2018 11:27 AM, Shawn Heisey wrote: > On 1/19/2018 8:54 AM, Pouliot, Scott wrote: >> I do have a ticket in with our system

Re: Solr Replication being flaky (6.2.0)

2018-01-19 Thread Shawn Heisey
On 1/19/2018 11:27 AM, Shawn Heisey wrote: On 1/19/2018 8:54 AM, Pouliot, Scott wrote: I do have a ticket in with our systems team to up the file handlers since I am seeing the "Too many files open" error on occasion on our prod servers.  Is this the setting you're referring to?  Found we were

Re: Solr Replication being flaky (6.2.0)

2018-01-19 Thread Shawn Heisey
On 1/19/2018 8:54 AM, Pouliot, Scott wrote: I do have a ticket in with our systems team to up the file handlers since I am seeing the "Too many files open" error on occasion on our prod servers. Is this the setting you're referring to? Found we were set to to 1024 using the "Ulimit" command.

RE: Solr Replication being flaky (6.2.0)

2018-01-19 Thread Pouliot, Scott
That's evidence enough for me to beat on our systems guys to get these file handles upped and cross my fingers then! -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Friday, January 19, 2018 1:18 PM To: solr-user Subject: Re: Solr Replication being

Re: Solr Replication being flaky (6.2.0)

2018-01-19 Thread Erick Erickson
working like a champ, except when things get out of sync. > > Scott > > -Original Message- > From: Erick Erickson [mailto:erickerick...@gmail.com] > Sent: Friday, January 19, 2018 12:27 PM > To: solr-user > Subject: Re: Solr Replication being flaky (6.2.0) > >

RE: Solr Replication being flaky (6.2.0)

2018-01-19 Thread Pouliot, Scott
Subject: Re: Solr Replication being flaky (6.2.0) Scott: We usually recommend setting files and processes very, very high. Like 65K high. Or unlimited if you can. Plus max user processes should also be bumped very high as well, like 65K as well. Plus max memory and virtual memory should be

Re: Solr Replication being flaky (6.2.0)

2018-01-19 Thread Erick Erickson
this the setting you're referring to? Found we were set to to 1024 using > the "Ulimit" command. > > -Original Message- > From: Shawn Heisey [mailto:apa...@elyograg.org] > Sent: Friday, January 19, 2018 10:48 AM > To: solr-user@lucene.apache.org > Subject: Re

RE: Solr Replication being flaky (6.2.0)

2018-01-19 Thread Pouliot, Scott
Message- From: Shawn Heisey [mailto:apa...@elyograg.org] Sent: Friday, January 19, 2018 10:48 AM To: solr-user@lucene.apache.org Subject: Re: Solr Replication being flaky (6.2.0) On 1/19/2018 7:50 AM, Pouliot, Scott wrote: > So we're running Solr in a Master/Slave configuration (1

Re: Solr Replication being flaky (6.2.0)

2018-01-19 Thread Shawn Heisey
On 1/19/2018 7:50 AM, Pouliot, Scott wrote: So we're running Solr in a Master/Slave configuration (1 of each) and it seems that the replication stalls or stops functioning every now and again. If we restart the Solr service or optimize the core it seems to kick back in again. Anyone have any

RE: Solr Replication being flaky (6.2.0)

2018-01-19 Thread Pouliot, Scott
-Original Message- From: David Hastings [mailto:hastings.recurs...@gmail.com] Sent: Friday, January 19, 2018 10:35 AM To: solr-user@lucene.apache.org Subject: Re: Solr Replication being flaky (6.2.0) This happens to me quite often as well. Generally on the replication admin screen

Re: Solr Replication being flaky (6.2.0)

2018-01-19 Thread David Hastings
This happens to me quite often as well. Generally on the replication admin screen it will say its downloading a file, but be at 0 or a VERY small kb/sec. Then after a restart of the slave its back to downloading at 30 to 100 mg/sec. Would be curious if there actually is a solution to this aside

Re: Solr replication

2017-09-20 Thread Satyaprashant Bezwada
Thanks Eric, fixed the issue. The IT team corrected the solrconfig.xml but forgot to execute the zkcli.sh script on solr node. After I executed the script its working now. On 9/20/17, 10:20 AM, "Erick Erickson" wrote: WARNING - External email; exercise caution. Your solrconf

Re: Solr replication

2017-09-20 Thread Erick Erickson
Your solrconfig.xml file is mal-formed. The smoking gun is: Exception during parsing file: solrconfig.xml Best, Erick On Tue, Sep 19, 2017 at 4:48 PM, Satyaprashant Bezwada wrote: > Need some inputs or help in resolving replication across solr nodes. We have > installed Solr 6.5 in cloud mode

Re: Solr Replication sometimes coming in log files

2015-09-14 Thread Upayavira
I bet you have the admin UI open on your second slave. The _=144... is the give-away. Those requests are the admin UI asking the replication handler for the status of replication. Upayavira On Wed, Sep 9, 2015, at 06:32 AM, Kamal Kishore Aggarwal wrote: > Hi Team, > > I am currently working with

Re: Solr Replication sometimes coming in log files

2015-09-14 Thread Mikhail Khludnev
Hello, I'd say opposite: high load causes long time to respond. 'command=details' is rather cheap and fast _I believe_. On Mon, Sep 14, 2015 at 10:20 AM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > Can anybody suggest me something.. > > On Wed, Sep 9, 2015 at 11:02 AM, Kamal Kishore

Re: Solr Replication sometimes coming in log files

2015-09-14 Thread Kamal Kishore Aggarwal
Can anybody suggest me something.. On Wed, Sep 9, 2015 at 11:02 AM, Kamal Kishore Aggarwal < kkroyal@gmail.com> wrote: > Hi Team, > > I am currently working with Java-1.7, Solr-4.8.1 with tomcat 7. The solr > configuration has master & slave ( 2 Slaves) architecture. > > > Master & Slave 2 ar

Re: solr replication vs. rsync

2015-01-25 Thread Erick Erickson
bq: I thought SolrCloud replicas were replication, and you imply parallel indexing Absolutely! You couldn't get near-real-time indexing if you relied on replication a-la 3x. And you also couldn't guarantee consistency. Say you have 1 shard, a leader and a follower (i.e. 2 replicas). Now you thro

Re: solr replication vs. rsync

2015-01-25 Thread Dan Davis
@Erick, Problem space is not constant indexing. I thought SolrCloud replicas were replication, and you imply parallel indexing. Good to know. On Sunday, January 25, 2015, Erick Erickson wrote: > @Shawn: Cool table, thanks! > > @Dan: > Just to throw a different spin on it, if you migrate to S

Re: solr replication vs. rsync

2015-01-25 Thread Dan Davis
Thanks! On Sunday, January 25, 2015, Erick Erickson wrote: > @Shawn: Cool table, thanks! > > @Dan: > Just to throw a different spin on it, if you migrate to SolrCloud, then > this question becomes moot as the raw documents are sent to each of the > replicas so you very rarely have to copy the fu

Re: solr replication vs. rsync

2015-01-25 Thread Erick Erickson
@Shawn: Cool table, thanks! @Dan: Just to throw a different spin on it, if you migrate to SolrCloud, then this question becomes moot as the raw documents are sent to each of the replicas so you very rarely have to copy the full index. Kind of a tradeoff between constant load because you're sending

Re: solr replication vs. rsync

2015-01-25 Thread Shawn Heisey
On 1/24/2015 10:56 PM, Dan Davis wrote: > When I polled the various projects already using Solr at my organization, I > was greatly surprised that none of them were using Solr replication, > because they had talked about "replicating" the data. > > But we are not Pinterest, and do not expect to be

Re: Solr Replication during Tomcat shutdown causes shutdown to hang/fail

2014-10-13 Thread Phil Black-Knight
I haven't seen any activity regarding this in Jira, just curious if it would be looked into anytime soon... On Thu, Oct 2, 2014 at 10:11 AM, Phil Black-Knight < pblackkni...@globalgiving.org> wrote: > see the ticket here: > https://issues.apache.org/jira/browse/SOLR-6579 > > including a patch to

Re: Solr Replication during Tomcat shutdown causes shutdown to hang/fail

2014-10-02 Thread Phil Black-Knight
see the ticket here: https://issues.apache.org/jira/browse/SOLR-6579 including a patch to fix it. On Thu, Oct 2, 2014 at 9:44 AM, Shawn Heisey wrote: > On 10/2/2014 7:25 AM, Phil Black-Knight wrote: > > I was helping to look into this with Nick & I think we may have figured > out > > the core o

Re: Solr Replication during Tomcat shutdown causes shutdown to hang/fail

2014-10-02 Thread Shawn Heisey
On 10/2/2014 7:25 AM, Phil Black-Knight wrote: > I was helping to look into this with Nick & I think we may have figured out > the core of the problem... > > The problem is easily reproducible by starting replication on the slave and > then sending a shutdown command to tomcat (e.g. catalina.sh st

RE: Solr Replication during Tomcat shutdown causes shutdown to hang/fail

2014-10-02 Thread Phil Black-Knight
I was helping to look into this with Nick & I think we may have figured out the core of the problem... The problem is easily reproducible by starting replication on the slave and then sending a shutdown command to tomcat (e.g. catalina.sh stop). With a debugger attached, it looks like the fsyncSe

Re: SolR replication issue

2014-09-01 Thread Mauricio Ferreyra
The entire stacktrace: ERROR SolrIndexWriter Coud not unlock directory after seemingly failed IndexWriter#close() org.apache.lucene.store.LockReleaseFailedException: Cannot forcefully unlock a NativeFSLock which is held by another indexer component: /home/miapp/collection1/data/index.2014090114080

Re: SolR replication issue

2014-09-01 Thread Shawn Heisey
On 9/1/2014 10:31 AM, Mauricio Ferreyra wrote: > I'm using Solr 4.3.1 with a master/slave configuration. > > Configuration: > > Master: > * * > * commit* > * startup* > * schema.xml,stopwords.txt* > * * > > > Slave: > * * > * http://10.xx.xx.xx:90

Re: Solr Replication Issue : Incorrect Base_URL

2014-06-13 Thread Alan Woodward
Hi Pramod, You need to set hostContext in your solr.xml. See https://cwiki.apache.org/confluence/display/solr/Format+of+solr.xml Alan Woodward www.flax.co.uk On 13 Jun 2014, at 00:44, pramodEbay wrote: > Hi, > I am deploying Solr in a larger web application. The standalone solr > instance wo

Re: SOLR replication question?

2013-07-29 Thread Shawn Heisey
> I am currently using SOLR 4.4. but not planning to use solrcloud in very near > future. > I have 3 master / 3 slave setup. Each master is linked to its > corresponding > slave.. I have disabled auto polling.. > We do both push (using MQ) and pull indexing using SOLRJ indexing program. > I have en

Re: Solr replication is extremely slow(less then 1MB/s)

2013-06-24 Thread William Bell
I agree. It is even slower when the slave is being pounded. On Fri, Jun 21, 2013 at 3:35 AM, Ted wrote: > Solr replication is extremely slow(less then 1MB/s) > > When the replication is runinng,network and disk occupancy rate remained at > a very low level. > > I've tried downloading a piece of

Re: Solr Replication

2013-03-16 Thread Erick Erickson
Why do you think that during a backup any write activity would corrupt your backup? Solr "backs up" live indexes all the time, that's what's happening, in effect, when you replicate from a master to a slave. There's no requirement that the master stop indexing. The replication "backup" command Ahme

Re: Solr Replication

2013-03-14 Thread vicky desai
Hi, I have a multi core setup and there is continuous updation going on in each core. Hence I dont prefer a bckup as it would either cause a downtime or if during a backup there is a write activity my backup will be corrupted. Can you please suggest if there is a cleaner way to handle this -- V

Re: Solr Replication

2013-03-14 Thread Ahmet Arslan
Hi Vicky, May be startup ? For backups http://master_host:port/solr/replication?command=backup would be more suitable. or startup --- On Thu, 3/14/13, vicky desai wrote: > From: vicky desai > Subject: Solr Replication > To: solr-user@lucene.apache.org > Date: Thursday, March 14, 2013, 9:

Re: Solr replication takes long time

2013-03-13 Thread Victor Ruiz
While looking at Solr logs, I found a java.lang.OutOfMemoryError: Java heap space that was happening 2 times per hour So I tried to increase the max memory heap assigned to JVM (-Xmx) and since then the servers are not crashing, even though the replication takes still long time to complete. But f

Re: Solr replication takes long time

2013-03-13 Thread Victor Ruiz
After upgrading to 4.2, the problem is not yet solved, in this image you can see, how slow is the transfer speed. At least, after the update the master is not blocked during replication Any idea? -- View this message in co

Re: Solr replication takes long time

2013-03-11 Thread Victor Ruiz
Thanks for your answer Mark. I think I'll try to update to 4.2. I'll keep you updated. Anyway, I'd not say that the full index is replicated, I've been monitoring the replication process in the Solr admin console and there I see that usually not more than 50-100 files are transferrend, the total s

Re: Solr replication takes long time

2013-03-11 Thread Mark Miller
Okay - yes, 4.0 is a better choice for replication than 4.1. It almost sounds like you may be replicating the full index rather than just changes or something. 4.0 had a couple issues as well - a couple things that were discovered while writing stronger tests for 4.2. 4.2 is spreading onto mirr

Re: Solr replication takes long time

2013-03-11 Thread Victor Ruiz
no, Solr 4.0.0, I wanted to update to Solr 4.1 but I read that there was an issue with the replication, so I decided not to try it for now Mark Miller-3 wrote > Are you using Solr 4.1? > > - Mark > > On Mar 11, 2013, at 1:53 PM, Victor Ruiz < > bik1979@ > > wrote: > >> Hi guys, >> >> I have

Re: Solr replication takes long time

2013-03-11 Thread Mark Miller
Are you using Solr 4.1? - Mark On Mar 11, 2013, at 1:53 PM, Victor Ruiz wrote: > Hi guys, > > I have a problem with Solr replication. I have 2 solr servers (Solr 4.0.0) 1 > master and 1 slave (8 processors,16GB RAM ,Ubuntu 11, ext3, each). In > every server, there are 2 independent instances

Re: Solr replication

2012-11-27 Thread Erick Erickson
BTW, when I said "I think to say anything intelligent" I meant "I think for _me_ to say anything intelligent". Didn't mean to be snarky Erick On Mon, Nov 26, 2012 at 8:19 AM, Erick Erickson wrote: > "both servers are master and slave in the config file". So that means > they're polling each

Re: Solr replication

2012-11-26 Thread Erick Erickson
"both servers are master and slave in the config file". So that means they're polling each other? I think to say anything intelligent you're going to have to provide more data. Please review: http://wiki.apache.org/solr/UsingMailingLists. The bottom line here is that it sounds like what you're try

Re: Solr replication

2012-11-26 Thread jacques.cortes
Thanks Antoine. In fact, both solr servers are master and slave in config file. They have the same config file and replicate from the same master url with the vip. So, the master is on the server with the vip mounted on. And if heartbeat toggle, the role is toggled too. The question is : what can

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-06 Thread deniz
Erik Hatcher-4 wrote > There's an open issue (with a patch!) that enables this, it seems: > ; > > Erik well patch seems not doing that... i have tried and still getting some error lines about the dir types - Zeki ama calismiyor... Cal

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-05 Thread Michael Della Bitta
Here's some reading: http://en.wikipedia.org/wiki/Page_cache Michael Della Bitta Appinions 18 East 41st Street, 2nd Floor New York, NY 10017-6271 www.appinions.com Where Influence Isn’t a Game On Mon, Nov 5, 2012 at 8:02 PM, deniz wrote: > Er

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-05 Thread Shawn Heisey
> Shawn Heisey-4 wrote >> ... transparently mapping the files on disk to a virtual memory space >> and >> using excess RAM to cache that data and make it fast. If you have >> enough extra memory (disk cache) to fit the entire index, the OS will >> never have to read any part of the index from dis

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-05 Thread deniz
Erik Hatcher-4 wrote > There's an open issue (with a patch!) that enables this, it seems: > ; i will check it for sure, thank you Erik :) Shawn Heisey-4 wrote > ... transparently mapping the files on disk to a virtual memory space and > using ex

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-05 Thread Erik Hatcher
There's an open issue (with a patch!) that enables this, it seems: Erik On Nov 5, 2012, at 07:41 , deniz wrote: > Michael Della Bitta-2 wrote >> No, RAMDirectory doesn't work for replication. Use MMapDirectory... it >> ends up storing th

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-04 Thread Shawn Heisey
On 11/4/2012 11:41 PM, deniz wrote: Michael Della Bitta-2 wrote No, RAMDirectory doesn't work for replication. Use MMapDirectory... it ends up storing the index in RAM and more efficiently so, plus it's backed by disk. Just be sure to not set a big heap because MMapDirectory works outside of he

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-04 Thread deniz
Michael Della Bitta-2 wrote > No, RAMDirectory doesn't work for replication. Use MMapDirectory... it > ends up storing the index in RAM and more efficiently so, plus it's > backed by disk. > > Just be sure to not set a big heap because MMapDirectory works outside of > heap. for my tests, i dont t

Re: Solr Replication is not Possible on RAMDirectory?

2012-11-02 Thread Michael Della Bitta
> so it is not possible to use RAMdirectory for replication? No, RAMDirectory doesn't work for replication. Use MMapDirectory... it ends up storing the index in RAM and more efficiently so, plus it's backed by disk. Just be sure to not set a big heap because MMapDirectory works outside of heap.

Re: solr replication against active indexing on master

2012-11-01 Thread Jie Sun
thanks... I just read the related code ... now I understand it seems the master keeps replicable snapshots (version), so it should be static. thank you Otis! -- View this message in context: http://lucene.472066.n3.nabble.com/solr-replication-against-active-indexing-on-master-tp4017696p4017743.

Re: solr replication against active indexing on master

2012-11-01 Thread Otis Gospodnetic
Hi, I don't have sources handy but you could start from SnapPuller.Java. Otis -- Performance Monitoring - http://sematext.com/spm On Nov 1, 2012 6:18 PM, "Jie Sun" wrote: > thanks ... > > could you please point me to some more detailed explanation on line or I > will have to read the code to fi

Re: solr replication against active indexing on master

2012-11-01 Thread Jie Sun
thanks ... could you please point me to some more detailed explanation on line or I will have to read the code to find out? I would like to understand a little more on how this is achieved. thanks! Jie -- View this message in context: http://lucene.472066.n3.nabble.com/solr-replication-agains

Re: Solr replication hangs on multiple slave nodes

2012-10-04 Thread Otis Gospodnetic
Hi, I haven't seen this error before. Some questions/suggestions... Have you tried with 3.6.1? Is the disk full? Have you tried watching the network with http://code.google.com/p/tcpmon/ or tcpdump? Otis -- Search Analytics - http://sematext.com/search-analytics/index.html Performance Monitoring

Re: Solr Replication and Autocommit

2012-09-27 Thread Aleksey Vorona
Thank both of you for the responses! -- Aleksey On 12-09-27 03:51 AM, Erick Erickson wrote: I'll echo Otis, nothing comes to mind... Unless you were indexing stuff to the _slaves_, which you should never do, now or in the past Erick On Thu, Sep 27, 2012 at 12:00 AM, Aleksey Vorona wrote

Re: Solr Replication and Autocommit

2012-09-27 Thread Erick Erickson
I'll echo Otis, nothing comes to mind... Unless you were indexing stuff to the _slaves_, which you should never do, now or in the past Erick On Thu, Sep 27, 2012 at 12:00 AM, Aleksey Vorona wrote: > Hi, > > I remember having some issues with replication and autocommit previously. > But now

Re: Solr Replication and Autocommit

2012-09-26 Thread Otis Gospodnetic
No issues that I know of, never encountered such an issue with any if our clients using Solr. Otis -- Performance Monitoring - http://sematext.com/spm On Sep 27, 2012 12:00 AM, "Aleksey Vorona" wrote: > Hi, > > I remember having some issues with replication and autocommit previously. > But now w

Re: solr replication lag

2012-06-07 Thread Michael Della Bitta
Hello, Boris, If I remember correctly, older versions of Solr report the version of the as-of-yet uncommitted core in the replication page. So if you did a commit on the master and then a replication, you'd see that version on the client. Michael Della Bitta -

Re: solr replication failing with error: Master at: is not available. Index fetch failed

2012-04-26 Thread Mark Miller
On Apr 23, 2012, at 12:10 PM, geeky2 wrote: > http://someip:someport/somepath/somecore/admin/replication/ is not > available. Index fetch failed. Exception: Invalid version (expected 2, but > 10) or the data in not in 'javabin' format This is kind of a bug. When Solr tries to talk in javabin and

Re: solr replication failing with error: Master at: is not available. Index fetch failed

2012-04-26 Thread geeky2
hello, sorry - i overlooked this message - thanks for checking back and thanks for the info. yes - replication seems to be working now: tailed from logs just now: 2012-04-26 09:21:33,284 INFO [org.apache.solr.handler.SnapPuller] (pool-12-thread-1) Slave in sync with master. 2012-04-26 09:21:53

Re: solr replication failing with error: Master at: is not available. Index fetch failed

2012-04-25 Thread Rahul Warawdekar
Hi, Is the replication still failing or working fine with that change ? On Tue, Apr 24, 2012 at 2:16 PM, geeky2 wrote: > that was it! > > thank you. > > i did notice something else in the logs now ... > > what is the meaning or implication of the message, "Connection reset".? > > > > 2012-04-24

Re: solr replication failing with error: Master at: is not available. Index fetch failed

2012-04-24 Thread geeky2
that was it! thank you. i did notice something else in the logs now ... what is the meaning or implication of the message, "Connection reset".? 2012-04-24 12:59:19,996 INFO [org.apache.solr.handler.SnapPuller] (pool-12-thread-1) Slave in sync with master. 2012-04-24 12:59:39,998 INFO [org.a

Re: solr replication failing with error: Master at: is not available. Index fetch failed

2012-04-24 Thread Rahul Warawdekar
Hi, In Solr wiki, for replication, the master url is defined as follows http://master_host:port /solr/corename/replication This url does not contain "admin" in its path where as in the master url provided by you, you have an additional "admin" in the url. Not very sure if this might be an issue b

Re: solr replication failing with error: Master at: is not available. Index fetch failed

2012-04-24 Thread geeky2
hello, thank you for the reply, yes - master has been indexed. ok - makes sense - the polling interval needs to change i did check the solr war file on both boxes (master and slave). they are identical. actually - if they were not indentical - this would point to a different issue altogether

Re: solr replication failing with error: Master at: is not available. Index fetch failed

2012-04-23 Thread Erick Erickson
Hmmm, does your master have an index? In other words have you added anything to it? I actually doubt that's an issue, but An aside, a polling interval of 20 seconds is rather short, beware of your autowarming time exceeding your index updates But my _first_ guess is that somehow you're So

Re: solr replication

2012-01-25 Thread Parvin Gasimzade
Hi Anderson, Thank you for your effort.I will try this. Hope it will solve my problem. Regards On Wed, Jan 25, 2012 at 2:27 PM, Anderson vasconcelos < anderson.v...@gmail.com> wrote: > Hi Parvin > > I did something that may help you. I set up apache (with mod_proxy and mode > balance) like a fr

Re: solr replication

2012-01-25 Thread Anderson vasconcelos
Hi Parvin I did something that may help you. I set up apache (with mod_proxy and mode balance) like a front-end and use this to distruted the request of my aplication. Request for /update or /optmize, i'm redirect to master (or masters) server and requests /search i redirect to slaves. Example:

Re: solr replication

2012-01-25 Thread Parvin Gasimzade
Ok thank you for your response. On Wed, Jan 25, 2012 at 12:24 PM, darul wrote: > I mean by grid the list of your instances : > > String masterUrl = "http://masterUrl/core/..."; > String[] slaveUrls = {"http://slaveUrl/core/...";, > "http://slaveUrl/core/..."} > > Then use your business logic to

Re: solr replication

2012-01-25 Thread darul
I mean by grid the list of your instances : String masterUrl = "http://masterUrl/core/..."; String[] slaveUrls = {"http://slaveUrl/core/...";, "http://slaveUrl/core/..."} Then use your business logic to use the correct one with Http solrJ facade. -- View this message in context: http://lucene.4

Re: solr replication

2012-01-25 Thread Parvin Gasimzade
Thank you for your response. What you mean by Grid? Can you please send me any example or any link? On Wed, Jan 25, 2012 at 11:30 AM, darul wrote: > You may define your specific configuration as a Grid with all your solr > instances and then using SolrJ and CommonsHttpSolrServer choose the righ

Re: solr replication

2012-01-25 Thread darul
You may define your specific configuration as a Grid with all your solr instances and then using SolrJ and CommonsHttpSolrServer choose the right url depending on indexation or search task. -- View this message in context: http://lucene.472066.n3.nabble.com/solr-replication-tp3687106p3687208.html

Re: solr replication

2012-01-25 Thread Parvin Gasimzade
Then as you say , shouldn't i define three SolrServer() using SolrJ? For indexing call solrMasterServer, and for querying call solrSlaveServer1 or solrSlaveServer2? On Wed, Jan 25, 2012 at 11:09 AM, darul wrote: > Here is the way I see it (and implemented it), while using SolrJ api you > have >

Re: solr replication

2012-01-25 Thread darul
Here is the way I see it (and implemented it), while using SolrJ api you have to fire : - Indexation commands to your /indexation solr instance/ (master) example : http://myMaster:80/myCore/ - Query commands to your /search solr instance/ (slave). You may have several slaves, and also find alterna

Re: Solr Replication: relative path in confFiles Element?

2011-10-25 Thread Yury Kats
On 10/25/2011 11:24 AM, Mark Schoy wrote: > Hi, > > is ist possible to define a relative path in confFile? > > For example: > > ../../x.xml > > If yes, to which location will the file be copied at the slave? I don;t think it's possible. Replication copies confFiles from master core's confDir t

Re: SOLR replication monitoring

2011-10-10 Thread Yury Kats
On 10/10/2011 5:18 AM, Alexander Valet | edelight wrote: > Hi, > > we are about to develop a replication dashboard for our master / slaves setup > to monitor and control replication through a single interface. > > Has anybody experience with this and could share some hint, ideas, learnings > wit

Re: Solr replication / repeater

2011-09-05 Thread Rene Lehmann
Hey Erik, Hey Chris, thank you for your answers. I think i now understand better the functioning. kind regards Rene

Re: Solr replication / repeater

2011-09-02 Thread Chris Hostetter
: i´m really new in Solr and have a question about the Solr replication. : We want to use Solr in two data centers (dedicated fibre channel lane, like : intranet) behind a load balancer. Is the following infrastructure possible? : : - one repeater and one slave per data center : - the repeaters u

Re: Solr Replication / Repeater

2011-09-02 Thread Erick Erickson
It looks good except for the "repeaters used to each other for replication". Having the masters use each other for replication implies that you're indexing data to both of them, in which case you wouldn't need them to update from each other! So you really have two choices I think 1> designate one

Re: Solr replication / repeater

2011-09-02 Thread Rene Lehmann
Hi, no ideas? :( kind regards, Rene From: Rene Lehmann To: solr-user@lucene.apache.org Date: 01.09.2011 15:36 Subject:Solr replication / repeater Hi there, i´m really new in Solr and have a question about the Solr replication. We want to use Solr in two data centers (

Re: solr replication

2011-07-07 Thread William Bell
You can query the replication status on the slave... When it is complete continue... On Thu, Jul 7, 2011 at 3:40 PM, Nolan Frausto wrote: > We are looking for a call back to know when replication has finished after > we force a replication using > http://slave_host:port/solr/replication?command=f

Re: Solr replication, HAproxy and data management

2010-12-13 Thread Paolo Castagna
Paolo Castagna wrote: Hi, we are using Solr v1.4.x with multi-cores and a master/slaves configuration. We also use HAProxy [1] to load balance search requests amongst slaves. Finally, we use MapReduce to create new Solr indexes. I'd like to share with you what I am doing when I need to: 1. a

Re: Solr Replication Questions

2010-01-05 Thread Noble Paul നോബിള്‍ नोब्ळ्
On Wed, Jan 6, 2010 at 2:51 AM, Giovanni Fernandez-Kincade wrote: > http://wiki.apache.org/solr/SolrReplication > > I've been looking over this replication wiki and I'm still unclear on a two > points about Solr Replication: > > 1.     If there have been small changes to the index on the master,

Re: SOLR: Replication

2010-01-03 Thread Yonik Seeley
On Sun, Jan 3, 2010 at 2:55 PM, Peter Wolanin wrote: > Related to the difference between rsync and native Solr replication - > we are seeing issues with Solr 1.4 where search queries that come in > during a replication request hang for excessive amount of time (up to > 100's of seconds for a resul

Re: SOLR: Replication

2010-01-03 Thread Peter Wolanin
..@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik >> Seeley >> Sent: January-03-10 10:03 AM >> To: solr-user@lucene.apache.org >> Subject: Re: SOLR: Replication >> >> On Sat, Jan 2, 2010 at 11:35 PM, Fuad Efendi wrote: >> > I tried... I set APR to im

RE: SOLR: Replication

2010-01-03 Thread Fuad Efendi
> Seeley > Sent: January-03-10 10:03 AM > To: solr-user@lucene.apache.org > Subject: Re: SOLR: Replication > > On Sat, Jan 2, 2010 at 11:35 PM, Fuad Efendi wrote: > > I tried... I set APR to improve performance... server is slow while > replica; > > but "top&qu

Re: SOLR: Replication

2010-01-03 Thread Yonik Seeley
On Sat, Jan 2, 2010 at 11:35 PM, Fuad Efendi wrote: > I tried... I set APR to improve performance... server is slow while replica; > but "top" shows only 1% of I/O wait... it is probably environment specific; So you're saying that stock tomcat (non-native APR) was also 10 times slower? > but the

RE: SOLR: Replication

2010-01-02 Thread Fuad Efendi
could be base64 or something like that; RAM-buffer, flush to disk, etc. -Fuad > -Original Message- > From: ysee...@gmail.com [mailto:ysee...@gmail.com] On Behalf Of Yonik > Seeley > Sent: January-02-10 5:52 PM > To: solr-user@lucene.apache.org > Subject: Re: SOLR: Replic

Re: SOLR: Replication

2010-01-02 Thread Yonik Seeley
On Sat, Jan 2, 2010 at 5:48 PM, Fuad Efendi wrote: > I used RSYNC before, and 20Gb replica took less than an hour (20-40 > minutes); now, HTTP, and it takes 5-6 hours... > Admin screen shows 952Kb/sec average speed; 100Mbps network, full-duplex; I > am using Tomcat Native for APR. 10x times slow..

RE: Solr replication 1.3 issue

2009-12-22 Thread Maduranga Kannangara
anks again. Madu -Original Message- From: Lance Norskog [mailto:goks...@gmail.com] Sent: Wednesday, 23 December 2009 9:33 AM To: solr-user@lucene.apache.org Subject: Re: Solr replication 1.3 issue This is a Unix security question. "rsyncd' is a system daemon and should be manag

Re: Solr replication 1.3 issue

2009-12-22 Thread Lance Norskog
This is a Unix security question. "rsyncd' is a system daemon and should be managed in the OS scripts. The rsyncd-* scripts include a security setting for the 'solr' account that limits the account to the solr data directory (and this code does not support multicore). For security reasons, I perso

RE: Solr Replication: How to restore data from last snapshot

2009-11-08 Thread Osborn Chan
What happen if it is multiple core? Thanks -Original Message- From: noble.p...@gmail.com [mailto:noble.p...@gmail.com] On Behalf Of Noble Paul ??? ?? Sent: Friday, November 06, 2009 10:49 PM To: solr-user@lucene.apache.org Subject: Re: Solr Replication: How to restore data from

Re: Solr Replication: How to restore data from last snapshot

2009-11-08 Thread Chris Hostetter
: Subject: Solr Replication: How to restore data from last snapshot : References: <8950e934db69a040a1783438e67293d813da3f6...@delmail.sapient.com> : <26230840.p...@talk.nabble.com> : : In-Reply-To: http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When sta

Re: Solr Replication: How to restore data from last snapshot

2009-11-06 Thread Noble Paul നോബിള്‍ नोब्ळ्
ail.com] > Sent: Friday, November 06, 2009 12:20 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr Replication: How to restore data from last snapshot > > If your master index is corrupt and it hasn't been replicated out, you > should be able to shut down the server and re

Re: Solr Replication

2009-08-28 Thread Shalin Shekhar Mangar
On Fri, Aug 28, 2009 at 2:04 AM, J G wrote: > > We have multiple solr webapps all running from the same WAR file. Each > webapp is running under the same Tomcat container and I consider each webapp > the same thing as a "slice" (or "instance"). I've configured the Tomcat > container to enable JMX

Re: Solr Replication

2009-08-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
t; as in using the replication admin page for each web app. > > Thanks. > > > > > >> From: noble.p...@corp.aol.com >> Date: Thu, 27 Aug 2009 13:04:38 +0530 >> Subject: Re: Solr Replication >> To: solr-user@lucene.apache.org >> >> when you say a slice yo

RE: Solr Replication

2009-08-27 Thread J G
e replication information using JMX as in using the replication admin page for each web app. Thanks. > From: noble.p...@corp.aol.com > Date: Thu, 27 Aug 2009 13:04:38 +0530 > Subject: Re: Solr Replication > To: solr-user@lucene.apache.org > > when you say a slice you mean one

Re: Solr Replication

2009-08-27 Thread Noble Paul നോബിള്‍ नोब्ळ्
uot;instance" via each > replication admin jsp page? > > Thanks again. > >> From: noble.p...@corp.aol.com >> Date: Wed, 26 Aug 2009 11:05:34 +0530 >> Subject: Re: Solr Replication >> To: solr-user@lucene.apache.org >> >> The ReplicationHandler is not

  1   2   >