Hi Akreeti, How much should I set "commitReserveDuration" for 2.62 GB ?
That's why I asked you about the time taken by the replication. You can easily get hint about it after manually starting replication. The commitReserveDuration should be roughly set as the time taken to download 5MB from master to slave. Do read the resource I had shared. On Fri, 13 Sep 2019 at 14:24, Akreeti Agarwal <akree...@hcl.com> wrote: > Hi, > > I have no idea about how much time is taken for successful replication for > 2.62 GB. How much should I set "commitReserveDuration" for 2.62 GB ? > > Thanks & Regards, > Akreeti Agarwal > > -----Original Message----- > From: Paras Lehana <paras.leh...@indiamart.com> > Sent: Thursday, September 12, 2019 6:46 PM > To: solr-user@lucene.apache.org > Subject: Re: Replication Iteration > > Hey Akreeti, > > <str name="commitReserveDuration">00:00:10</str> > > > Have you tried increasing *commitReserveDuration*? Do you have any idea > how much time your successful replications take for 2.62 GB? > > > > On Wed, 11 Sep 2019 at 22:30, Akreeti Agarwal <akree...@hcl.com> wrote: > > > Hi, > > > > It fails many times, sharing the iteration: > > > > Passed: > > Wed Sep 11 16:49:18 UTC 2019 > > Wed Sep 11 16:48:56 UTC 2019 > > Wed Sep 11 16:48:36 UTC 2019 > > Wed Sep 11 16:48:18 UTC 2019 > > Wed Sep 11 16:47:55 UTC 2019 > > Wed Sep 11 16:47:35 UTC 2019 > > Wed Sep 11 16:47:16 UTC 2019 > > Wed Sep 11 16:46:55 UTC 2019 > > Wed Sep 11 16:46:33 UTC 2019 > > > > Failed: > > Wed Sep 11 16:42:47 UTC 2019 > > Wed Sep 11 16:36:07 UTC 2019 > > Wed Sep 11 16:32:47 UTC 2019 > > Wed Sep 11 16:29:27 UTC 2019 > > Wed Sep 11 16:24:27 UTC 2019 > > Wed Sep 11 16:11:07 UTC 2019 > > Wed Sep 11 16:09:47 UTC 2019 > > Wed Sep 11 16:05:47 UTC 2019 > > Wed Sep 11 15:53:27 UTC 2019 > > Wed Sep 11 15:51:47 UTC 2019 > > > > Memory details: > > > > total used free shared buffers cached > > Mem: 15947 15549 398 62 198 5650 > > -/+ buffers/cache: 9700 6246 > > Swap: 0 0 0 > > > > > > Thanks & Regards, > > Akreeti Agarwal > > > > > > -----Original Message----- > > From: Jon Kjær Amundsen <j...@udbudsvagten.dk> > > Sent: Wednesday, September 11, 2019 7:28 PM > > To: solr-user@lucene.apache.org > > Subject: Re: Replication Iteration > > > > Is it every time it fails, or just sometimes? > > What is the timestamps on the failed and passed iterations? > > And how much disk space do you have available on the slave? > > > > Venlig hilsen/Best regards > > > > *Jon Kjær Amundsen* > > Developer > > > > > > Phone: +45 7023 9080 > > E-mail: j...@udbudsvagten.dk > > Web: > > https://apc01.safelinks.protection.outlook.com/?url=www.udbudsvagten.d > > k&data=02%7C01%7CAkreetiA%40hcl.com%7Cf7230fabcabe4144303c08d73783 > > 6ad1%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C0%7C637038909894888022&a > > mp;sdata=jABLGHXUJv6DyJ6vqiHRHgr0PbiP8Si2gMDD5fMxDls%3D&reserved=0 > > Parken - Tårn D - 5. Sal > > Øster Allé 48 | DK - 2100 København > > > > < > > https://apc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdk.li > > nkedin.com%2Fin%2FJonKjaerAmundsen%2F&data=02%7C01%7CAkreetiA%40hc > > l.com%7Cf7230fabcabe4144303c08d737836ad1%7C189de737c93a4f5a8b686f4ca99 > > 41912%7C0%7C0%7C637038909894888022&sdata=UTMNsDYtN2OiLfkItVP6JwE3V > > WSPhhWHvCGBIZfLifU%3D&reserved=0 > > > > > > > Intelligent Offentlig Samhandel > > *Før, under og efter udbud* > > > > *Følg UdbudsVagten og markedet her Linkedin < > > https://apc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.l > > inkedin.com%2Fgroups%3FgroupDashboard%3D%26gid%3D1862353&data=02%7 > > C01%7CAkreetiA%40hcl.com%7Cf7230fabcabe4144303c08d737836ad1%7C189de737 > > c93a4f5a8b686f4ca9941912%7C0%7C0%7C637038909894888022&sdata=tI2RNk > > nFQjpFZZHaIM7gedcVdwEs6uJGgQH7FEHX5ag%3D&reserved=0> > > * > > > > > > Den ons. 11. sep. 2019 kl. 15.23 skrev Akreeti Agarwal <akree...@hcl.com > >: > > > > > My index size is 2.62 GB, and : > > > <str name="commitReserveDuration">00:00:10</str> > > > > > > Thanks & Regards, > > > Akreeti Agarwal > > > > > > > > > -----Original Message----- > > > From: Paras Lehana <paras.leh...@indiamart.com> > > > Sent: Wednesday, September 11, 2019 5:39 PM > > > To: solr-user@lucene.apache.org > > > Subject: Re: Replication Iteration > > > > > > What is the size of your index? Is it too big? How fast is your link > > > between master and slave? > > > > > > I'm asking these because, for larger indexes, you may want to raise > > > commitReserveDuration defined in ReplicationHandler in solrconfig.xml. > > > > > > <str name="commitReserveDuration">00:00:10</str> > > > > > > > > > From SolrReplication > > > < > > > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcw > > > ik > > > i.apache.org%2Fconfluence%2Fdisplay%2Fsolr%2FSolrReplication&dat > > > a= > > > 02%7C01%7CAkreetiA%40hcl.com%7Cd0ccab4b71554c325d0e08d736c019bb%7C18 > > > 9d > > > e737c93a4f5a8b686f4ca9941912%7C0%7C0%7C637038071020061996&sdata= > > > 4p > > > rY6X8%2FXVTbFj9OAlgQ1t6Vq7GFytRPHNzPsQkFktc%3D&reserved=0 > > > > > > > documentation for Master > > > < > > > https://apc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcw > > > ik > > > i.apache.org%2Fconfluence%2Fdisplay%2Fsolr%2FSolrReplication%23Maste > > > r& > > > amp;data=02%7C01%7CAkreetiA%40hcl.com%7Cd0ccab4b71554c325d0e08d736c0 > > > 19 > > > bb%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C0%7C637038071020061996&a > > > mp > > > ;sdata=vPlsIvqTrwzq0wSkBkMiJc3C7IOaXpQWdwG06xRlG9k%3D&reserved=0 > > > >: > > > > > > If your commits are very frequent and network is particularly slow, > > > you can > > > > tweak an extra attribute <str > > > name="commitReserveDuration">00:00:10</str>. > > > > This is roughly the time taken to download 5MB from master to slave. > > > > Default is 10 secs. > > > > > > > > > Do check the hyperlinks. > > > > > > On Wed, 11 Sep 2019 at 17:25, Akreeti Agarwal <akree...@hcl.com> > wrote: > > > > > > > I am seeing the logs on both UI and file, but I only see this error: > > > > > > > > ReplicationHandler > > > > Index fetch failed :org.apache.solr.common.SolrException: Unable > > > > to download segments_znow completely. Downloaded 0!=2217 > > > > > > > > Thanks & Regards, > > > > Akreeti Agarwal > > > > > > > > -----Original Message----- > > > > From: Paras Lehana <paras.leh...@indiamart.com> > > > > Sent: Wednesday, September 11, 2019 5:17 PM > > > > To: solr-user@lucene.apache.org > > > > Subject: Re: Replication Iteration > > > > > > > > Hi Akreeti, > > > > > > > > Have you tried using the old UI to see errors? I had always > > > > experienced not seeing status updates about replication in the > > > > newer UI. Check for the option on top right of Solr UI. > > > > > > > > And where are you seeing logs - on solr UI or from a file? > > > > > > > > On Wed, 11 Sep 2019 at 16:12, Akreeti Agarwal <akree...@hcl.com> > > wrote: > > > > > > > > > In the logs I don't see any errors, mostly after every 1-2 min > > > > > replication fails and I am not able to identify the root cause > > > > > for > > it. > > > > > > > > > > Thanks & Regards, > > > > > Akreeti Agarwal > > > > > > > > > > -----Original Message----- > > > > > From: Jon Kjær Amundsen <j...@udbudsvagten.dk> > > > > > Sent: Wednesday, September 11, 2019 12:15 PM > > > > > To: solr-user@lucene.apache.org > > > > > Subject: Re: Replication Iteration > > > > > > > > > > It depends on the timestamps. > > > > > The red iterations are failed replications and the green are > > > > > passed replications. > > > > > If the newest timestamp is green the latest replication went > > > > > well, if it is red, it failed. > > > > > > > > > > You should check the solr log on the slave if a recent > > > > > replication have failed to see the cause. > > > > > > > > > > Venlig hilsen/Best regards > > > > > > > > > > *Jon Kjær Amundsen* > > > > > Developer > > > > > > > > > > > > > > > Phone: +45 7023 9080 > > > > > E-mail: j...@udbudsvagten.dk > > > > > Web: > > > > > https://apc01.safelinks.protection.outlook.com/?url=www.udbudsva > > > > > gten&data=02%7C01%7CAkreetiA%40hcl.com%7Cf7230fabcabe4144303 > > > > > c08d737836ad1%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C0%7C63703 > > > > > 8909894888022&sdata=5ykEvhy1PO6N6hL%2Fior7eYMGOB3QcIu0ypIjPP > > > > > TME%2Bg%3D&reserved=0 > > > > > .d > > > > > k&data=02%7C01%7CAkreetiA%40hcl.com%7Cdac98a88d43446d88f8208 > > > > > d7 > > > > > 36 > > > > > ad > > > > > ebfa%7C189de737c93a4f5a8b686f4ca9941912%7C0%7C1%7C63703799293165 > > > > > 14 > > > > > 16 > > > > > &a > > > > > mp;sdata=HBrEXexrQZ2UrhmDwGaZfnvn4XjbawVGq8PnMDA5ocA%3D&rese > > > > > rv > > > > > ed > > > > > =0 > > > > > Parken - Tårn D - 5. Sal > > > > > Øster Allé 48 | DK - 2100 København > > > > > > > > > > < > > > > > http://dk. > > > > > li > > > > > nkedin.com%2Fin%2FJonKjaerAmundsen%2F&data=02%7C01%7CAkreeti > > > > > A% > > > > > 40 > > > > > hc > > > > > l.com%7Cdac98a88d43446d88f8208d736adebfa%7C189de737c93a4f5a8b686 > > > > > f4 > > > > > ca > > > > > 99 > > > > > 41912%7C0%7C1%7C637037992931651416&sdata=9sealYl8sRN7Et2Oc%2 > > > > > F8 > > > > > Nx > > > > > nx > > > > > ooisjC15hPV5y9NSCgKg%3D&reserved=0 > > > > > > > > > > > > > > > > Intelligent Offentlig Samhandel > > > > > *Før, under og efter udbud* > > > > > > > > > > *Følg UdbudsVagten og markedet her Linkedin < http://www .l > > > > > inkedin.com%2Fgroups%3FgroupDashboard%3D%26gid%3D1862353&dat > > > > > a= > > > > > 02 > > > > > %7 > > > > > C01%7CAkreetiA%40hcl.com%7Cdac98a88d43446d88f8208d736adebfa%7C18 > > > > > 9d > > > > > e7 > > > > > 37 > > > > > c93a4f5a8b686f4ca9941912%7C0%7C1%7C637037992931651416&sdata= > > > > > zQ > > > > > VT > > > > > %2 FJjMY6GlU4IVHZEMc6P4EWh9MrMcWEybBonKn7w%3D&reserved=0> > > > > > * > > > > > > > > > > > > > > > Den ons. 11. sep. 2019 kl. 06.35 skrev Akreeti Agarwal > > > > ><akree...@hcl.com > > > > >: > > > > > > > > > > > Hi All, > > > > > > > > > > > > I am using solr-5.5.5, in which I have one master and two slaves. > > > > > > I see some red and some green replication iteration on my > > > > > > slave > > side. > > > > > > What does these red and green iteration means? > > > > > > Will this cause problem? > > > > > > > > > > > > Thanks & Regards, > > > > > > Akreeti Agarwal > > > > > > > > > > > > ::DISCLAIMER:: > > > > > > ________________________________ The contents of this e-mail > > > > > > and any attachment(s) are confidential and intended for the > > > > > > named > > > > > > recipient(s) only. E-mail transmission is not guaranteed to be > > > > > > secure or error-free as information could be intercepted, > > > > > > corrupted, lost, destroyed, arrive late or incomplete, or may > > > > > > contain viruses in transmission. The e mail and its contents > > > > > > (with or without referred errors) shall therefore not attach > > > > > > any liability on the originator or HCL or its affiliates. > > > > > > Views or opinions, if any, presented in this email are solely > > > > > > those of the author and may not necessarily reflect the views > > > > > > or opinions of HCL or > > > > its affiliates. > > > > > > Any form of reproduction, dissemination, copying, disclosure, > > > > > > modification, distribution and / or publication of this > > > > > > message without the prior written consent of authorized > > > > > > representative of HCL is strictly prohibited. If you have > > > > > > received this email in error please delete it and notify the > sender immediately. > > > > > > Before opening any email and/or attachments, please check them > > > > > > for viruses and other > > > > > defects. > > > > > > ________________________________ > > > > > > > > > > > > > > > > > > > > > > > -- > > > > -- > > > > Regards, > > > > > > > > *Paras Lehana* [65871] > > > > Software Programmer, Auto-Suggest, IndiaMART Intermesh Ltd. > > > > > > > > 8th Floor, Tower A, Advant-Navis Business Park, Sector 142, Noida, > > > > UP, IN > > > > - 201303 > > > > > > > > Mob.: +91-9560911996 > > > > Work: 01203916600 | Extn: *8173* > > > > > > > > -- > > > > IMPORTANT: > > > > NEVER share your IndiaMART OTP/ Password with anyone. > > > > > > > > > > > > > -- > > > -- > > > Regards, > > > > > > *Paras Lehana* [65871] > > > Software Programmer, Auto-Suggest, > > > IndiaMART Intermesh Ltd. > > > > > > 8th Floor, Tower A, Advant-Navis Business Park, Sector 142, Noida, > > > UP, IN > > > - 201303 > > > > > > Mob.: +91-9560911996 > > > Work: 01203916600 | Extn: *8173* > > > > > > -- > > > IMPORTANT: > > > NEVER share your IndiaMART OTP/ Password with anyone. > > > > > > > > -- > -- > Regards, > > *Paras Lehana* [65871] > Software Programmer, Auto-Suggest, > IndiaMART Intermesh Ltd. > > 8th Floor, Tower A, Advant-Navis Business Park, Sector 142, Noida, UP, IN > - 201303 > > Mob.: +91-9560911996 > Work: 01203916600 | Extn: *8173* > > -- > IMPORTANT: > NEVER share your IndiaMART OTP/ Password with anyone. > -- -- Regards, *Paras Lehana* [65871] Software Programmer, Auto-Suggest, IndiaMART Intermesh Ltd. 8th Floor, Tower A, Advant-Navis Business Park, Sector 142, Noida, UP, IN - 201303 Mob.: +91-9560911996 Work: 01203916600 | Extn: *8173* -- IMPORTANT: NEVER share your IndiaMART OTP/ Password with anyone.
