Are the user/group/permissions on the snapshot files the same for both cases
(manual vs postCommit/postOptimize events)?
Bill
On Tue, May 5, 2009 at 12:54 PM, tushar kapoor <
tushar_kapoor...@rediffmail.com> wrote:
>
> Hi,
>
> I am facing an issue while performing snapshot pulling thru Snappuller
> script from slave server :
> We have the setup of multicores on Master Solr and Slave Solr servers.
> Scenario , 2 cores are set :
> i) CORE_WWW.ABCD.COM
> ii) CORE_WWW.XYZ.COM
>
> rsync-enable and rsync-start script run from CORE_WWW.ABCD.COM on master
> server. Thus rsyncd.commf file got generated on CORE_WWW.ABCD.COM only ,
> but not on CORE_WWW.XYZ.COM.
> Rsyncd.conf of CORE_WWW.ABCD.COM :
> #### rsyncd.conf file ####
> uid = webuser
> gid = webuser
> use chroot = no
> list = no
> pid file =
> /opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
> CORE_WWW.ABCD.COM/logs/rsyncd.pid
> log file =
> /opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
> CORE_WWW.ABCD.COM/logs/rsyncd.log
> [solr]
> path =
> /opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
> CORE_WWW.ABCD.COM/data
> comment = Solr
>
> rsync error used to get generated while doing the pulling of master server
> snapshot of a particular core "CORE_WWW.XYZ.COM" from slave end, for core
> "CORE_WWW.ABCD.COM" snappuller occured without any error.
>
> Also, this issue is coming only when snapshot are generated at master end
> thru the way given below:
> A) Snapshot are generated automatically by
> editing “${SOLR_HOME}/solr/conf/solrconfig.xml” to let either commit index
> or optimize index trigger the snapshooter (search “postCommit” and
> “postOptimize” to find the configuration section).
>
> Sample of solrconfig.xml entry on Master server End:
> I)
> <listener event="postCommit" class="solr.RunExecutableListener">
> <str
>
> name="exe">/opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
> CORE_WWW.ABCD.COM/bin/snapshooter</str>
> <str
>
> name="dir">/opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
> CORE_WWW.ABCD.COM/bin</str>
> <bool name="wait">true</bool>
> <arr name="args"> <str>arg1</str> <str>arg2</str> </arr>
> <arr name="env"> <str>MYVAR=val1</str> </arr>
> </listener>
>
> same way done for core "CORE_WWW.XYZ.COM" solrConfig.xml.
> II) The <dataDir> tag remains commented on both the cores .XML on master
> server.
>
> Log sample for more clearity :
> rsyncd.log of the core "CORE_WWW.XYZ.COM":
> 2009/05/01 15:48:40 command: ./rsyncd-start
> 2009/05/01 15:48:40 [15064] rsyncd version 2.6.3 starting, listening on
> port
> 18983
> 2009/05/01 15:48:40 rsyncd started with
>
> data_dir=/opt/apache-tomcat-6.0.18/apache-solr-1.3.0/example/solr/multicore/
> CORE_WWW.XYZ.COm/data
> and accepting requests
> 2009/05/01 15:50:36 [15195] rsync on solr/snapshot.20090501153311/ from
> deltrialmac.mac1.com (10.210.7.191)
> 2009/05/01 15:50:36 [15195] rsync: link_stat "snapshot.20090501153311/."
> (in
> solr) failed: No such file or directory (2)
> 2009/05/01 15:50:36 [15195] rsync error: some files could not be
> transferred
> (code 23) at main.c(442)
> 2009/05/01 15:52:23 [15301] rsync on solr/snapshot.20090501155030/ from
> delpearsondm.sapient.com (10.210.7.191)
> 2009/05/01 15:52:23 [15301] wrote 3438 bytes read 290 bytes total size
> 2779
> 2009/05/01 16:03:31 [15553] rsync on solr/snapshot.20090501160112/ from
> deltrialmac.mac1.com (10.210.7.191)
> 2009/05/01 16:03:31 [15553] rsync: link_stat "snapshot.20090501160112/."
> (in
> solr) failed: No such file or directory (2)
> 2009/05/01 16:03:31 [15553] rsync error: some files could not be
> transferred
> (code 23) at main.c(442)
> 2009/05/01 16:04:27 [15674] rsync on solr/snapshot.20090501160054/ from
> deltrialmac.mac1.com (10.210.7.191)
> 2009/05/01 16:04:27 [15674] wrote 4173214 bytes read 290 bytes total size
> 4174633
>
> I m unable to figure out that from where "/." gets appeneded at the end
> "snapshot.20090501153311/."
> "Snappuller.log"
> 2009/05/04 16:55:43 started by solrUser
> 2009/05/04 16:55:43 command:
> /opt/apache-solr-1.3.0/example/solr/multicore/
> CORE_WWW.PUFFINBOOKS.CA/bin/snappuller
> -u <http://CORE_WWW.PUFFINBOOKS.CA/bin/snappuller%0A-u> webuser
> 2009/05/04 16:55:52 pulling snapshot snapshot.20090504164935
> 2009/05/04 16:56:09 rsync failed
> 2009/05/04 16:56:24 failed (elapsed time: 41 sec)
>
> Error shown on console :
> rsync: link_stat "snapshot.20090504164935/." (in solr) failed: No such file
> or directory (2)
> client: nothing to do: perhaps you need to specify some filenames or the
> --recursive option?
> rsync error: some files could not be transferred (code 23) at main.c(723)
>
> B) The same issue is not coming while manually running the Snapshot script
> after reguler interval of time at Master server and then running Snappuller
> script at slave end for multiple cores. The postCommit/postOptimize part of
> solrConfig.xml has been commented.
> Here also rsync script run thru the core "CORE_WWW.ABCD.COM". Snappuller
> and
> snapinstaller occurred successfully.
>
> Thanks in advance.
>
> --
> View this message in context:
> http://www.nabble.com/Master-Slave-data-distribution-%7C-rsync-fail-issue-tp23391580p23391580.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
