Sorry but which one shoud I take?? where exactly ?
Noble Paul നോബിള് नोब्ळ् wrote: > > this fix is there in the trunk , > you may not need to apply the patch > > On Fri, Mar 27, 2009 at 6:02 AM, sunnyfr <johanna...@gmail.com> wrote: >> >> Hi, >> >> It doesn't seem to work for me, I changed as well this part below is it >> ok?? >>> - List<String> copiedfiles = new ArrayList<String>(); >>> + Set<String> filesToCopy = new HashSet<String>(); >> >> http://www.nabble.com/file/p22734005/ReplicationHandler.java >> ReplicationHandler.java >> >> Thanks a lot, >> >> >> >> >> >> Noble Paul നോബിള് नोब्ळ् wrote: >>> >>> James thanks . >>> >>> If this is true the place to fix this is in >>> ReplicationHandler#getFileList(). patch is attached. >>> >>> >>> On Wed, Dec 24, 2008 at 4:04 PM, James Grant <james.gr...@semantico.com> >>> wrote: >>>> I had the same problem. It turned out that the list of files from the >>>> master >>>> included duplicates. When the slave completes the download and tries to >>>> move >>>> the files into the index it comes across a file that does not exist >>>> because >>>> it has already been moved so it backs out the whole operation. >>>> >>>> My solution for now was to patch the copyindexFiles method of >>>> org.apache.solr.handler.SnapPuller so that it normalises the list >>>> before >>>> moving the files. This isn't the best solution since it will still >>>> download >>>> the file twice but it was the easiest and smallest change to make. The >>>> patch >>>> is below >>>> >>>> Regards >>>> >>>> James >>>> >>>> --- src/java/org/apache/solr/handler/SnapPuller.java (revision >>>> 727347) >>>> +++ src/java/org/apache/solr/handler/SnapPuller.java (working copy) >>>> @@ -470,7 +470,7 @@ >>>> */ >>>> private boolean copyIndexFiles(File snapDir, File indexDir) { >>>> String segmentsFile = null; >>>> - List<String> copiedfiles = new ArrayList<String>(); >>>> + Set<String> filesToCopy = new HashSet<String>(); >>>> for (Map<String, Object> f : filesDownloaded) { >>>> String fname = (String) f.get(NAME); >>>> // the segments file must be copied last >>>> @@ -482,6 +482,10 @@ >>>> segmentsFile = fname; >>>> continue; >>>> } >>>> + filesToCopy.add(fname); >>>> + } >>>> + List<String> copiedfiles = new ArrayList<String>(); >>>> + for (String fname: filesToCopy) { >>>> if (!copyAFile(snapDir, indexDir, fname, copiedfiles)) return >>>> false; >>>> copiedfiles.add(fname); >>>> } >>>> >>>> >>>> Jaco wrote: >>>>> >>>>> Hello, >>>>> >>>>> While testing out the new replication features, I'm running into some >>>>> strange problem. On the slave, I keep getting an error like this after >>>>> all >>>>> files have been copied from the master to the temporary >>>>> index.xxxxxxxxx >>>>> directory: >>>>> >>>>> SEVERE: Unable to move index file from: >>>>> D:\Data\solr\Slave\data\index.20081224110855\_21e.tvx to: >>>>> D:\Data\Solr\Slave\data\index\_21e.tvx >>>>> >>>>> The replication then stops, index remains in original state, so the >>>>> updates >>>>> are not available at the slave. >>>>> >>>>> This is my replication config at the master: >>>>> >>>>> <requestHandler name="/replication" class="solr.ReplicationHandler" >>>>> > >>>>> <lst name="master"> >>>>> <!--Replicate on 'optimize' it can also be 'commit' --> >>>>> <str name="replicateAfter">commit</str> >>>>> <str name="confFiles">schema.xml</str> >>>>> </lst> >>>>> </requestHandler> >>>>> >>>>> This is the replication config at the slave: >>>>> >>>>> <requestHandler name="/replication" class="solr.ReplicationHandler" >>>>> > >>>>> <lst name="slave"> >>>>> <str name="masterUrl"> >>>>> http://hostnamemaster:8080/solr/Master/replication</str> >>>>> <str name="pollInterval">00:10:00</str> >>>>> <str name="zip">true</str> >>>>> </lst> >>>>> </requestHandler> >>>>> >>>>> I'm running a Solr nightly build of 21.12.2008 in Tomcat 6 on Windows >>>>> 2003. >>>>> Initially I thought there was some problem with disk space, but this >>>>> is >>>>> not >>>>> the case. Replication did run fine for intial version of index, but >>>>> after >>>>> that at some point it didn't work anymore. Any ideas what could be >>>>> wrong >>>>> here? >>>>> >>>>> Thanks very much in advance, bye, >>>>> >>>>> Jaco. >>>>> >>>>> >>>> >>>> >>> >>> >>> >>> -- >>> --Noble Paul >>> >>> Index: src/java/org/apache/solr/handler/ReplicationHandler.java >>> =================================================================== >>> --- src/java/org/apache/solr/handler/ReplicationHandler.java (revision >>> 729282) >>> +++ src/java/org/apache/solr/handler/ReplicationHandler.java (working >>> copy) >>> @@ -268,7 +268,7 @@ >>> List<Map<String, Object>> result = new ArrayList<Map<String, >>> Object>>(); >>> try { >>> //get all the files in the commit >>> - Collection<String> files = commit.getFileNames(); >>> + Collection<String> files = new >>> HashSet<String>(commit.getFileNames()); >>> for (String fileName : files) { >>> File file = new File(core.getIndexDir(), fileName); >>> Map<String, Object> fileMeta = getFileInfo(file); >>> >>> >> >> -- >> View this message in context: >> http://www.nabble.com/%22Unable-to-move-index-file%22-error-during-replication-tp21157722p22734005.html >> Sent from the Solr - User mailing list archive at Nabble.com. >> >> > > > > -- > --Noble Paul > > -- View this message in context: http://www.nabble.com/%22Unable-to-move-index-file%22-error-during-replication-tp21157722p22737672.html Sent from the Solr - User mailing list archive at Nabble.com.
