People on both FMS and Freetalk seem to be reaching the conclusion that Freenet has substantially improved data persistence but also slower download speeds - apparently including for recently inserted files which should be the same.
Anyone confirm this? Thoughts??? Re: Soylent Green is Freenet!!!! on 2011-06-27 18:27:30 >test finished as I don't think there is any point to continue to >download the CHK key to test the speed of downloads while I am not also >downloading the SSK key. I will leave it to finish so I can confirm it >does finish and not get stuck and fail. > >CHK key was at 75% >SSK key finished and was decoded after 42h33m Okay. >During that time I downloaded a couple small files. Less then 5 files >and less then 5mb combined. Nothing else was downloaded during the test. >Node was set to 100Kib 35 peers during the whole test. > >Node updated to build 1379 during the test and at that time Freetalk >started to work again. I also restarted the node once during the test. > >I also started inserting some files during the test but I don't think >that should matter. > >No other files were downloaded other then those 5 small files that only >took a few minutes at most. Both the CHK and SSK versions were >downloaded using medium priority. > >-I would be interested in how old both the CHK and SSK keys were. I think the CHK key was oldish. Lets see... CHK: StartupTime=1302956322469 CompletionTime=1303201413824 April the 19th. I'm not sure how widely it was fetched. I did eventually put it on my flog's resources page but it's not noticeable from the front page or even the top of the resources page. I did mention it on IRC twice once on April 22nd and once on May 5th. SSK: StartupTime=1308435557360 CompletionTime=1308756000955 June 22nd, i.e. very recent. I think I kept this one private? >-Had either of the keys ever been downloaded in the past or did you >simply hold onto them to run this test? > >On Freetalk I posted a junk file in the thread about healing files and >it failed to start. That file was inserted at the end of march and was >never downloaded ever. I added the key to fuqid and dam the thing >started after about 12 hours. The key is almost three months old!!! I don't understand - "it failed to start" ??? >I downloaded 88% of the file but aborted the download to run your test >but will start over again with it and confirm it will finish. > >The download speed of freenet is much slower then in the past but it >seems keys last much longer then they did in the past!! You have to compare keys of similar age. If we have a wider range of retrievable keys, but older keys take a relatively long time to fetch, that's a clear improvement. However if new keys are taking longer, while old keys are more retrievable, that's not so clear cut a gain. On the other hand, IMHO data persistence has been one of the big weaknesses of Freenet - fundamentally if data persistence is poor freenet is much less useful, especially as reinserts are dangerous, but also because it makes e.g. freesites, indexes etc much less useful. So since a year or so ago one major goal has been to improve data persistence, and I expect further gains from new load management, should it eventually happen. ==== Freetalk: Re: How to reinsert and heal files ... That depends on what you are Reuploading. Are you uploading just the metadata or the whole insert. If the whole insert then yes it is very dangerous. I am unsure how unsafe it is to upload only the metadata as it is such a small amount it only takes a couple minutes at most. It is about 736 bytes for the file below. There are two issues with files that fail to download: 1)Files that fail to start because they can't download the meta data 2)Files that fail to finish but do start. Try to download this junk 80mb file inserted at the end of march CHK at .../test0093323264.bin It should fail with a Data not found error or it might work. It failed for me. Report back and if the file has failed I will heal it by inserting only the metadata For option 1 all that is needed is an option to only insert the metadata to fix the file ... Forget that idea the key started :( Guess I will have to wait longer then three months till my test files will fail to start. ... Thanks for the math behind the size of the metadata. My point was it is possible to only re-insert just the metadata if a file fails to start. Unfortunately my test file still worked even after being inserted three months ago but never downloaded. [ I am asking him whether he is sure that he posted it ] -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: This is a digitally signed message part. URL: <https://emu.freenetproject.org/pipermail/devl/attachments/20110627/626479dd/attachment.pgp>
