Package: wget Version: 1.11.4-1 Severity: normal
I downloaded all the aircraft for flightgear from their ftp mirrors. To spread the load over several mirrors I did: wget -nc ftp://ftp.kingmont.com/flightsims/flightgear/Aircraft/* wget -nc ftp://ftp.de.flightgear.org/pub/fgfs/Aircraft/* wget -nc ftp://some.third.mirror/pub/fgfs/Aircraft/* It worked basically as files started by one wget were not downloaded by other wgets. However, after one wget decided to download a locally non existant file it appearently created it only when the data started coming. In this interval - from decision to file creation - other wgets sometimes would also decide to download the same file and so two (or possibly three) wgets would download and write the same file and waste time and bandwidth. Maybe the destination file should be created right after wget decides to download it. Maybe these operations can be combined atomically to avoid the race completely. If it later turns out that the file cannot be downloaded, it can be deleted. That might be a new race as other wegts won't try to download a file which one wget fails to download. Bernhard -- System Information: Debian Release: lenny/sid APT prefers testing APT policy: (990, 'testing'), (500, 'unstable') Architecture: i386 (i686) Kernel: Linux 2.6.26 Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/bash Versions of packages wget depends on: ii libc6 2.7-13 GNU C Library: Shared libraries ii libssl0.9.8 0.9.8g-13 SSL shared libraries wget recommends no packages. wget suggests no packages. -- no debconf information -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
