Hi John, On Mon, 2006-06-12 at 15:50 -0700, John Nelson wrote: > Hi Andree, > > Thanks very much for getting back to me on this.
Likewise. ;-)
> 64k sounds like a reasonable number, with caveats, of course. 4096 was
> sufficient while using a
> DDS-2 tape drive but not once I upgraded to a DDS-3 drive. What would happen
> with a high-capacity
> drive, such as a DLT-S4?
I suppose we'd have to increase the constant again. Not very elegant, I
know.
> If I could expand a little on the observed behavior, you might find the
> additional info useful. I
> also have some questions, as I'm not a programmer/developer of any sort, and
> I'm still quite a
> newbie WRT Linux.
>
> When Mondo fails on me, I believe it's backing up my MP3 collection, as the
> file sizes are about
> what would be expected for those files. It appears to be putting, 1 or
> perhaps 2 MP3 files per
> afio archive, and since my collection is in excess of 5900, it runs out of
> catalog entries. Also,
> this was my first attempt at a multi-tape backup after upgrading to a DDS-3
> tape drive. I never
> had trouble while using a DDS-2 drive, but I was not trying to backup as much
> data either.
Int
> Is there a limitation on the size of the afio archives? I've noticed that the
> afio archives are
> staged in /tmp/shm before being written to the backup media, so perhaps
> there's a limitation to
> accommodate systems that don't have much resources?
I think the following is defining the maximum filesize (from
libmondo-tools.c):
bkpinfo->optimal_set_size =
(IS_THIS_A_STREAMING_BACKUP(bkpinfo->backup_media_type) ? 4 : 8) *
1024;
That would be 4MB for streaming backups and 8MB for others.
From looking at chop_filelist() in libmondo-filelist.c I think it keeps
adding files until the above value is exceeded and then it stops. So you
could have 500 files adding up to just under 8MB and the next file is
16MB which would be accepted as the last file making to resulting afio
almost 24MB in size. Then again you have 500 files just under 8MB in
total and the next one quite small and you end up with an afio file of
about 8MB. There is also a maximum size for files to qualify as
biggiefiles which will not even be considered in chop_filelist().
Amazing, isn't it? :-/ The upshot is that we may be able to just
increase the values 4 and 8 in the above formula and we get bigger
files. Maybe doubling or tripling would work better?
> Does Mondo use a single pool of catalog entries, or is it 'per media'? I've
> never had to restore
> from a multi-tape backup set with Mondo, so I don't know how it behaves under
> that circumstance.
No idea. [Bruno: Any suggestions from your end?]
> I would also have to ask where Mondo allocates space to store the catalog
> while it's running? I
> would surmise that increasing the size of the catalog may significantly
> change the resource
> requirements of the package.
I would assume that's either in the scratch or the tmp directory.
> If I may be of any further assistance, please don't hesitate to contact me.
Absolutely, thanks for the offer! I would indeed be interested to see
what happens if you change the above formula to say:
(IS_THIS_A_STREAMING_BACKUP(bkpinfo->backup_media_type) ? 16 : 32) *
1024;
This would change your tape backup afio filesize from (4MB + one more
file) to (16MB + one more file) which might be better suited for your
mp3's. You could obviously try a compromise like 8 : 16 as well...
> Thanks,
>
> John Nelson
Best regards,
Andree
> --- Andree Leidenfrost <[EMAIL PROTECTED]> wrote:
>
> > [Bruno: Would be great if you could comment on this one. Looks to me
> > like we may only have to bump up a number, but maybe there are
> > implications that I'm not aware off...]
> >
> > Hi John,
> >
> > Thanks a lot for your bug report and your analysis of the problem. I
> > don;t have any experience with tapes and Mondo Rescue, but I can confirm
> > that the following is still even in the latest SVN in
> > mondo/common/my-stuff.h:
> >
> > #define MAX_TAPECATALOG_ENTRIES 4096 ///< The maximum number of
> > entries
> > in the tape catalog.
> >
> > So, the question would be what a reasonable value for this couldlook
> > like. Would 65536 be ok?
> >
> > Cheers,
> > Andree
> >
> >
> > On Sun, 2006-05-28 at 20:26 -0700, John Nelson wrote:
> > > Package: mondo
> > > Version: 2.04-4
> > > Severity: important
> > >
> > >
> > > Mondo fails due to a 4096 entry limitation in the tape catalog. This
> > > causes
> > > /dev/shm to fill up and the task hangs when afio reports "Ready for
> > > volume 2".
> > >
> > > -- Package-specific info:
> > > /var/log/mindi.log and /var/log/mondo-archive.log provided in attachment.
> > >
> > >
> > > =========================================================
> > > Fileystem information:
> > > Filesystem 1K-blocks Used Available Use% Mounted on
> > > /dev/hda3 36869072 2663656 32332552 8% /
> > > tmpfs 518260 0 518260 0% /dev/shm
> > > /dev/hda1 50233 6715 40924 15% /boot
> > > /dev/hdb1 118729904 33986324 78712380 31% /home
> > > tmpfs 10240 804 9436 8% /dev
> > > /dev/shm 256000 256000 0 100%
> > /tmp/tmp.mondo.29578/tmp.mondo.29937/tmpfs
> > >
> > > -- System Information:
> > > Debian Release: 3.1
> > > Architecture: i386 (i686)
> > > Kernel: Linux 2.6.8-3-k7
> > > Locale: LANG=en_US, LC_CTYPE=en_US (charmap=ISO-8859-1)
> > >
> > > Versions of packages mondo depends on:
> > > ii afio 2.5-3 archive file manipulation
> > > program
> > > ii binutils 2.15-6 The GNU assembler, linker
> > > and bina
> > > ii buffer 1.19-7 Buffering/reblocking program
> > > for t
> > > ii cdrecord 4:2.01+01a01-2 command line CD writing tool
> > > ii dosfstools 2.11-2 Utilities to create and
> > > check MS-D
> > > ii gawk 1:3.1.4-2 GNU awk, a pattern scanning
> > > and pr
> > > ii libc6 2.3.2.ds1-22 GNU C Library: Shared
> > > libraries an
> > > ii libnewt0.51 0.51.6-20 Not Erik's Windowing Toolkit
> > > - tex
> > > ii lzop 1.01-3 fast compression program
> > > ii mindi 1.04-4 creates boot/root disks
> > > based on y
> > >
> > > Versions of packages mindi depends on:
> > > ii bzip2 1.0.2-7 high-quality block-sorting
> > > file co
> > > ii file 4.12-1 Determines file type using
> > > "magic"
> > > ii gawk 1:3.1.4-2 GNU awk, a pattern scanning
> > > and pr
> > > ii mindi-busybox 1.00-4 Collection of shell
> > > utilities in a
> > > ii mindi-kernel 2.4.27-2sarge1 failsafe Linux kernel for
> > > Mindi/Mo
> > > ii mindi-partimagehack 0.6.2-4 disk partition imaging
> > > utility for
> > > ii mkisofs 4:2.01+01a01-2 Creates ISO-9660 CD-ROM
> > > filesystem
> > > ii ms-sys 1.1.3-1 Write a Microsoft compatible
> > > boot
> > > ii nano 1.2.4-5 free Pico clone with some
> > > new feat
> > > ii parted 1.6.21-1 The GNU Parted disk
> > > partition resi
> > > ii syslinux 2.11-0.1 Bootloader for Linux/i386
> > > using MS
> > >
> > > -- no debconf information
> > --
> > Andree Leidenfrost
> > Sydney - Australia
> >
> >
>
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam? Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com
--
Andree Leidenfrost
Sydney - Australia
signature.asc
Description: This is a digitally signed message part
