Package: obnam Version: 1.1-1 I've been trying to do an initial full backup of my server using obnam, but it reliably fails with the error message ERROR: Node 1598 cannot be found in the node store 1566508680438567912 (the numbers change between attempts) about 12 hours into the backup run. I unfortunately did not have logging enabled in any of these attempts.
After the last full backup attempt I've tried restarting the backup; it failed eventually with the following (trimmed) log: 2012-07-25 13:05:15 DEBUG Current configuration: [config] output = log = /var/tmp/backup-local/obnam-log log-level = debug log-max = 0 log-keep = 10 log-mode = 0600 dump-memory-profile = simple repository = /mnt/backup client-name = flowerpot.kaijanaho.info node-size = 262144 chunk-size = 1048576 upload-queue-size = 1024 lru-size = 500 trace = idpath-depth = 3 idpath-bits = 12 idpath-skip = 13 quiet = False pretend = False pretend-time = lock-timeout = 60 crash-limit = 0 compress-with = deflate root = exclude = exclude-caches = False one-file-system = False checkpoint = 1073741824 chunkids-per-group = 1024 deduplicate = fatalist leave-checkpoints = False small-files-in-btree = False warn-age = 27h critical-age = 27h sftp-delay = 0 ssh-key = strict-ssh-host-keys = False ssh-known-hosts = /root/.ssh/known_hosts pure-paramiko = False to = generation = latest keep = fsck-fix = False 2012-07-25 13:05:15 INFO Backup starts [ ... ] 2012-07-25 18:22:49 DEBUG Backing up /home/ajk/wp-2.0.6/wp-admin/import/livejournal.php 2012-07-25 18:22:50 ERROR Error reading node: 24: Too many open files: 1566508680438567912/nodes/0/0/0/314 2012-07-25 18:22:50 DEBUG Handling exception Node 788 cannot be found in the node store 1566508680438567912 2012-07-25 18:22:51 DEBUG Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/obnamlib/plugins/backup_plugin.py", line 258, in backup self.backup_roots(roots) File "/usr/lib/python2.7/dist-packages/obnamlib/plugins/backup_plugin.py", line 357, in backup_roots metadata) File "/usr/lib/python2.7/dist-packages/obnamlib/plugins/backup_plugin.py", line 564, in backup_file_contents self.repo.append_file_chunks(filename, chunkids) File "/usr/lib/python2.7/dist-packages/obnamlib/repo.py", line 750, in append_file_chunks self.client.append_file_chunks(filename, chunkids) File "/usr/lib/python2.7/dist-packages/obnamlib/clientmetadatatree.py", line 507, in append_file_chunks self.tree.insert(self.chunk_key(chunkid, file_id), '') File "/usr/lib/python2.7/dist-packages/larch/tree.py", line 281, in insert kids = self._insert_into_index(self.root, key, value) File "/usr/lib/python2.7/dist-packages/larch/tree.py", line 317, in _insert_into_index child = self._get_node(new_index[child_key]) File "/usr/lib/python2.7/dist-packages/larch/tree.py", line 111, in _get_node return self.node_store.get_node(node_id) File "/usr/lib/python2.7/dist-packages/larch/nodestore_disk.py", line 237, in get_node raise larch.NodeMissing(self.dirname, node_id) NodeMissing: Node 788 cannot be found in the node store 1566508680438567912 2012-07-25 18:22:51 INFO Unlocking client because of error 2012-07-25 18:22:51 DEBUG Got second exception while unlocking: have not got lock on shared B-trees 2012-07-25 18:22:51 DEBUG Traceback (most recent call last): File "/usr/lib/python2.7/dist-packages/obnamlib/plugins/backup_plugin.py", line 285, in unlock_when_error self.repo.unlock_client() File "/usr/lib/python2.7/dist-packages/obnamlib/repo.py", line 455, in unlock_client self._really_remove_generations(self.added_generations) File "/usr/lib/python2.7/dist-packages/obnamlib/repo.py", line 566, in _really_remove_generations self.require_shared_lock() File "/usr/lib/python2.7/dist-packages/obnamlib/repo.py", line 221, in require_shared_lock raise LockFail('have not got lock on shared B-trees') LockFail: have not got lock on shared B-trees 2012-07-25 18:22:51 CRITICAL Node 788 cannot be found in the node store 1566508680438567912 I'm now running another attempt to continue the backup. (Maybe I should try raise the limits, but whyever for does obnam need a lot of open files? Even if it does, that error message should be given in stderr, not buried in the logs.) -- System Information: Debian Release: wheezy/sid APT prefers testing APT policy: (990, 'testing') Architecture: i386 (i686) Kernel: Linux 2.6.32.33-kvm-i386-20111128-dirty (SMP w/1 CPU core) Locale: LANG=fi_FI.UTF-8, LC_CTYPE=fi_FI.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/bash Versions of packages obnam depends on: ii libc6 2.13-33 ii python 2.7.3~rc2-1 ii python-cliapp 1.20120630-1 ii python-larch 1.20120527-1 ii python-paramiko 1.7.7.1-3 ii python-tracing 0.6-2 ii python-ttystatus 0.19-1 obnam recommends no packages. obnam suggests no packages. -- no debconf information -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of "unsubscribe". Trouble? Contact listmas...@lists.debian.org