On Wed, 3 Dec 2014, Nikolaus Rath wrote:
Hi,
Is it possible that your DNS server behaves as described in
https://bitbucket.org/nikratio/python-dugong/issue/16/?
If so, could you test if upgrading to python3-dugong 3.4 from
experimental fixes the problem?
I installed python-dugong from experimental and proceeded to transfer a
lot of data to my S3 file system. Stopped it a couple of times, unmounted
once (successfully), remounted and continued transferring data. After
around 13-15 GB total had been uploaded, the file system crashed again (no
hang):
rsync: writefd_unbuffered failed to write 4 bytes to socket [sender]:
Broken pipe (32)
rsync: write failed on <file name>
Transport endpoint is not connected (107)
rsync error: error in file IO (code 11) at receiver.c(322)
[receiver=3.0.9]
rsync: connection unexpectedly closed (51874 bytes received so far)
[sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(605)
[sender=3.0.9]
See attached mount log file for more details.
Shannon C. Dealy | DeaTech Research Inc.
de...@deatech.com | - Custom Software Development -
USA Phone: +1 800-467-5820 | - Natural Building Instruction -
numbers : +1 541-929-4089 | www.deatech.com
2014-12-04 22:21:27.735 31437:MainThread (name)s.determine_threads: Using 8
upload threads.
2014-12-04 22:21:27.738 31437:MainThread (name)s.main: Autodetected 4040 file
descriptors available for cache entries
2014-12-04 22:21:36.322 31437:MainThread (name)s.get_metadata: Using cached
metadata.
2014-12-04 22:21:36.325 31437:MainThread (name)s.main: Mounting filesystem...
2014-12-04 22:21:36.375 31445:MainThread (name)s.detach_process_context:
Daemonizing, new PID is 31446
2014-12-05 00:18:35.346 31446:Thread-3 (name)s.wrapped: Encountered
DNSUnavailable exception (Unable to resolve
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com, DNS server
unavailable.), retrying call to ObjectW.close for the 3-th time...
2014-12-05 00:18:53.835 31446:Thread-10 (name)s.wrapped: Encountered
DNSUnavailable exception (Unable to resolve
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com, DNS server
unavailable.), retrying call to ObjectW.close for the 3-th time...
2014-12-05 00:18:58.710 31446:Thread-9 (name)s.wrapped: Encountered
DNSUnavailable exception (Unable to resolve
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com, DNS server
unavailable.), retrying call to ObjectW.close for the 3-th time...
2014-12-05 00:19:05.143 31446:Thread-4 (name)s.wrapped: Encountered
DNSUnavailable exception (Unable to resolve
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com, DNS server
unavailable.), retrying call to ObjectW.close for the 3-th time...
2014-12-05 00:19:13.463 31446:Thread-6 (name)s.wrapped: Encountered
DNSUnavailable exception (Unable to resolve
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com, DNS server
unavailable.), retrying call to ObjectW.close for the 3-th time...
2014-12-05 00:28:34.696 31446:Thread-10 (name)s.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1445, in
create_socket
return socket.create_connection(address)
File "/usr/lib/python3.4/socket.py", line 491, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "/usr/lib/python3.4/socket.py", line 530, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/mount.py", line 66, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 404, in _upload_loop
self._do_upload(*tmp)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 431, in _do_upload
% obj_id).get_obj_size()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 258, in perform_write
return fn(fh)
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 477, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 471, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 636, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 845, in close
headers=self.headers, body=self.fh)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 409, in _do_request
query_string=query_string, body=body)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 642, in _send_request
headers=headers, body=BodyFollowing(body_len))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 508, in
send_request
self.timeout)
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1396, in
eval_coroutine
if not next(crt).poll(timeout=timeout):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 535, in
co_send_request
self.connect()
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 439, in connect
self._sock = create_socket((self.hostname, self.port))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1449, in
create_socket
raise HostnameNotResolvable(address[0])
dugong.HostnameNotResolvable: Host
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com does not have any
ip addresses
2014-12-05 00:28:48.279 31446:Thread-4 (name)s.exchook: Unhandled top-level
exception during shutdown (will not be re-raised)
2014-12-05 00:28:48.279 31446:Thread-4 (name)s.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1445, in
create_socket
return socket.create_connection(address)
File "/usr/lib/python3.4/socket.py", line 491, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "/usr/lib/python3.4/socket.py", line 530, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/mount.py", line 66, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 404, in _upload_loop
self._do_upload(*tmp)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 431, in _do_upload
% obj_id).get_obj_size()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 258, in perform_write
return fn(fh)
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 477, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 471, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 636, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 845, in close
headers=self.headers, body=self.fh)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 409, in _do_request
query_string=query_string, body=body)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 642, in _send_request
headers=headers, body=BodyFollowing(body_len))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 508, in
send_request
self.timeout)
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1396, in
eval_coroutine
if not next(crt).poll(timeout=timeout):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 535, in
co_send_request
self.connect()
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 439, in connect
self._sock = create_socket((self.hostname, self.port))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1449, in
create_socket
raise HostnameNotResolvable(address[0])
dugong.HostnameNotResolvable: Host
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com does not have any
ip addresses
2014-12-05 00:28:48.476 31446:Thread-9 (name)s.exchook: Unhandled top-level
exception during shutdown (will not be re-raised)
2014-12-05 00:28:48.477 31446:Thread-9 (name)s.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1445, in
create_socket
return socket.create_connection(address)
File "/usr/lib/python3.4/socket.py", line 491, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "/usr/lib/python3.4/socket.py", line 530, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/mount.py", line 66, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 404, in _upload_loop
self._do_upload(*tmp)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 431, in _do_upload
% obj_id).get_obj_size()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 258, in perform_write
return fn(fh)
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 477, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 471, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 636, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 845, in close
headers=self.headers, body=self.fh)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 409, in _do_request
query_string=query_string, body=body)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 642, in _send_request
headers=headers, body=BodyFollowing(body_len))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 508, in
send_request
self.timeout)
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1396, in
eval_coroutine
if not next(crt).poll(timeout=timeout):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 535, in
co_send_request
self.connect()
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 439, in connect
self._sock = create_socket((self.hostname, self.port))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1449, in
create_socket
raise HostnameNotResolvable(address[0])
dugong.HostnameNotResolvable: Host
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com does not have any
ip addresses
2014-12-05 00:28:52.382 31446:Thread-3 (name)s.exchook: Unhandled top-level
exception during shutdown (will not be re-raised)
2014-12-05 00:28:52.383 31446:Thread-3 (name)s.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1445, in
create_socket
return socket.create_connection(address)
File "/usr/lib/python3.4/socket.py", line 491, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "/usr/lib/python3.4/socket.py", line 530, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/mount.py", line 66, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 404, in _upload_loop
self._do_upload(*tmp)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 431, in _do_upload
% obj_id).get_obj_size()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 258, in perform_write
return fn(fh)
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 477, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 471, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 636, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 845, in close
headers=self.headers, body=self.fh)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 409, in _do_request
query_string=query_string, body=body)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 642, in _send_request
headers=headers, body=BodyFollowing(body_len))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 508, in
send_request
self.timeout)
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1396, in
eval_coroutine
if not next(crt).poll(timeout=timeout):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 535, in
co_send_request
self.connect()
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 439, in connect
self._sock = create_socket((self.hostname, self.port))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1449, in
create_socket
raise HostnameNotResolvable(address[0])
dugong.HostnameNotResolvable: Host
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com does not have any
ip addresses
2014-12-05 00:29:04.461 31446:Thread-8 (name)s.exchook: Unhandled top-level
exception during shutdown (will not be re-raised)
2014-12-05 00:29:04.461 31446:Thread-8 (name)s.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1445, in
create_socket
return socket.create_connection(address)
File "/usr/lib/python3.4/socket.py", line 491, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "/usr/lib/python3.4/socket.py", line 530, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/mount.py", line 66, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 404, in _upload_loop
self._do_upload(*tmp)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 431, in _do_upload
% obj_id).get_obj_size()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 258, in perform_write
return fn(fh)
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 477, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 471, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 636, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 845, in close
headers=self.headers, body=self.fh)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 409, in _do_request
query_string=query_string, body=body)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 642, in _send_request
headers=headers, body=BodyFollowing(body_len))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 508, in
send_request
self.timeout)
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1396, in
eval_coroutine
if not next(crt).poll(timeout=timeout):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 535, in
co_send_request
self.connect()
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 439, in connect
self._sock = create_socket((self.hostname, self.port))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1449, in
create_socket
raise HostnameNotResolvable(address[0])
dugong.HostnameNotResolvable: Host
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com does not have any
ip addresses
2014-12-05 00:29:17.463 31446:Thread-7 (name)s.exchook: Unhandled top-level
exception during shutdown (will not be re-raised)
2014-12-05 00:29:17.464 31446:Thread-7 (name)s.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1445, in
create_socket
return socket.create_connection(address)
File "/usr/lib/python3.4/socket.py", line 491, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "/usr/lib/python3.4/socket.py", line 530, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/mount.py", line 66, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 404, in _upload_loop
self._do_upload(*tmp)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 431, in _do_upload
% obj_id).get_obj_size()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 258, in perform_write
return fn(fh)
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 477, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 471, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 636, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 845, in close
headers=self.headers, body=self.fh)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 409, in _do_request
query_string=query_string, body=body)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 642, in _send_request
headers=headers, body=BodyFollowing(body_len))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 508, in
send_request
self.timeout)
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1396, in
eval_coroutine
if not next(crt).poll(timeout=timeout):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 535, in
co_send_request
self.connect()
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 439, in connect
self._sock = create_socket((self.hostname, self.port))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1449, in
create_socket
raise HostnameNotResolvable(address[0])
dugong.HostnameNotResolvable: Host
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com does not have any
ip addresses
2014-12-05 00:29:18.330 31446:Thread-6 (name)s.exchook: Unhandled top-level
exception during shutdown (will not be re-raised)
2014-12-05 00:29:18.330 31446:Thread-6 (name)s.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1445, in
create_socket
return socket.create_connection(address)
File "/usr/lib/python3.4/socket.py", line 491, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "/usr/lib/python3.4/socket.py", line 530, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/mount.py", line 66, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 404, in _upload_loop
self._do_upload(*tmp)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 431, in _do_upload
% obj_id).get_obj_size()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 258, in perform_write
return fn(fh)
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 477, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 471, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 636, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 845, in close
headers=self.headers, body=self.fh)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 409, in _do_request
query_string=query_string, body=body)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 642, in _send_request
headers=headers, body=BodyFollowing(body_len))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 508, in
send_request
self.timeout)
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1396, in
eval_coroutine
if not next(crt).poll(timeout=timeout):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 535, in
co_send_request
self.connect()
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 439, in connect
self._sock = create_socket((self.hostname, self.port))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1449, in
create_socket
raise HostnameNotResolvable(address[0])
dugong.HostnameNotResolvable: Host
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com does not have any
ip addresses
2014-12-05 00:29:27.481 31446:Thread-5 (name)s.exchook: Unhandled top-level
exception during shutdown (will not be re-raised)
2014-12-05 00:29:27.482 31446:Thread-5 (name)s.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1445, in
create_socket
return socket.create_connection(address)
File "/usr/lib/python3.4/socket.py", line 491, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "/usr/lib/python3.4/socket.py", line 530, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/mount.py", line 66, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 404, in _upload_loop
self._do_upload(*tmp)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 431, in _do_upload
% obj_id).get_obj_size()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 258, in perform_write
return fn(fh)
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 477, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 471, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 636, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 845, in close
headers=self.headers, body=self.fh)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 409, in _do_request
query_string=query_string, body=body)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 642, in _send_request
headers=headers, body=BodyFollowing(body_len))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 508, in
send_request
self.timeout)
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1396, in
eval_coroutine
if not next(crt).poll(timeout=timeout):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 535, in
co_send_request
self.connect()
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 439, in connect
self._sock = create_socket((self.hostname, self.port))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1449, in
create_socket
raise HostnameNotResolvable(address[0])
dugong.HostnameNotResolvable: Host
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com does not have any
ip addresses
2014-12-05 00:29:30.916 31446:CommitThread (name)s.exchook: Unhandled top-level
exception during shutdown (will not be re-raised)
2014-12-05 00:29:30.917 31446:CommitThread (name)s.excepthook: Uncaught
top-level exception:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/database.py", line 143, in get_row
row = next(res)
StopIteration
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/block_cache.py", line 531, in upload
block_id = self.db.get_val('SELECT id FROM blocks WHERE hash=?', (hash_,))
File "/usr/lib/s3ql/s3ql/database.py", line 127, in get_val
return self.get_row(*a, **kw)[0]
File "/usr/lib/s3ql/s3ql/database.py", line 145, in get_row
raise NoSuchRowError()
s3ql.database.NoSuchRowError: Query produced 0 result rows
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/mount.py", line 66, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/s3ql/s3ql/mount.py", line 795, in run
self.block_cache.upload(el)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 550, in upload
self._queue_upload((el, obj_id))
File "/usr/lib/s3ql/s3ql/block_cache.py", line 593, in _queue_upload
raise NoWorkerThreads('no upload threads')
s3ql.block_cache.NoWorkerThreads: no upload threads
2014-12-05 00:29:36.399 31446:MainThread (name)s.destroy: Unable to flush
cache, no upload threads left alive
2014-12-05 00:29:41.403 31446:MainThread (name)s.unmount: Unmounting file
system...
2014-12-05 00:29:41.409 31446:MainThread (name)s.excepthook: Uncaught top-level
exception:
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1445, in
create_socket
return socket.create_connection(address)
File "/usr/lib/python3.4/socket.py", line 491, in create_connection
for res in getaddrinfo(host, port, 0, SOCK_STREAM):
File "/usr/lib/python3.4/socket.py", line 530, in getaddrinfo
for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -2] Name or service not known
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/lib/s3ql/s3ql/mount.py", line 226, in main
raise exc_inst.with_traceback(exc_tb)
File "/usr/lib/s3ql/s3ql/mount.py", line 66, in run_with_except_hook
run_old(*args, **kw)
File "/usr/lib/python3.4/threading.py", line 868, in run
self._target(*self._args, **self._kwargs)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 404, in _upload_loop
self._do_upload(*tmp)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 431, in _do_upload
% obj_id).get_obj_size()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/common.py", line 258, in perform_write
return fn(fh)
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 477, in __exit__
self.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 471, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/comprenc.py", line 636, in close
self.fh.close()
File "/usr/lib/s3ql/s3ql/backends/common.py", line 46, in wrapped
return method(*a, **kw)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 845, in close
headers=self.headers, body=self.fh)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 409, in _do_request
query_string=query_string, body=body)
File "/usr/lib/s3ql/s3ql/backends/s3c.py", line 642, in _send_request
headers=headers, body=BodyFollowing(body_len))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 508, in
send_request
self.timeout)
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1396, in
eval_coroutine
if not next(crt).poll(timeout=timeout):
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 535, in
co_send_request
self.connect()
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 439, in connect
self._sock = create_socket((self.hostname, self.port))
File "/usr/lib/python3/dist-packages/dugong/__init__.py", line 1449, in
create_socket
raise HostnameNotResolvable(address[0])
dugong.HostnameNotResolvable: Host
server-external-2014-11-21-deatech-com-s3ql.s3.amazonaws.com does not have any
ip addresses
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/bin/mount.s3ql", line 9, in <module>
load_entry_point('s3ql==2.11.1', 'console_scripts', 'mount.s3ql')()
File "/usr/lib/s3ql/s3ql/mount.py", line 230, in main
unmount_clean = True
File "/usr/lib/python3.4/contextlib.py", line 336, in __exit__
raise exc_details[1]
File "/usr/lib/python3.4/contextlib.py", line 321, in __exit__
if cb(*exc_details):
File "/usr/lib/python3.4/contextlib.py", line 267, in _exit_wrapper
callback(*args, **kwds)
File "/usr/lib/s3ql/s3ql/block_cache.py", line 390, in destroy
os.rmdir(self.path)
OSError: [Errno 39] Directory not empty:
'/root/.s3ql/s3:=2F=2Fserver-external-2014-11-21-deatech-com-s3ql=2Fserver-external-cache'
