I am backing up to the cloud for the first time and see some unexpected (or
at least undesired) behaviour. With the cloud resource below, I had
expected that as each local cache volume is created, it would be uploaded
and then be truncated, I.e. parallel operations.
I had hoped that AfterUpload would do that but what I see instead is that
all the local volumes are first created then upload starts and cache is
truncated after. I'm not sure if truncation occurs after each part is
uploaded, at the end of all uploads or the end of the job.
This causing me a problem with large backups since enough local cache space
must be available of size equal roughly to the data set size, in my case
data is 1TB but available cache is 800G. When it runs out of cache the job
errors and must be cancelled. I also have to clean up afterwards.
I read in the 11x manual under the cloud resource that the Truncate Cache =
AfterUpload directive is not yet implemented. That is also true for the
AtEndOfJob option, the only option being No which doesn't truncate cache at
all. However these other two do appear to be acceptable.
Since this is my first attempt at cloud backup, I'm hoping to get some
advice on how I should amend my config.
bacula-sd.conf
...
Cloud {
Name = "B2"
Driver = "S3"
HostName = x
Region = x
BucketName = x
AccessKey = x
SecretKey = x
Protocol = HTTPS
UriStyle = path
Truncate Cache = AfterUpload #No|AfterUpload|AtEndOfJob
Upload = EachPart
}
Manual 11x
...
Truncate Cache = <Truncate-kw>
This directive specifies when Bacula should automatically remove (truncate)
the local cache parts. Local cache parts can only be removed if they have
been uploaded to the cloud. The currently implemented values are:
No Do not remove cache. With this option you must manually delete the cache
parts with a bconsole truncate cache command, or do so with an Admin Job
that runs an truncate cache command. This is the default. AfterUpload Each
part will be removed just after it is uploaded. Note, if this option[*note]
is specified, all restores will require a download from the Cloud. AtEndOfJob
With this option[*note] , at the end of the Job, every part that has been
uploaded to the Cloud will be removed (truncated).
[*Not yet implemented]
Chris Wilkinson
_______________________________________________
Bacula-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/bacula-users
