Re: backup rsync

2014-09-08 Thread Egoitz Aurrekoetxea
El 08/09/2014, a las 18:32, Patrick Goetz escribió: > On 09/06/2014 06:52 AM, Egoitz Aurrekoetxea wrote: >> We are using Cyrus replication for some years now. It’s just fine. You >> can play too with >> expunge_delayed for avoid removing mail immediately. >> > > Hi - > > Do you mind explainin

Re: backup rsync

2014-09-08 Thread Patrick Goetz
On 09/06/2014 06:52 AM, Egoitz Aurrekoetxea wrote: > We are using Cyrus replication for some years now. It’s just fine. You > can play too with > expunge_delayed for avoid removing mail immediately. > Hi - Do you mind explaining this in more detail? Thanks. Cyrus Home Page: http://www.cyru

Re: backup rsync

2014-09-07 Thread Bron Gondwana
We have an option called 'auditlog' now, which logs every append, regardless of where it came from, along with the sha1 of the spool file, and of course the mailbox name and UID. From that, you could calculate exactly which emails were new. I keep talking of writing a real incremental dump m

Re: backup rsync

2014-09-07 Thread Stephen Ulmer
I think at that point we may not have cared… We did still run TSM incrementals, basically back-to-back, but those didn’t finish in 24 hours. We needed a better-effort way to get most message for a disaster. I looked for the patch a bit ago (not that it would apply, but I would at least see wha

Re: backup rsync

2014-09-07 Thread Bron Gondwana
Did you back up Sent folders too? On Mon, Sep 8, 2014, at 11:48 AM, Stephen Ulmer wrote: A long time ago for a much older version of Cyrus, we hacked lmtpd (I think, it’s been years) to log the messages as it wrote them down. Then we just processed the log every hour or so to backup only th

Re: backup rsync

2014-09-07 Thread Stephen Ulmer
A long time ago for a much older version of Cyrus, we hacked lmtpd (I think, it’s been years) to log the messages as it wrote them down. Then we just processed the log every hour or so to backup only those files. That saved having to traverse the entire in ode tree most of the time. -- Stephen

Re: backup rsync

2014-09-06 Thread Bron Gondwana
No, no - we do replication. Replication rocks. You could easily stop the replica and take a snapshot of that, but our real backup solution is much more evil. I've posted it to this list before, but it's basically a perl daemon which knows far too much about how Cyrus locks its data files. It

Re: backup rsync

2014-09-06 Thread Marcus Schopen
Hi Bron, Am Samstag, den 06.09.2014, 22:17 +1000 schrieb Bron Gondwana: > That's what we do :) > Thanks for your feedbeek. What's your workaround for not stopping cyrus before taking a lvm snapshot and run rsnapshot? Ciao Marcus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/I

Re: backup rsync

2014-09-06 Thread Bron Gondwana
That's what we do :) Bron. On Sat, Sep 6, 2014, at 09:52 PM, Egoitz Aurrekoetxea wrote: In fact really…. I should say is “the way” of having a proper HA. Best regards, El 06/09/2014, a las 13:52, Egoitz Aurrekoetxea <[1]ego...@ramattack.net> escribió: Good morning, We are using Cyr

Re: backup rsync

2014-09-06 Thread Egoitz Aurrekoetxea
In fact really…. I should say is “the way” of having a proper HA. Best regards, El 06/09/2014, a las 13:52, Egoitz Aurrekoetxea escribió: > Good morning, > > We are using Cyrus replication for some years now. It’s just fine. You can > play too with > expunge_delayed for avoid removing mail i

Re: backup rsync

2014-09-06 Thread Egoitz Aurrekoetxea
Good morning, We are using Cyrus replication for some years now. It’s just fine. You can play too with expunge_delayed for avoid removing mail immediately. Regards, El 05/09/2014, a las 17:25, Marcus Schopen escribió: > Am Samstag, den 30.08.2014, 17:10 +0200 schrieb Simon Matter: >>> Am Frei

Re: backup rsync

2014-09-05 Thread Marcus Schopen
Am Samstag, den 30.08.2014, 17:10 +0200 schrieb Simon Matter: > > Am Freitag, den 29.08.2014, 07:56 -0700 schrieb David R Bosso: > >> --On August 29, 2014 at 4:27:57 PM +0200 Marcus Schopen > >> wrote: > >> > >> > Hi, > >> > > >> > I'm planing to use lvm snaps and rsync for a daily disaster recove

Re: backup rsync

2014-09-01 Thread Marcus Schopen
Am Samstag, den 30.08.2014, 14:37 -0500 schrieb Patrick Goetz: > On 8/30/2014 10:10 AM, Simon Matter wrote: > > > > I suggest -aH to preserve single instance storage in the backup. > > > > Does cyrus use a lot of hard links? I use rsync a lot to create > snapshot backups, and use hard links acro

Re: backup rsync

2014-09-01 Thread Marcus Schopen
Am Samstag, den 30.08.2014, 17:10 +0200 schrieb Simon Matter: > > Am Freitag, den 29.08.2014, 07:56 -0700 schrieb David R Bosso: > >> --On August 29, 2014 at 4:27:57 PM +0200 Marcus Schopen > >> wrote: > >> > >> > Hi, > >> > > >> > I'm planing to use lvm snaps and rsync for a daily disaster recove

Re: backup rsync

2014-08-30 Thread Patrick Goetz
Thanks for that explanation! I don't have time to read every email that comes to the cyrus list, and missed that one. One point of clarification: On 8/30/2014 2:49 PM, Nic Bernstein wrote: > ctl_cyrusdb -c > ctl_mboxlist -d > mailboxes.db.dump > stop cyrus > lvm snaps >

Re: backup rsync

2014-08-30 Thread Nic Bernstein
On 08/30/2014 02:37 PM, Patrick Goetz wrote: On 8/30/2014 10:10 AM, Simon Matter wrote: I suggest -aH to preserve single instance storage in the backup. Does cyrus use a lot of hard links? I use rsync a lot to create snapshot backups, and use hard links across snapshots to preserve space; how

Re: backup rsync

2014-08-30 Thread Patrick Goetz
On 8/30/2014 10:10 AM, Simon Matter wrote: > > I suggest -aH to preserve single instance storage in the backup. > Does cyrus use a lot of hard links? I use rsync a lot to create snapshot backups, and use hard links across snapshots to preserve space; however, for a single instance backup and un

Re: backup rsync

2014-08-30 Thread Simon Matter
> Am Freitag, den 29.08.2014, 07:56 -0700 schrieb David R Bosso: >> --On August 29, 2014 at 4:27:57 PM +0200 Marcus Schopen >> wrote: >> >> > Hi, >> > >> > I'm planing to use lvm snaps and rsync for a daily disaster recovery >> > backup on my master cyrus (2.4.12 Ubuntu 12.04 LTS): >> >> Have you

Re: backup rsync

2014-08-30 Thread Marcus Schopen
Am Freitag, den 29.08.2014, 07:56 -0700 schrieb David R Bosso: > --On August 29, 2014 at 4:27:57 PM +0200 Marcus Schopen > wrote: > > > Hi, > > > > I'm planing to use lvm snaps and rsync for a daily disaster recovery > > backup on my master cyrus (2.4.12 Ubuntu 12.04 LTS): > > Have you tested l

Re: backup rsync

2014-08-29 Thread Patrick Goetz
There's something to be worried about with using lvm snapshots. My understanding is that this can dramatically slow down your system. I'm too busy right now to pull up a reference, but google is your friend. On 08/29/2014 09:27 AM, Marcus Schopen wrote: > Hi, > > I'm planing to use lvm snaps

Re: backup rsync

2014-08-29 Thread David R Bosso
--On August 29, 2014 at 4:27:57 PM +0200 Marcus Schopen wrote: > Hi, > > I'm planing to use lvm snaps and rsync for a daily disaster recovery > backup on my master cyrus (2.4.12 Ubuntu 12.04 LTS): Have you tested lvm snaps for this purpose yet? When I tried to use lvm snapshots in this way a

backup rsync

2014-08-29 Thread Marcus Schopen
Hi, I'm planing to use lvm snaps and rsync for a daily disaster recovery backup on my master cyrus (2.4.12 Ubuntu 12.04 LTS): ctl_cyrusdb -c ctl_mboxlist -d > mailboxes.db.dump stop cyrus lvm snaps start cyrus rsync /var/lib/cyrus/ and /var/spool/cyrus to backup host remove snaps Is there