Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Per olof Ljungmark
On 11/12/10 00:06, Bron Gondwana wrote: > On Thu, Nov 11, 2010 at 10:12:31AM +0100, Paul Dekkers wrote: >> Hmm, allright, so I ran it with a truss (like strace for FreeBSD) to >> give me a bit more verbosity, and I realized I should chown. >> >> But then: >> >> # chown cyrus 22003. >> # sudo -u cyr

Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Bron Gondwana
On Thu, Nov 11, 2010 at 11:58:04PM -0200, Henrique de Moraes Holschuh wrote: > It _will_ write to stderr (aka fd 2). If we want to be safe, we make sure > fds 0-2 are sane, and we check when we open sockets/files that we did not > get fds below 3... > > > Bron ( a while later, fd 2 gets re-used a

Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Henrique de Moraes Holschuh
On Thu, 11 Nov 2010, Gary Mills wrote: > Isn't the modern design multiple threads, rather than multiple > processes? That seems to me to be the right direction for Cyrus. > It might even make for a simpler design. Ehh... not realy. Multithreading means locking, futexes, and other pains. It also m

Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Henrique de Moraes Holschuh
On Fri, 12 Nov 2010, Bron Gondwana wrote: > Since that wasn't the issue - why on earth was it allowed to have fd 2 > in the first place? Is Cyrus closing fd 2, or is truss closing it?? That is the issue that caused the leaks into protstreams, AFAIK. It is always com-err writing to fd 2, and some

Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Gary Mills
On Fri, Nov 12, 2010 at 10:33:15AM +1100, Bron Gondwana wrote: > Sorry - I've been busy working on the specific problem rather than the > overview, and I realised I kind of glossed over this bit: > > On Thu, Nov 11, 2010 at 02:24:47PM -0200, Henrique de Moraes Holschuh wrote: > > This probably nee

Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Bron Gondwana
Sorry - I've been busy working on the specific problem rather than the overview, and I realised I kind of glossed over this bit: On Thu, Nov 11, 2010 at 02:24:47PM -0200, Henrique de Moraes Holschuh wrote: > This probably needs a redesign of master/service fd-passing protocol, > and of prot stream

Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Bron Gondwana
On Thu, Nov 11, 2010 at 10:12:31AM +0100, Paul Dekkers wrote: > Hmm, allright, so I ran it with a truss (like strace for FreeBSD) to > give me a bit more verbosity, and I realized I should chown. > > But then: > > # chown cyrus 22003. > # sudo -u cyrus /usr/local/cyrus/bin/reconstruct user.bla >

Cyrus IMAPd 2.4.4 Released

2010-11-11 Thread Jeroen van Meeuwen (Kolab Systems)
We are pleased to announce the immediate availability of Cyrus IMAPd version 2.4.4. This is a stable released in the 2.4 series, containing a mere 5 bug-fixes since version 2.4.3, released two days ago. Particular focus of this release has been paid to upgrade paths, for which many of our users

Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Bron Gondwana
On Thu, Nov 11, 2010 at 02:24:47PM -0200, Henrique de Moraes Holschuh wrote: > On Thu, 11 Nov 2010, Paul Dekkers wrote: > > Uhoh! And then I looked at mailboxes.db: It looks like part completely > > rewritten, including the skiplist header, and the first line now said: > > user.bla: System I/O erro

Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Bron Gondwana
On Thu, Nov 11, 2010 at 02:24:47PM -0200, Henrique de Moraes Holschuh wrote: > On Thu, 11 Nov 2010, Paul Dekkers wrote: > > Uhoh! And then I looked at mailboxes.db: It looks like part completely > > rewritten, including the skiplist header, and the first line now said: > > user.bla: System I/O erro

Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Bron Gondwana
On Thu, Nov 11, 2010 at 02:24:47PM -0200, Henrique de Moraes Holschuh wrote: > On Thu, 11 Nov 2010, Paul Dekkers wrote: > > Uhoh! And then I looked at mailboxes.db: It looks like part completely > > rewritten, including the skiplist header, and the first line now said: > > user.bla: System I/O erro

Re: reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Henrique de Moraes Holschuh
On Thu, 11 Nov 2010, Paul Dekkers wrote: > Uhoh! And then I looked at mailboxes.db: It looks like part completely > rewritten, including the skiplist header, and the first line now said: > user.bla: System I/O error System I/O error This is something that has plagued cyrus for a long time. Can we

reconstruct caused mailboxes (skiplist) corruption?

2010-11-11 Thread Paul Dekkers
Hi, Maybe I've some more 2.4.3 badness: I just decided to restore one message, and copied it from the archive. Unfortunately, I didn't copy properly, so the ownership was root instead of cyrus. I then ran a # sudo -u cyrus /usr/local/cyrus/bin/reconstruct user.bla user.bla: System I/O error Syst

Re: problematic upgrade 2.3.16 -> 2.4.3

2010-11-11 Thread Paul Dekkers
Hi Bron, On 11-11-10 03:45, Bron Gondwana wrote: > On Wed, Nov 10, 2010 at 09:38:34PM +0100, Paul Dekkers wrote: >> On 10-11-2010 21:27, Bron Gondwana wrote: >> (Can I downgrade? I just need to reconstruct everything, right, because the index format changed? :-S) >>> >>> Yes, you will ne