FastMail.FM GUID upgrade process

2007-10-28 Thread Bron Gondwana
Ok - we're doing our GUID upgrades across the board now. Here's the process we're using: a) wrote a tool that tied a "DB_File" called "cyrus.sha1s" in each meta directory on the replicas, parsed the index files looking for records with nothing but zeros in the last 16 characters of the G

Re: Cyrus IMAPd 2.3.10 Released

2007-11-05 Thread Bron Gondwana
On Sun, Nov 04, 2007 at 07:19:26PM -0800, Rich Wales wrote: > What is the current status of 2.3.10? Right after it was announced > a couple of weeks ago, I saw some people reporting problems. Are > there any patches? Or is 2.3.10 still believed to be OK as is? > > I'm running 2.3.9 on a FreeBSD

Re: Deleting top-level mailbox with 'delete_mode: delayed'

2007-11-05 Thread Bron Gondwana
On Fri, Nov 02, 2007 at 01:15:37PM -0400, Brian Wong wrote: > On Nov 2, 2007 12:39 PM, Rudy Gevaert <[EMAIL PROTECTED]> wrote: > > > > Brian Wong wrote: > > > I was testing out Cyrus 2.3.10 and realized that when I set the option > > > > > > delete_mode: delayed > > > > > > I can not delete top-lev

Re: Cyrus IMAPd 2.3.10 Released

2007-11-06 Thread Bron Gondwana
On Tue, Nov 06, 2007 at 08:57:29AM +0100, Rudy Gevaert wrote: > Bron Gondwana wrote: >> On Sun, Nov 04, 2007 at 07:19:26PM -0800, Rich Wales wrote: >>> What is the current status of 2.3.10? Right after it was announced >>> a couple of weeks ago, I saw some peop

Re: LARGE single-system Cyrus installs?

2007-11-08 Thread Bron Gondwana
On Thu, Nov 08, 2007 at 10:18:04AM -0800, Vincent Fox wrote: > Our latest line of investigation goes back to the Fastmail suggestion, > simply > have multiple Cyrus binary instances on a system. Each running it's own > config and with it's own ZFS filesystems out of the pool to use. > Since we ca

Re: LARGE single-system Cyrus installs?

2007-11-10 Thread Bron Gondwana
On Fri, Nov 09, 2007 at 01:28:05PM -0500, John Madden wrote: > On Fri, 2007-11-09 at 19:10 +0100, Jure Pečar wrote: > > I'm still on linux and was thinking a lot about trying out solaris 10, > > but > > stories like yours will make me think again about that ... > > Agreed -- with the things I see

Re: How many people to admin a Cyrus system?

2007-11-10 Thread Bron Gondwana
On Fri, Nov 09, 2007 at 08:24:00AM -0500, Adam Tauno Williams wrote: > > > How many > > > and what sort of people does it take to maintain a system such as > > > this? I need a good argument for hiring a replacement for me. > > At a minimum you want 1 qualified person and someone cross-trained > >

Skiplist stuff

2007-11-11 Thread Bron Gondwana
On Sun, Nov 11, 2007 at 02:31:45PM +1100, Bron Gondwana wrote: > * the one buggy skiplist I actually still have a copy of, the "logstart" > value in the header is wrong, causing recovery to fail with only a few > of the records still reachable because it hits another INORDE

Re: Replication: does it work in both directions?

2007-11-11 Thread Bron Gondwana
On Sat, Nov 10, 2007 at 07:51:15PM -0800, Rich Wales wrote: > I'm using replication on a 2.3.9 system. > > I know that if changes happen on the master system, they are propagated > automatically to the replica system. > > But what happens if I make a change on the replica (e.g., by setting up > a

Re: Replication: sync_client -r dies

2007-11-11 Thread Bron Gondwana
On Sat, Nov 10, 2007 at 07:09:53PM -0800, Rich Wales wrote: > After about a week of having synchronization running perfectly in my > 2.3.9 system, I finally got another bailout incident with sync_client > on my master server. > > This happened just after I shut down my replica server (to move it t

Multiple skiplist bugs found, patches attached

2007-11-12 Thread Bron Gondwana
On Mon, Nov 12, 2007 at 12:34:34AM +1100, Bron Gondwana wrote: > Anyway - here it is. A "recovery()" that copes if the logstart > parameter in the database header is wrong. No, I don't have a > clue how that happened unless lseek() lied. Maybe it sometimes > lies, I d

Re: Replication: does it work in both directions?

2007-11-12 Thread Bron Gondwana
On Sun, Nov 11, 2007 at 08:41:04PM -0800, Rich Wales wrote: > Earlier, I wrote: > > >> What do I need to do in order for changes made on the replica > >> to get copied over to the master? > > Bron Gondwana replied: > > > Impossible. You don't do th

Re: Renaming heirarchies from the bottom

2007-11-12 Thread Bron Gondwana
On Mon, Nov 12, 2007 at 11:38:54AM +, Ian G Batten wrote: > A common scenario when we are moving users between partitions is to > want to move their archived mail first, because there's less risk of > disrupting them, and then their top-level mailbox last. For a different approach - we use

Re: Replication: does it work in both directions?

2007-11-12 Thread Bron Gondwana
On Mon, 12 Nov 2007 09:37:12 -0800, "Rich Wales" <[EMAIL PROTECTED]> said: > Bron Gondwana wrote: > > > It doesn't work like that. Rolling replication gets events from > > actions on mailboxes (lmtp deliver, imapd updates, etc) and logs > > them

Re: Multiple skiplist bugs found, patches attached

2007-11-13 Thread Bron Gondwana
On Tue, 13 Nov 2007 09:12:18 +0100 (CET), "Simon Matter" <[EMAIL PROTECTED]> said: > > On Mon, Nov 12, 2007 at 12:34:34AM +1100, Bron Gondwana wrote: > >> Anyway - here it is. A "recovery()" that copes if the logstart > >> parameter in the datab

Re: Deleting top-level mailbox with 'delete_mode: delayed'

2007-11-13 Thread Bron Gondwana
On Tue, Nov 13, 2007 at 01:11:49PM +0100, Simon Matter wrote: > > expunge_mode: delayed > > delete_mode: delayed > > I've just tried a batch delete of mailboxes and hit the same wall. > > Mailbox deletion doesn't work anymore with 2.3.10 if "delete_mode: > delayed". If "delete_mode: immediate" it

Re: LARGE single-system Cyrus installs?

2007-11-13 Thread Bron Gondwana
On Tue, Nov 13, 2007 at 10:24:22AM +, David Carter wrote: > On Sun, 11 Nov 2007, Bron Gondwana wrote: > > >> 250,000 mailboxes, 1,000 concurrent users, 60 million emails, 500k > >> deliveries/day. For us, backups are the worst thing, followed by > >> reise

Re: v2.3.10 build fails, pcreposix problems

2007-11-14 Thread Bron Gondwana
On Wed, Nov 14, 2007 at 12:16:29PM -0500, Larry Rosenbaum wrote: > Upgrading PCRE to v7.4 fixed the problem. (Previous version was v6.5) Excellent - because I was a little surprised otherwise - then again I only tested on Debian Etch because that's all I have handy. Ken - I think the solution is

Re: LARGE single-system Cyrus installs?

2007-11-15 Thread Bron Gondwana
On Thu, Nov 15, 2007 at 01:29:54PM -0500, Wesley Craig wrote: > On 14 Nov 2007, at 23:15, Vincent Fox wrote: > > We have all Cyrus lumped in one ZFS pool, with separate filesystems > > for > > imap, mail, sieve, etc. However, I do have an unused disk in each > > array > > such that I could set

Re: LARGE single-system Cyrus installs?

2007-11-19 Thread Bron Gondwana
On Mon, Nov 19, 2007 at 08:50:16AM +, Ian G Batten wrote: > > On 17 Nov 07, at 0909, Rob Mueller wrote: >> >> This shouldn't really be a problem. Yes the whole file is locked for the >> duration of the write, however there should be only 1 fsync per >> "transaction", which is what would introdu

Re: LARGE single-system Cyrus installs?

2007-11-19 Thread Bron Gondwana
know which block belongs > to which file, the entire journal must be applied to the filesystem to > achieve the expected fsync() symantics (at least, with data=ordered, > it does). Lucky we run reiserfs then, I guess... Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: ht

Re: LARGE single-system Cyrus installs?

2007-11-19 Thread Bron Gondwana
On Mon, 19 Nov 2007 22:51:43 -0800, "Vincent Fox" <[EMAIL PROTECTED]> said: > Bron Gondwana wrote: > > Lucky we run reiserfs then, I guess... > > > > > > I suppose this is inappropriate topic-drift, but I wouldn't be > too sanguine about Re

Re: 2.3.10 Upgrade Question

2007-11-20 Thread Bron Gondwana
t; anything special. The index files are pretty small, and they rebuild fast :) They get streamed into new copies every single expunge anyway. Also, it will only upgrade each index as it is opened for the first time, so the load isn't one giant hit. Bron. -- Bron Gondwana [EMAIL PROTECT

Re: 2.3.10 Upgrade Question

2007-11-20 Thread Bron Gondwana
On Tue, 20 Nov 2007 11:54:24 +, "Ian G Batten" <[EMAIL PROTECTED]> said: > > On 20 Nov 07, at 1146, Bron Gondwana wrote: > > > > > The index files are pretty small, and they rebuild fast :) They > > get streamed > > into new copies every s

FastMail.FM Patchset Updated

2007-11-20 Thread Bron Gondwana
As usual you can get the patches here: http://cyrus.brong.fastmail.fm/ I've been busy with Cyrus _again_ - so much for my theory that I was taking a break. OK - here's what's new. * http://cyrus.brong.fastmail.fm/patches/cyrus-skiplist-bugfixes-2.3.10.diff http://cyrus.brong.fastmail.fm/patc

Re: FastMail.FM Patchset Updated

2007-11-21 Thread Bron Gondwana
ine isn't (though I renamed the function he's using...) Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: reconstruct -u or -U

2007-11-21 Thread Bron Gondwana
On Wed, Nov 21, 2007 at 03:06:39PM -0800, Andrew Morgan wrote: > The changelog says: > >Added -u and -U options to reconstruct -- courtesy of David Carter. > > But I can't find those options listed in the manpage or the built-in help > of reconstruct. What do those options do? The changelo

Re: Murder in replicated mode

2007-11-21 Thread Bron Gondwana
On Wed, Nov 21, 2007 at 09:41:15PM -0300, Diego Woitasen wrote: > Hi! > I'm trying to setup murder in replicated mode. My schema is: > > -Two servers + one shared storage > -Redhat Cluster Suite (RHEL 5.1) with GFS2 working. > -Cyrus 2.3.10 in both servers working. >

Re: FastMail.FM Patchset Updated

2007-11-21 Thread Bron Gondwana
On Wed, Nov 21, 2007 at 06:37:17AM -0500, Ken Murchison wrote: > Bron Gondwana wrote: >> On Wed, 21 Nov 2007 07:40:21 +0100 (CET), "Simon Matter" >> <[EMAIL PROTECTED]> said: >>> Hi Bron, >>> >>> Did you consider this one >>> htt

Re: FastMail.FM Patchset Updated (new patches)

2007-11-21 Thread Bron Gondwana
On Wed, Nov 21, 2007 at 06:37:17AM -0500, Ken Murchison wrote: > Bron Gondwana wrote: >> On Wed, 21 Nov 2007 07:40:21 +0100 (CET), "Simon Matter" >> <[EMAIL PROTECTED]> said: >>> Hi Bron, >>> >>> Did you consider this one >>> htt

Re: Murder in replicated mode

2007-11-22 Thread Bron Gondwana
On Thu, Nov 22, 2007 at 11:01:30PM -0300, Diego Woitasen wrote: > On Thu, Nov 22, 2007 at 12:50:47PM +1100, Bron Gondwana wrote: > > On Wed, Nov 21, 2007 at 09:41:15PM -0300, Diego Woitasen wrote: > > > Hi! > > > I'm trying to setup murder in replicated mode. My

Re: Restricting admin logins

2007-11-29 Thread Bron Gondwana
On Thu, Nov 29, 2007 at 03:54:29PM +0100, Alain Spineux wrote: > On Nov 29, 2007 3:15 PM, Andy Fiddaman <[EMAIL PROTECTED]> wrote: > > > > At the moment we patch the Cyrus IMAP server source so that administrators > > (admins in the config file) can only log in from certain IP addresses. > > > > I

Re: Cyrus upgrade from 2.1.18 to 2.2.13 moved email messages

2007-12-02 Thread Bron Gondwana
On Sun, Dec 02, 2007 at 08:51:51PM +0100, Steinar Bang wrote: > > Steinar Bang <[EMAIL PROTECTED]>: > > > Steinar Bang <[EMAIL PROTECTED]>: > > Sebastian Hagedorn <[EMAIL PROTECTED]>: > > What previously was mail/s/user/sb/ is now mail/u/s/user/sb/ > > Here's what I think happen

Re: DBERROR

2007-12-06 Thread Bron Gondwana
On Thu, Dec 06, 2007 at 05:56:29PM +0100, Alain Spineux wrote: > On Dec 6, 2007 5:03 PM, Jeff Blaine <[EMAIL PROTECTED]> wrote: > > bash-2.05# ls -l *db > > -rw--- 1 cyrusmail 144 Dec 5 16:56 annotations.db > > -rw--- 1 cyrusmail 144 Dec 5 16:56 deliver.db > >

Re: Cyrus on Solaris at universities?

2007-12-13 Thread Bron Gondwana
On Thu, Dec 13, 2007 at 11:46:19AM +0200, Janne Peltonen wrote: > On Thu, Dec 13, 2007 at 08:26:03AM +0100, Rudy Gevaert wrote: > > Vincent Fox wrote: > > > Just wondering what other universities are runing Cyrus on Solaris? > > > > > > We know of: > > > CMU > > > UCSB > > > > We have run it, but

Re: Cyrus on Solaris at universities?

2007-12-13 Thread Bron Gondwana
On Thu, Dec 13, 2007 at 04:22:45PM -0800, Vincent Fox wrote: > Bron Gondwana wrote: > > (Linux comments) > > 'Twas not my intent to start a this-OS versus that-OS comparison. > Valid though that is, it's a different thread. > > Like most sites, we have var

Re: Plugging into the imap system

2007-12-22 Thread Bron Gondwana
On Sat, Dec 22, 2007 at 04:51:46PM -0300, Diego M. Vadell wrote: > Hi Gabriele, >If you are using linux, maybe you can use inotify-tools to notify you of > any change in cyrus' spool. Be aware that the files on disk are created _before_ the index record, so you need to wait or poll until the

Re: Plaintext only for loopback?

2008-01-13 Thread Bron Gondwana
On Sun, Jan 13, 2008 at 01:59:48AM -0500, Chris Pepper wrote: > Hello, > > I want to allow plaintext auth only for SquirrelMail (running on the > Cyrus IMAPd server), and require encrypted authentication over all > physical network connections. I see several options governing plaintext >

Re: Plaintext only for loopback?

2008-01-14 Thread Bron Gondwana
On Sun, Jan 13, 2008 at 07:09:25PM -0800, Phil Pennock wrote: > It's been a little while since I've done this, so I'm not absolutely > sure of the details, but if memory serves ... > > Run two different IMAP services from cyrus.conf: > > SERVICES { > imap cmd="imapd" listen="imap.exam

Re: segfault of imapd and pop3d

2008-01-15 Thread Bron Gondwana
On Tue, Jan 15, 2008 at 09:18:27AM +0100, Michael Menge wrote: > Hi, > > I found some segmentation faults of my "imapd -s" and "pop3d -s""proceses > in my logs.Has anybody seen this before. I'm running cyrus 2.3.8 on an > SLES10 x86_64. > > Jan 14 09:37:44 mailserv08 kernel: imapd[1898]: segfault

Re: segfault of imapd and pop3d

2008-01-15 Thread Bron Gondwana
On Tue, 15 Jan 2008 16:33:50 +0100, "Michael Menge" <[EMAIL PROTECTED]> said: > Quoting Bron Gondwana <[EMAIL PROTECTED]>: > > > Syslog is logging Cyrus at debug level, and the last line for that > process is > "accepted connection". Normaly

Re: Move to new server

2008-02-19 Thread Bron Gondwana
> # SourceUserSourcePassword DestinationUser DestinationPw > Copy"cyrus" "cyruspw""cyrus" "cyruspw" Does this copy all seen information as well? Seen is per-user in Cyrus, so you won't see it if the admin user

Re: Endgame: Cyrus big install at UC Davis

2008-02-21 Thread Bron Gondwana
cost a bit more to read, but the IO would _all_ be streaming then, and we have plenty of memory. We can still just append the changes. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: GUID change to SHA1

2008-02-21 Thread Bron Gondwana
On Thu, Feb 21, 2008 at 05:11:48PM +0100, Martin Schweizer wrote: > Hello > > I use FreeBSD 6.3 and cyrus 2.3.11. Below is the manual for the change. > > Upgrading from 2.3.9 > > * The method used for generating Globally Unique IDentifiers used > for replication has been changed to be the

Re: Deleted cyrus.* files

2008-02-21 Thread Bron Gondwana
On Thu, Feb 21, 2008 at 11:26:49AM +0100, David Flegl wrote: > Hi, > > > try reconstruct from command line. > > 1. login as cyrus. > > 2. /usr/local/cyrus/bin/reconstruct -r user/bad.user > > Thank's for a reply. I've tried but no effect. Reconstruct said: > $>/usr/local/cyrus/bin/reconstruct

Re: Abusing the sync protocol for fun and profit.

2008-02-21 Thread Bron Gondwana
On Thu, 21 Feb 2008 09:20:34 -0600, "Dan White" <[EMAIL PROTECTED]> said: > Bron Gondwana wrote: > > Attached are three perl modules, > > > > Cyrus/SyncClient.pm > > Cyrus/ImapReplica.pm > > Mail/IMAPTalk.pm > > > > I'm in

Re: Again: GUID change to SHA1

2008-02-25 Thread Bron Gondwana
On Mon, Feb 25, 2008 at 05:52:34PM +0100, Martin Schweizer wrote: > Hello > > 2008/2/21, Bron Gondwana <[EMAIL PROTECTED]>: > > > On Thu, Feb 21, 2008 at 05:11:48PM +0100, Martin Schweizer wrote: > > > Hello > > > > > > I use FreeBSD

Re: Fwd: Again: GUID change to SHA1

2008-03-05 Thread Bron Gondwana
The important question is: are your messages being replicated? > > > Yes, the messages will replicated all the time. Cool - I'd say you're fine then. Nothing to worry about! Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/

Re: delayed expunge/delete with replication?

2008-03-10 Thread Bron Gondwana
On Mon, Mar 10, 2008 at 07:53:52AM -0700, David R Bosso wrote: > Hello, > > I've got a few questions about how delayed expunge works with replication > in 2.3.11. > > 1. If I want delayed expunge & delete on both the replica and master > (replicated delayed expunge & delete), do I need them tu

Re: Migrate all to skiplist?

2008-03-12 Thread Bron Gondwana
On Wed, Mar 12, 2008 at 12:02:30PM -0400, Shelley Waltz wrote: > > I am migrating my 200 users from a RHAS3 cyrus-imapd-2.2.3 install to a > RHAS5 cyrus-imapd-2.3.7 install. > > I have been happy with the current setup with the exception of issues with > the Berkeley DB for mailboxes and deliver.

Re: Is there any way to log/see protocol level commands for a mailbox which is not under user.* ?

2008-03-13 Thread Bron Gondwana
On Thu, Mar 13, 2008 at 11:57:31AM +0100, Ciprian Marius Vizitiu wrote: > Hi listers, > > > > It's written in the manuals that by creating a folder under > /var/lib/imap/log/username Cyrus will log at protocol level details for > "username". Question: how can I do the same for a mailbox which

Re: reconstruct doing nothing

2008-03-22 Thread Bron Gondwana
r looks to be useless > - -f discover yet unknow folder, recursively too, but only inside new > folder, not if already known, use * to for a full discovery in two > time user/[EMAIL PROTECTED] and > user/first.lastname/[EMAIL PROTECTED] > - '*' and '%' allow to walk

Re: ctl_mboxlist virtual memory exhausted !

2008-03-25 Thread Bron Gondwana
it takes far too long to copy that much data onto modern drives, so if you lose your drive unit then getting users back up and running looks like about a week's sitting there watching data copy. Yes, I have done that before. That's why we run partitions that can rebuild from scratch in 6

Re: Sieve forwarding loop destroys e-mail

2008-03-31 Thread Bron Gondwana
On Mon, Mar 31, 2008 at 04:21:20PM +0200, Alain Spineux wrote: > On Mon, Mar 31, 2008 at 2:40 PM, Joseph Brennan <[EMAIL PROTECTED]> wrote: > > > > Jo Rhett <[EMAIL PROTECTED]> wrote: > > > > > I would ask that you spend some time determining how the > > > program could determine it is a bad ru

Re: Sieve forwarding loop destroys e-mail

2008-03-31 Thread Bron Gondwana
On Mon, 31 Mar 2008 15:51:17 -0700 (PDT), "Andrew Morgan" <[EMAIL PROTECTED]> said: > On Tue, 1 Apr 2008, Bron Gondwana wrote: > > > On Mon, Mar 31, 2008 at 04:21:20PM +0200, Alain Spineux wrote: > >> On Mon, Mar 31, 2008 at 2:40 PM, Joseph Brennan <[

Re: Sync_client error Hit upload limit 0

2008-04-02 Thread Bron Gondwana
On Wed, Apr 02, 2008 at 11:28:07AM +1030, Stephen Carr wrote: > Dear List > > I get the following type of error (see below) during replication that > appeared after upgrading from 2.3.8 to 2.3.11. > > This occurs occasionally and yet the emails are synced and it occurs for > various user accounts

Re: Sync_client error Hit upload limit 0

2008-04-02 Thread Bron Gondwana
On Wed, Apr 02, 2008 at 09:51:50PM +1100, Bron Gondwana wrote: > On Wed, Apr 02, 2008 at 11:28:07AM +1030, Stephen Carr wrote: > > I get the following type of error (see below) during replication that > > appeared after upgrading from 2.3.8 to 2.3.11. > > BAH - upload_mess

Re: Sync_client error Hit upload limit 0

2008-04-02 Thread Bron Gondwana
On Wed, Apr 02, 2008 at 07:19:07AM -0400, Ken Murchison wrote: > Bron Gondwana wrote: >> On Wed, Apr 02, 2008 at 09:51:50PM +1100, Bron Gondwana wrote: >>> On Wed, Apr 02, 2008 at 11:28:07AM +1030, Stephen Carr wrote: >>>> I get the following type of error (see

Re: Sync_client error Hit upload limit 0

2008-04-02 Thread Bron Gondwana
On Wed, Apr 02, 2008 at 11:28:07AM +1030, Stephen Carr wrote: > Apr 2 10:31:14 brooks sync_client[23049]: Hit upload limit 0 at UID > 101775 for user.XXX, sending Btw - you can get the same effect as applying the patch by putting the following in your imapd.conf: sync_batch_size: 4294967295 Ye

Re: Sync_client error Hit upload limit 0

2008-04-02 Thread Bron Gondwana
On Wed, Apr 02, 2008 at 07:46:33AM -0400, Ken Murchison wrote: > Bron Gondwana wrote: >> On Wed, Apr 02, 2008 at 07:19:07AM -0400, Ken Murchison wrote: >>> Bron Gondwana wrote: >>>> On Wed, Apr 02, 2008 at 09:51:50PM +1100, Bron Gondwana wrote: >>>>

Re: Sync_client error Hit upload limit 0

2008-04-02 Thread Bron Gondwana
hen a replica gets shut down with the sync still running of course). Glad you seem sorted :) Bron ( been off Cyrus patching for a while now... was time to take a break and work on something else ) -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyr

Patch to avoid mailboxesdb corruption on concurrent renames

2008-04-03 Thread Bron Gondwana
I've put a header on the patch describing the bug. Basically, the result code from mailbox_open_locked() wasn't being tested sufficiently, and hence the new mailbox name would be created in mailboxes.db even though the files were no longer available to be copied - causing sync bailouts and IOERROR

Re: Patch to avoid mailboxesdb corruption on concurrent renames

2008-04-04 Thread Bron Gondwana
On Fri, Apr 04, 2008 at 07:10:27AM -0400, Ken Murchison wrote: > Bron Gondwana wrote: > >> Bron ( P.S. isn't it about time for a 2.3.12? I'm getting sick >>of posting skiplist patches to people running the >>lastest and having issues! ) > >

Re: cyr_expire -E ?

2008-04-19 Thread Bron Gondwana
On Sat, Apr 19, 2008 at 09:19:40AM +0100, David Carter wrote: > On Fri, 18 Apr 2008, David R Bosso wrote: > > > I don't specify a -X, I just want to prune the duplicate db. What am I > > doing wrong? > > -X expunge-days > Expunge previously deleted messages older than expunge-days >

Re: cyr_expire -E ?

2008-04-20 Thread Bron Gondwana
but everything else will do delayed delete. Don't come crying when your mailboxes melt under the load of huge spam databases whenever you delete a message though... actually, it's not so bad since cyrus_expunge doesn't get sorted every time, the records just get appended. Bron. --

FastMail.FM patchset updated against 2.3.12

2008-04-22 Thread Bron Gondwana
On Mon, Apr 21, 2008 at 07:35:01AM -0400, Ken Murchison wrote: > I am pleased to announce the release of Cyrus IMAPd 2.3.12. This > release should be considered production quality. http://cyrus.brong.fastmail.fm/ Notable changes: * cyrus-findall-txn-2.3.12.diff Creates a mboxlist_findall_t

Re: Cyrus IMAPd 2.3.12 Released

2008-04-23 Thread Bron Gondwana
++ > Process 26096 detached This would be even more useful: % gdb /opt/imap/libexec/master > run -d [ wait for it to segfault ] > bt > Compiling and running version 2.3.11 with the same options on the same > machine works fine. Are you able to post your /var/imap/imapd.conf f

Re: Cyrus IMAPd 2.3.12 Released

2008-04-23 Thread Bron Gondwana
On Wed, Apr 23, 2008 at 05:58:27PM +0400, Dmitriy Kirhlarov wrote: > Sebastian Hagedorn wrote: > > --On 23. April 2008 15:37:19 +0400 Dmitriy Kirhlarov <[EMAIL PROTECTED]> > > wrote: > > > >> Attached patch add to log information about moving messages between > >> folders. I am using this informa

Re: Cyrus IMAPd 2.3.12 Released

2008-04-23 Thread Bron Gondwana
On Wed, Apr 23, 2008 at 03:37:19PM +0400, Dmitriy Kirhlarov wrote: > If dspam miss, user can manually move message from|to "spam" folder. This > fact fixed in cyrus log file. simple script parsing log and relaunch dspam. > +syslog(LOG_ERR, "DSPAM-Hack index_copysetup(): %s -> %s, hdr %s", >

Re: Cyrus - GFS slow start and poor performace

2008-05-14 Thread Bron Gondwana
e entire recovery run. If GFS's locking can say "just do the updates and save copying back until the fsync at the end" then that should speed it up. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus - GFS slow start and poor performace

2008-05-14 Thread Bron Gondwana
y stat the file every second and copy it on any change pretty cheaply and risk losing at most the last second's changes (it doesn't change often) Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web

Re: sync_server crashing..

2008-05-17 Thread Bron Gondwana
nything happens on that folder you get the crash again. 1) figure out what folder it is 2) reconstruct it 3) profit??? Enjoy, Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: sync_server crashing..

2008-05-18 Thread Bron Gondwana
On Sun, 18 May 2008 21:44:45 + (GMT), "Andy Fiddaman" <[EMAIL PROTECTED]> said: > On Sun, 18 May 2008, Bron Gondwana wrote: > > ; You have a corrupted cache file. Various things could have caused > this, > ; it isn´t easy to know what it was. > > Th

Re: are these error messages severe? and how to fix them?

2008-05-19 Thread Bron Gondwana
r^name.seen (3 records, 7316 bytes) in 0 seconds > > I think skiplist files are always "recovered" when they are opened. So > that is not a sign of anything wrong. Yeah, all that means is that the timestamp of the skiplist file is earlier than the timestamp of the last time

Re: Cyrus POP access restritcion to users

2008-05-20 Thread Bron Gondwana
On Tue, May 20, 2008 at 08:57:14PM +0530, Ashay Chitnis wrote: > Hi, > > I wanted to know if we can restrict some users to access POP and allow some > users to access POP. I do not want to have firewall based restriction. I am > using cyrus-imapd-2.3.7-4. The same users should be allowed through

Re: Protection against POP or IMAP Denial of Service (DOS)

2008-05-20 Thread Bron Gondwana
On Wed, May 21, 2008 at 12:32:33AM +0200, Stéphane BERTHELOT wrote: > But being recently attacked many times especially on POP3 service I am > looking for some advice or maybe making a feature request for some more > protection against DOS. Gosh, I seem to be spending a lot of time pimping nginx

Re: Protection against POP or IMAP Denial of Service (DOS)

2008-05-21 Thread Bron Gondwana
o its own thread pool. It also listens on a UDP port for broadcast cache expiry events and caches user details to reduce database traffic for protocols with frequent short-lived logins. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Status of Cyrus replication

2008-05-23 Thread Bron Gondwana
On Thu, May 22, 2008 at 02:17:02PM -0500, Blake Hudson wrote: > Hey all, last time I checked replication was undergoing major overhauls > and incompatibility between minor versions of 2.3.x was pretty great. > There were also a few bugs that could potentially cause trouble down the > road. I've

Re: seen db

2008-06-10 Thread Bron Gondwana
On Tue, Jun 10, 2008 at 12:02:44PM +0200, Rudy Gevaert wrote: > Hi, > > I'm seeing this in my logs > > mail5r/syncserver[19755]: seen_db: user [EMAIL PROTECTED] opened > /mail/mail5r/var/imap/domain/u/ugent.be/user/n/nick^andries.seen > mail5r/master[12683]: process 19755 exited, signaled to dea

Re: seen db

2008-06-10 Thread Bron Gondwana
On Tue, 10 Jun 2008 15:29:01 +0200, "Rudy Gevaert" <[EMAIL PROTECTED]> said: > Bron Gondwana wrote: > > > Are you running a 64 bit kernel? > > Yes, but the system is 32bit (I run 64bit kernel + 32 emulation support) Interesting, so do we (on etch as well)

Re: seen db

2008-06-11 Thread Bron Gondwana
On Wed, Jun 11, 2008 at 10:52:31AM +0200, Rudy Gevaert wrote: > Bron Gondwana wrote: >> There you go. We've had the 64bit kernel approximately forever, but only >> just upgraded from 2.6.20 series to 2.6.25. >> >>> I can try with a 32bit kernel tomorrow. &g

Re: seen db

2008-06-11 Thread Bron Gondwana
On Wed, 11 Jun 2008 15:07:02 +0200, "Rudy Gevaert" <[EMAIL PROTECTED]> said: > Bron Gondwana wrote: > > > Try a 2.6.20 kernel, just for an interesting datapoint. We changed > > back to 2.6.20 (64 bit still) and haven't seen a corrupted seen file > &g

Re: Is skiplist dependant on byte order?

2008-06-16 Thread Bron Gondwana
and can simply be removed. Are there any others on a murder > > front end that I've missed? Where do they reside? Yeah, we nuke all those on restart. duplicate_db is the most interesting of that lot - but not a giant concern. It will cause vacation messages to be repea

Linux kernel bug AMD64 - affects skiplists

2008-06-17 Thread Bron Gondwana
I promised I'd have something to say about skiplists soon! (hi Rudy - hope you had a good time off, leaving me here to figure this out _all_by_myself_ ;) ) There's a bug in the linux kernel for amd64 builds only that breaks some skiplist files. Specifically, checkpointing a seen file with a long

Re: Linux kernel bug AMD64 - affects skiplists

2008-06-18 Thread Bron Gondwana
On Wed, 18 Jun 2008 23:04:49 +0200, "<::Teresa_II::>" <[EMAIL PROTECTED]> said: > У ср, 2008-06-18 у 14:00 +1000, Bron Gondwana > пише: > > I promised I'd have something to say about skiplists soon! > > My cyrus runs on amd64 too, so does > ht

Re: Skiplist errors on Cyrus 2.3.12

2008-07-11 Thread Bron Gondwana
On Fri, Jul 11, 2008 at 11:37:52AM +0200, Reinhard Zierke wrote: > Hi, > > Since I upgraded my Solaris 10 Postfix/Cyrus mail server to Cyrus 2.3.12, > I habe some problems when removing mailboxes. I try to delete > several users' mailboxes within one call of cyradm or in a homemade Perl > script

Re: Skiplist errors on Cyrus 2.3.12

2008-07-11 Thread Bron Gondwana
On Fri, Jul 11, 2008 at 11:37:52AM +0200, Reinhard Zierke wrote: > Hi, > > Since I upgraded my Solaris 10 Postfix/Cyrus mail server to Cyrus 2.3.12, > I habe some problems when removing mailboxes. I try to delete > several users' mailboxes within one call of cyradm or in a homemade Perl > script

Re: Auto-deletion of messages in Junk-folder after a certain time

2008-07-15 Thread Bron Gondwana
On Mon, Jul 14, 2008 at 01:54:01PM +0200, Marten Lehmann wrote: > Hello, > > we have a virtual domain configuration and I want to remove all messages > within the folder > > user/@/Junk/* Being the filty perl programmer that I am, I would just make an admin IMAP connection to the server, LIST a

Re: patches since 2.3.12-p2?

2008-07-19 Thread Bron Gondwana
On Fri, Jul 18, 2008 at 11:57:28AM +0200, Per olof Ljungmark wrote: > and > skiplist: unlock while not locked This is almost certainly a bug. I added this along with a bunch of other skiplist changes to find places where the database interface wasn't being used correctly, because it means bugs of

Re: patches since 2.3.12-p2?

2008-07-21 Thread Bron Gondwana
On Mon, Jul 21, 2008 at 12:17:14PM +0100, Ian G Batten wrote: > > On 19 Jul 08, at 1313, Bron Gondwana wrote: >> >> Unfortunately, the cyrus database interface sort of sucks from >> a consistency perspective, it's dangerous to call any function >> that needs dat

Re: help with cyr_expire please

2008-07-27 Thread Bron Gondwana
On Sun, Jul 27, 2008 at 11:18:43AM +0200, Per olof Ljungmark wrote: > It seems I do not fully understand how cyr_expire works. Some background: > > I've set up a testing server with 2.3.12-p2 with delayed expunge and > delayed delete. In cyrus.conf: > delpruneandexpunge cmd="cyr_expire -D 7 -E 3

Re: even more questions on replication and expire

2008-07-29 Thread Bron Gondwana
On Tue, Jul 29, 2008 at 12:16:01PM +0200, Rudy Gevaert wrote: > Per olof Ljungmark wrote: > > In the course of setting up delayed expunge on our production server I > > came across the following; > > > > - With delayed_expunge on the master, messages that are expunged by a > > user will be retai

Re: even more questions on replication and expire

2008-07-29 Thread Bron Gondwana
On Tue, Jul 29, 2008 at 05:09:05PM +0200, Per olof Ljungmark wrote: > Bron Gondwana wrote: >> On Tue, Jul 29, 2008 at 12:16:01PM +0200, Rudy Gevaert wrote: >>> Per olof Ljungmark wrote: >>>> In the course of setting up delayed expunge on our production >>&

Re: Cyrus vs Dovecot

2008-08-13 Thread Bron Gondwana
On Wed, Aug 13, 2008 at 01:07:34PM -0400, Wesley Craig wrote: > On 13 Aug 2008, at 10:31, kbajwa wrote: > > I think you are missing a point which is most important, i.e., what > > type of > > support Cyrus vs Dovecot offers. In my experience: > > > > Cyrus = 0 > > Dovecot= 100 > > As

Re: Deleting messages "marked for deletion" older than X days

2008-08-18 Thread Bron Gondwana
On Mon, Aug 18, 2008 at 05:09:53PM -0500, Kenneth Marshall wrote: > In the manual page, the definition of the '-X' option seems to > do what you want: > > -X expunge-days > Expunge previously deleted messages older than expunge-days > (when using the "delayed" ex

Re: Is unixhierarchysep:1 required when using virtdomain?

2008-08-27 Thread Bron Gondwana
On Tue, Aug 26, 2008 at 03:11:41PM +0200, tarjei wrote: > I read somewhere that setting unixhierarchysep to true is required when > using virtdomain, but this is not mentioned on the man page. Wow, you could have fooled me. > Is there something missing on the manpage, or have I just missunderst

Re: Is unixhierarchysep:1 required when using virtdomain?

2008-08-27 Thread Bron Gondwana
On Wed, 27 Aug 2008 14:36:58 +0200, "Rudy Gevaert" <[EMAIL PROTECTED]> said: > Bron Gondwana wrote: > > On Tue, Aug 26, 2008 at 03:11:41PM +0200, tarjei wrote: > >> I read somewhere that setting unixhierarchysep to true is required when > >> using virtd

Re: Very annoying IMAP problem (cyrus + Outlook)

2008-09-01 Thread Bron Gondwana
On Mon, Sep 01, 2008 at 03:37:19PM -0400, Wesley Craig wrote: > On 01 Sep 2008, at 14:50, Denis BUCHER wrote: > > What should I do next to solve my problem ? > > There are actually a couple of places cyrus might give the fatal > error "word too long". The prot routines should be recording the

Replication errors: missing subscription

2008-09-02 Thread Bron Gondwana
Our Cyrus 2.3.12 + patches replication system has been running very reliably for months - to the point where the only issues our checkreplication script tends to find are either: a) cases where someone has reconstructed and not run quota -f afterwards, causing quota mismatches. (this is mostly

Re: Skiplist errors on Cyrus 2.3.12

2008-09-02 Thread Bron Gondwana
On Fri, Jul 11, 2008 at 11:37:52AM +0200, Reinhard Zierke wrote: > Jul 11 10:32:41 mailhost.informatik.uni-hamburg.de cyradm[13944]: [ID 637875 > local6.error] Fatal error: Internal error: assertion failed: > cyrusdb_skiplist.c: 622: db->lock_status == UNLOCKED > Jul 11 10:32:41 mailhost.informat

  1   2   3   4   5   6   7   8   9   10   >