Re: Question about reconstruct

2010-01-12 Thread Bron Gondwana
On Tue, Jan 12, 2010 at 08:57:28AM -0800, wcoo...@nakedape.cc wrote: > > On Mon, 2010-01-04 at 16:24 -0200, Sergio Belkin wrote: > > >>From the Cyrus chapter of WMOGAG: > > > > The most important options for reconstruct are -r and -k. The > > -r > > option causes reconstruct to reindex the specif

Re: Future Ideas wiki page

2010-01-13 Thread Bron Gondwana
On Wed, 13 Jan 2010 16:26 -0800, "David Lang" wrote: > On Sat, 9 Jan 2010, Bron Gondwana wrote: > > > On Sat, 09 Jan 2010 15:10 +0100, "Alexey Melnikov" > > wrote: > >> Bron Gondwana wrote: > >>> While we're at it, I&#

Re: Future Ideas wiki page

2010-01-13 Thread Bron Gondwana
essage > numbers, this is being done in a backwards compatible manner so that the > client > can use either one, and a server can support both. The problem is you keep paying a higher and higher complexity cost at the server end. Once you start talking not having a folder selected, tha

Re: Future Ideas wiki page

2010-01-13 Thread Bron Gondwana
On Wed, Jan 13, 2010 at 04:02:43PM -0800, Wil Cooley wrote: > Bron Gondwana wrote: > > > Anyway, I'd love feedback on any or all of it, and if there > > are other things that you feel are really important for the > > future viability of Cyrus I'd love to hear abo

Re: Information about your Cyrus installation

2010-01-27 Thread Bron Gondwana
On Wed, Jan 27, 2010 at 06:53:47PM -0500, Dave McMurtrie wrote: > Hello Cyrus users, > > First, please allow me to apologize for this slightly off-topic message. > I'll ask that all replies be sent directly to me so the list doesn't > become too cluttered. > > I'm scheduled to do a presentati

Re: Information about your Cyrus installation

2010-02-02 Thread Bron Gondwana
On Tue, Feb 02, 2010 at 02:13:45PM +0200, Jukka Huhta wrote: > Sorry to answer off-list, but... Taking it back to the list, because it's not secret - I'm pretty sure I've posted most of it in bits and pieces before... > On Thu, 28 Jan 2010, Bron Gondwana wrote: > > &

Re: Reconstruct removes @domain from mboxlist

2010-02-05 Thread Bron Gondwana
On Fri, Feb 05, 2010 at 02:33:13PM -0600, Dan White wrote: > On 04/02/10 12:46 +0530, Ramprasad wrote: > >Hi, > > > > I have a cyrus-imapd 2.3.7 on RHEL 5 with multiple domains > > > >When I reconstruct a user mailbox on the primary domain it works fine > >, but when any secondary domain mailb

Re: Sieve and encoded Headers

2010-02-07 Thread Bron Gondwana
On Mon, Feb 08, 2010 at 07:53:21AM +0100, Garry wrote: > Hi, > > after wondering for a while why occasionally my sieve script rules > wouldn't work, I just found the reason (I guess) - Sieve doesn't > (correctly?) decode utf encoded header lines which e.g. are in a format > like this: > > Subject

Re: Sieve and encoded Headers

2010-02-08 Thread Bron Gondwana
On Mon, Feb 08, 2010 at 01:03:30PM +0100, Garry wrote: > On 08.02.2010 08:28, Bron Gondwana wrote: > > I've CC'd Ken on this - I wonder if it's worth going back and doing a > > "minimal still compatible" set of patches that fixes charset encoding in > &g

Re: Sieve, disable duplicate suppression.

2010-02-09 Thread Bron Gondwana
On Tue, Feb 09, 2010 at 11:22:01AM +0100, Carles Xavier Munyoz Baldó wrote: > Hello, > I have disabled the duplicatesuppression option in the imapd.conf file of my > Cyrus IMAP server. Nevertheless I have seen in the logs that the > duplicatesuppression mechanism is still on for users with a siev

Re: understanding fields in cyrus.header file

2010-02-09 Thread Bron Gondwana
On Tue, Feb 09, 2010 at 06:21:21PM +, Gavin McCullagh wrote: > Hi, > > I'm looking at some cyrus.header files while migrating from an old to a new > cyrus-based mail server. I think I understand it in general, except for > the second last line. A couple of examples follow: > > -

Re: understanding fields in cyrus.header file

2010-02-09 Thread Bron Gondwana
On Wed, Feb 10, 2010 at 12:00:04AM +, Gavin McCullagh wrote: > Hi, > > On Wed, 10 Feb 2010, Bron Gondwana wrote: > > > > > > Junk NonJunk $Forwarded Old > > > > Check out mailbox_read_header and mailbox_read_header_acl from > > imap/mailbox.c i

Re: cyrus and 500k to >1M mails per inbox

2010-02-11 Thread Bron Gondwana
On Thu, Feb 11, 2010 at 04:39:25PM +0100, Eric Luyten wrote: > On Thu, February 11, 2010 4:23 pm, Carsten Hoeger wrote: > > > > > we have a customer running cyrus imap on RHEL5 cluster with a few thousand > > mailboxes. Every single mail is sent to a second host acting as a read-only > > archive (

Re: cyrus and 500k to >1M mails per inbox

2010-02-11 Thread Bron Gondwana
On Fri, Feb 12, 2010 at 07:37:20AM +1100, Rob Mueller wrote: > > >>> It's quite likely, that these mailboxes will grow to 50 or > >>even > more then > >>> 1M mails per mailbox. > >>> > >>> Does anybody have experience with such big mailboxes? > >> > >>Is the I/O cost of message adding relativ

Re: Sieve and encoded Headers

2010-02-11 Thread Bron Gondwana
On Mon, Feb 08, 2010 at 11:29:22AM -0500, Ken Murchison wrote: > > > Bron Gondwana wrote: > >On Mon, Feb 08, 2010 at 07:53:21AM +0100, Garry wrote: > >>Hi, > >> > >>after wondering for a while why occasionally my sieve script rules > >>would

Re: Sieve and encoded Headers

2010-02-12 Thread Bron Gondwana
On Fri, Feb 12, 2010 at 10:18:02AM -0500, Ken Murchison wrote: > Bron Gondwana wrote: > >On Mon, Feb 08, 2010 at 11:29:22AM -0500, Ken Murchison wrote: > >> > >>Bron Gondwana wrote: > >>>On Mon, Feb 08, 2010 at 07:53:21AM +0100, Garry wrote: > >>&g

Re: Setting TCP keepalive for Cyrus daemons

2010-02-12 Thread Bron Gondwana
On Fri, Feb 12, 2010 at 09:45:02AM -0600, Gary Mills wrote: > I've been noticing idle pop3d processes on our Cyrus front end server > for some time. These should be transient. One that was several days > old had an established TCP connection to a wireless client that had > disappeared. Presumabl

Re: Setting TCP keepalive for Cyrus daemons

2010-02-13 Thread Bron Gondwana
On Fri, Feb 12, 2010 at 09:45:02AM -0600, Gary Mills wrote: > I'm willing to add a `keepalive' option to Cyrus master along with the > setsockopt() system call to enable that setting. This option could be > added to the cyrus.conf file for any services that could benefit from > it. Would this be a

Re: Setting TCP keepalive for Cyrus daemons

2010-02-13 Thread Bron Gondwana
On Sat, Feb 13, 2010 at 10:00:52AM -0600, Gary Mills wrote: > On Sat, Feb 13, 2010 at 09:09:05PM +1100, Bron Gondwana wrote: > > On Fri, Feb 12, 2010 at 09:45:02AM -0600, Gary Mills wrote: > > > I'm willing to add a `keepalive' option to Cyrus master along with the &g

Re: Setting TCP keepalive for Cyrus daemons

2010-02-13 Thread Bron Gondwana
On Sun, Feb 14, 2010 at 08:38:34AM +1100, Bron Gondwana wrote: > > One thing to watch is that only SO_KEEPALIVE is standard. The other > > three symbols: TCP_KEEPCNT, TCP_KEEPIDLE, and TCP_KEEPINTVL only exist > > in some operating systems. They have global settings but don

Re: ability to disable shared namespace?

2010-02-13 Thread Bron Gondwana
On Sat, Feb 13, 2010 at 08:50:04PM -0500, Wesley Craig wrote: > Isn't this what "foolstupidclients" does? I think Blackberry might > meet the criteria... Probably! That said, Mozilla Thunderbird checks the namespaces and gets: "INBOX", "shared", "" - and proceeds to list all three of them, he

Re: Setting TCP keepalive for Cyrus daemons

2010-02-13 Thread Bron Gondwana
On Sat, Feb 13, 2010 at 08:58:50PM -0500, Wesley Craig wrote: > On 13 Feb 2010, at 09:50, Brian Awood wrote: > > I've had a patch against lmptd in bugzilla for a while; > > https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=3158 > > I think the code probably just needs to be audited, to find the > >

Re: Backup strategy for large mailbox stores

2010-02-15 Thread Bron Gondwana
On Mon, Feb 15, 2010 at 10:28:13AM +, Gavin McCullagh wrote: > Hi, > > I'm a relative newbie with cyrus, but I'm interested in this discussion... Hehe - you should read through the mailing list archives for how FastMail does backups for a really complex but _FAST_ solution :) > > Things hav

Re: Any interest to implement RFC4978 (IMAP COMPRESS)?

2010-02-19 Thread Bron Gondwana
AP COMPRESS)? > > X-Spam-Score: 0.0 (/) > > > > >From the 2.3.15 Changelog: > > > > * Added support for MUPDATE COMPRESS and IMAP COMPRESS commands which > > help speed up bulk data commands over slow links. > > > > It actually already _is

Re: Metapartitions

2010-03-17 Thread Bron Gondwana
On Wed, Mar 17, 2010 at 09:17:49PM -0300, Diego Ventrice wrote: > Thanks Mark, > > Thats what I guessed. I suppose these files make use of the .seen and > .sub files under also, right ? .seen and .sub files are always in your "configdir" - where the mailboxes.db and related things are. It's act

Re: Nginx configuration for imap

2010-03-18 Thread Bron Gondwana
On Thu, Mar 18, 2010 at 04:19:37PM +0530, ram wrote: > One more issue with nginx 0.8.34 is that when auth-fails on the real > server the nginx returns "BAD: internal server error" > The email clients are not able to interpret this error. > > Can I configure nginx to pass on the actual message f

Re: Nginx configuration for imap

2010-03-22 Thread Bron Gondwana
On Mon, Mar 22, 2010 at 01:52:55PM +, Naresh V wrote: > Bron Gondwana fastmail.fm> writes: > > [...] > > > > Why does the auth fail on the backend server? It never should. If it does > > that means you've screwed up pretty badly. You can give the failur

Re: Not possible to replicate from 2.3.7 to 2.3.16?

2010-03-27 Thread Bron Gondwana
On Sat, Mar 27, 2010 at 12:19:06AM -0500, Jason L Tibbitts III wrote: > So, is it expected to be generally possible to replicate from 2.3.7 to > 2.3.16? If so, would anyone have any idea what I might be doing wrong > here? If it's not possible, would it be reasonable to migrate initially > using

Re: local mailbox %s wrong in mailbox list in cyrus 2.3.15

2010-03-27 Thread Bron Gondwana
On Sat, Mar 27, 2010 at 05:45:13PM -0500, Dan White wrote: > On 28/03/10 11:29 +1300, karen turner wrote: > >Has anyone else had this message in their cyrus logs? > > > >Mar 23 14:56:41 zysv01 mupdate[19515]: local mailbox user.zykdt0 wrong in > >mailbox list > > > >I have identified the section o

Re: Not possible to replicate from 2.3.7 to 2.3.16?

2010-03-29 Thread Bron Gondwana
On Sun, Mar 28, 2010 at 08:53:12PM -0400, Wesley Craig wrote: > On 27 Mar 2010, at 20:55, Jason L Tibbitts III wrote: > > I had guessed, though perhaps I had hoped that something would simply > > tell me that instead of giving odd errors that made me think that I > > had > > misconfigured somethi

Re: Building an interface to undelete for users

2010-03-29 Thread Bron Gondwana
On Mon, Mar 29, 2010 at 11:28:50AM +0100, David Mayo wrote: > > We have recently upgraded to Cyrus 2.3 and are making full use of the > "delayed delete" feature, and we are considering writing an interface to > allow users to undelete their own messages and mailboxes. > > Before I start work on

Re: Building an interface to unexpunge for users

2010-03-29 Thread Bron Gondwana
On Mon, Mar 29, 2010 at 12:12:42PM -0400, Matt Selsky wrote: > On Mar 29, 2010, at 11:22 AM, David Mayo wrote: > > > My biggest concern is the interface will be relying on the info from > > "unexpunge" which removes all the punctuation and spaces from the > > fields[1] which will look naff to th

Re: Nested "INBOX" folders - hard to delete

2010-03-29 Thread Bron Gondwana
On Mon, Mar 29, 2010 at 10:25:09PM +0300, Jukka Huhta wrote: > On Mon, 29 Mar 2010, Brian Awood wrote: > > > What version of cyrus are you running? If it's a version 2.3 with > > delayed delete enabled, you are likely running into a bug in cyrus. > > The newest, 2.3.16. This certainly feels lik

Re: Building an interface to unexpunge for users

2010-03-29 Thread Bron Gondwana
On Mon, Mar 29, 2010 at 09:17:08PM -0400, Wesley Craig wrote: > On 29 Mar 2010, at 18:18, Bron Gondwana wrote: > >>https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=3008 > > > >Yeah, that should be the default. Search form is not for presentation > >to users! > &g

Re: Get cyrus-imap folder size without "du" tool

2010-04-02 Thread Bron Gondwana
On Thu, Apr 01, 2010 at 01:54:47PM -0700, Andrew Morgan wrote: > On Thu, 1 Apr 2010, Adam Tauno Williams wrote: > > > On Thu, 2010-04-01 at 19:13 +0200, David Touzeau wrote: > >> Joe Vieira wrote: > >>> if they are all on one partition and nothing else is on that you could > >>> just use df >

Re: Get cyrus-imap folder size without "du" tool

2010-04-02 Thread Bron Gondwana
On Fri, Apr 02, 2010 at 01:40:38PM -0400, Wesley Craig wrote: > On 02 Apr 2010, at 08:59, Bron Gondwana wrote: > >Anyway, the quota system works fine. Just give each user a quota > >bigger > >than your disk and use it for the used value! > > It's a shame that the

FastMail, Opera, Cyrus work

2010-04-30 Thread Bron Gondwana
Hi Everyone, Just thought I'd point this out: http://blog.fastmail.fm/2010/04/30/fastmail-fm-has-been-acquired-by-opera-software/ http://www.opera.com/press/releases/2010/04/30/ And assure you that nothing's going to change with my work on Cyrus! In fact, a lot of the cross-datacentre and optim

Re: cvt_cyrusdb flat to skiplist fails

2010-05-05 Thread Bron Gondwana
On Wed, May 05, 2010 at 09:15:10AM +, Thorsten Glaser wrote: > Bernhard Reiter intevation.de> writes: > > > annotations.db is in the skiplist format. > > Now cvt_cyrusdb seems to fail a simple back and forth conversion test > > to flat and back. How can that be? > > > > cvt_cyrusdb /tmp/anno

Re: cvt_cyrusdb flat to skiplist fails

2010-05-06 Thread Bron Gondwana
On Thu, May 06, 2010 at 12:33:17PM +0200, Thorsten Glaser wrote: > On Thu, 6 May 2010, Bron Gondwana wrote: > > > I use cyr_dbtool to edit skiplists - you can dump just some lines > > and then restore just those lines. > > Thanks, that won’t help though… cyr_d

Re: bootstrapping replication

2010-05-10 Thread Bron Gondwana
On Mon, May 10, 2010 at 08:46:50PM +0200, Eric Doutreleau wrote: > thanks for the advice > > gfor the bail out i hadn't the same number of partition in the master > and in the replica. > > then i have another question > i have 13 partitions on the master server. > can i have only one on the repl

Re: bootstrapping replication

2010-05-10 Thread Bron Gondwana
On Mon, May 10, 2010 at 05:43:57PM -0400, Wesley Craig wrote: > On 10 May 2010, at 14:46, Eric Doutreleau wrote: > > i have 13 partitions on the master server. > > can i have only one on the replica or should i have the same number > > of partition? > > cyrus doesn't actually know about "partiti

Re: Cyrus active-active cluster checklist

2010-05-12 Thread Bron Gondwana
On Wed, May 12, 2010 at 02:17:18PM -0300, Andre Nathan wrote: > * Change the append_newstage() function in imap/append.c to add some > host information to the "stage." file names, to avoid PID clashes > between the two cluster nodes; I've got no problem with adding this upstream by the way.

Re: cyrus replication and RENAME problem

2010-05-31 Thread Bron Gondwana
On Mon, May 31, 2010 at 12:58:57PM +0200, Rudy Gevaert wrote: > > Renaming forth and back is a way, but not a really good solution to this > > problem. > > Hi Mark, > > Have you been able to fix this? It seems a bug to me. Sorry, yes - it's a bug. It will be fixed in 2.4 (as in, I've already c

Re: cyrus replication and RENAME problem

2010-06-01 Thread Bron Gondwana
On Tue, Jun 01, 2010 at 11:14:02AM +0200, Rudy Gevaert wrote: > On 05/31/2010 03:31 PM, Bron Gondwana wrote: > > On Mon, May 31, 2010 at 12:58:57PM +0200, Rudy Gevaert wrote: > >>> Renaming forth and back is a way, but not a really good solution to this > >&g

Re: cyrus replication and RENAME problem

2010-06-01 Thread Bron Gondwana
On Tue, Jun 01, 2010 at 11:46:38AM +0200, Sebastian Hagedorn wrote: > --On 1. Juni 2010 19:31:54 +1000 Bron Gondwana wrote: > > >Is it common to rename mailboxes across partitions once they're created? > > Speaking for myself: very much so! It's how we balance disk

Re: Live backup

2010-06-16 Thread Bron Gondwana
On Wed, Jun 16, 2010 at 11:45:10AM +0200, Roland Baum wrote: > For non-HA situations, you can do a 2-stage rsync-backup once a day: > > 1 ) copy all cyrus-folders (/var/spool/cyrus, /var/lib/cyrus etc) via rsync > to > a backup-folder > 2 a) shutdown cyrus > 2 b) rsync the same folders to comple

Re: Live backup

2010-06-16 Thread Bron Gondwana
On Wed, Jun 16, 2010 at 05:19:25PM +0300, Elver Loho wrote: > Replication looks to be the solution. Surprisingly I hadn't discovered > it on my own. Many thanks to everyone for pointing it out! > > However, while setting it up, I noticed a really weird thing. When > authentication fails on the mas

Re: Live backup

2010-06-16 Thread Bron Gondwana
On Wed, Jun 16, 2010 at 06:27:34PM +0300, Elver Loho wrote: > Hey Bron, > > I'm running Cyrus on Fedora 12, with the version number being > 2.3.16-3.fc12 according to yum. That's about as modern as it gets for now :) > By the way, how can I verify that replication is working and is up-to-date?

Re: Blacklisting destination addresses

2010-06-19 Thread Bron Gondwana
On Sat, Jun 19, 2010 at 10:35:46AM +0200, Luka Mrovlje wrote: > Hi, > > Please provide me some pointers on how to configure cyrus so that it will > reject sending any e-mails to foreign destination (example: > name.surn...@some-other-comany.com) > This is very important to me, because I do not wan

Re: very long cyr_expire at startup and no mail delivery

2010-06-24 Thread Bron Gondwana
On Thu, Jun 24, 2010 at 11:38:39PM +0200, Marcus wrote: > Hi, > > because of a kernel update I had to restart my server. After the restart > cyrmaster was running, but I couldn't connect to imap or pop3 port and > sendmail couldn't communicate via socket with cyrus. A "ps ax" showed a > running "c

Re: very long cyr_expire at startup and no mail delivery

2010-06-24 Thread Bron Gondwana
On Thu, Jun 24, 2010 at 08:14:02PM -0300, Reinaldo de Carvalho wrote: > On Thu, Jun 24, 2010 at 6:38 PM, Marcus wrote: > > Hi, > > > > because of a kernel update I had to restart my server. After the restart > > cyrmaster was running, but I couldn't connect to imap or pop3 port and > > sendmail co

Re: doing replication from two machine to one machine

2006-05-04 Thread Bron Gondwana
On Thu, May 04, 2006 at 02:35:55PM +0200, Rudy Gevaert wrote: > For now we are not going to use that in a murder. At [ > http://users.ugent.be/~rgevaert/HA-IMAP-2.png ] you can find a picture > of the setup we are aiming at. Looks rather similar to what we're doing at FastMail.FM. > Each user

Replication and Virtual Domains

2006-05-14 Thread Bron Gondwana
o access inbox for [EMAIL PROTECTED] May 12 01:54:42 imap6 syncserver[16522]: Unlocked Let me know if you need the entire configs (minus passwords, natch) Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Replication question

2006-05-17 Thread Bron Gondwana
On Wed, May 17, 2006 at 03:40:17PM -0400, Patrick Radtke wrote: > when we switch we comment out the sync_server line on the replica to > make sure it won't listen. We have a "as master" config and an "as slave" config - and switch them via symlinks. Similar basic concept though - or at least it

Some imapd processes getting permission denied setting flags

2006-05-18 Thread Bron Gondwana
This one is really strange. I've just recently upgraded one of our old Redhat 7.3 servers from Cyrus 2.2.something CVS to Cyrus 2.3.3. We're getting lots of users unable to mark messages read or deleted. Now, our code works by adding the 'selected' flag to whatever messages it wishes to act upon

Re: cyrus 2.3.3 change + solved: permission denied setting flags

2006-05-18 Thread Bron Gondwana
On Fri, May 19, 2006 at 02:40:11AM +1000, Robert Mueller wrote: > [...] saying that it's in [READ-WRITE] mode on an "examine" > while previously it used to say [READ-ONLY]. Is that an expected behaviour > change, or a bug? And if it's expected, then why was it saying "Permission denied" when our

Re: Removing Shared Folders

2006-05-19 Thread Bron Gondwana
On Fri, May 19, 2006 at 04:19:13PM -0400, David Korpiewski wrote: > Hi all, > While shared folders might be a cool concept, I don't really want > my users randomly creating them on the mail server. Is there any way to > pernamentally disable them? I didn't see an option in the man pages for

Cyrus Patches used at FastMail.FM

2006-05-22 Thread Bron Gondwana
I've finally split out all the patches that we use here into individual items. I know some people were interested in the "don't allow users to set the anyone ACL" patch as well. http://cyrus.brong.fastmail.fm/ Ken - I'd love to work with you on getting as many as possible of these into upstream,

Re: Some part of bug from 2.3.4 still in 2.3.5

2006-05-25 Thread Bron Gondwana
snoatt > selected medeleted hasatt \*)] > * 2 EXISTS > * 1 RECENT > * OK [UIDVALIDITY 1148525506] > * OK [UIDNEXT 186] > * OK [NOMODSEQ] Sorry, modsequences have not been enabled on this mailbox > . OK [READ-WRITE] Completed > > . uid search 1:* > * SEARCH 84 185

Re: Some part of bug from 2.3.4 still in 2.3.5

2006-05-25 Thread Bron Gondwana
DSTORE universe as well. It's certainly fine for those of us where modseq will always be 1. Bron. On Thu, 25 May 2006 17:16:17 +1000, "Bron Gondwana" <[EMAIL PROTECTED]> said: > I suspect what you're looking for is in the patch attached > to this message. > >

Re: Cyrus IMAPd 2.3.4 Released

2006-05-25 Thread Bron Gondwana
past couple of days due to incomplete features meaning corrupt indexes in a "release". Bron ( who shouldn't have blindly gone ahead and rolled out the latest code either, even just to one server... ) -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.

Re: Some part of bug from 2.3.4 still in 2.3.5

2006-05-25 Thread Bron Gondwana
ly fine for those of us where modseq will always be 1. Bron. On Thu, 25 May 2006 17:16:17 +1000, "Bron Gondwana" <[EMAIL PROTECTED]> said: > I suspect what you're looking for is in the patch attached > to this message. > > You forgot (entirely) to put modseq code i

Re: Cyrus IMAPd 2.3.4 Released

2006-05-25 Thread Bron Gondwana
dogfood. Should help us see if anything else is strange. (now I just have to figure things out so that when we move users we retain the UIDVALIDITY so my entire offlineimap store doesn't get stale next time) Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.w

Re: Some part of bug from 2.3.4 still in 2.3.5

2006-05-25 Thread Bron Gondwana
7;t speak for CONDSTORE users, but it looks to me like it does the right thing in that case too - because modseq should always have a non-zero value, and if it doesn't then the value of highestmodseq is probably 1 anyway, so 1 is still a better answer than 0. Release early, release ofte

Re: Some part of bug from 2.3.4 still in 2.3.5

2006-05-25 Thread Bron Gondwana
e we generally lock users from logging in when we're running reconstructs on them anyway. Bron. -- Bron Gondwana [EMAIL PROTECTED] diff -ur --new-file cyrus-imapd-2.3.6.orig/imap/mailbox.c cyrus-imapd-2.3.6/imap/mailbox.c --- cyrus-imapd-2.3.6.orig/imap/mailbox.c 2006-05-23 09:09:37.00

Re: Cyrus Patches used at FastMail.FM

2006-05-27 Thread Bron Gondwana
aven't LOST information. That last point is particularly important. By rejecting the message out of hand, you are preserving your pristine innards but lose interoperability with reality. By silently replacing unknown 8bit data with an 'X' you are throwing away information and ly

Re: Replicate to more than one replica?

2006-06-08 Thread Bron Gondwana
On Wed, Jun 07, 2006 at 11:52:16AM +1200, Roland Pope wrote: > Bron Gondwana wrote: > >Unless sync_server is logging all its actions to sync_client then this is > >a bit pointless, Replica2 will never have anything automatically sent to > >it. A quick grep of my 2.3.6 sour

Replication is broken with modseq issue in 2.3.6

2006-07-05 Thread Bron Gondwana
If I sound a little bitter, it's because I was up until 5:30am the other night after a hardware failure left us with corrupted filesystems on our master server, and fetching old messages from the replica returned blank responses. We eventually discovered that reconstruct could fix it, and 36(!!) h

Re: Replication is broken with modseq issue in 2.3.6

2006-07-06 Thread Bron Gondwana
om the database, so they were easy to fix. We'll be changing to do the right thing because relying on undocumented behaviour is a stupid long-term strategy. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Replication is broken with modseq issue in 2.3.6

2006-07-06 Thread Bron Gondwana
On Thu, 06 Jul 2006 17:17:39 -0400, "David S. Madole" <[EMAIL PROTECTED]> said: > On 05 Jul 2006, at 02:54, Bron Gondwana wrote: > > >If you're running replication on any post 2.3.3 cyrus, your replica > >contains indexes with '0' as the modseq val

Re: [POLL] Cyrus 2.3.x and CONDSTORE

2006-07-08 Thread Bron Gondwana
On Fri, Jul 07, 2006 at 10:54:13AM -0400, Ken Murchison wrote: > The reason I ask is that I want to push out a 2.3.7 release ASAP which > contains a number of important bugfixes, but I've realized that the > replication protocol doesn't have any support for the metadata that is > used by CONDSTO

Re: Performance and cheap storage

2006-08-05 Thread Bron Gondwana
On Fri, Aug 04, 2006 at 03:26:39PM +1000, Robert Mueller wrote: > Anyway the good news: > Before: 2 frontend servers with 7000+ connections (eg 14,000+ total) using > 6G of RAM with a load on each of about 2 > After: 1 frontend server with 14,000+ connections, less than 1G of RAM > usage, load of

Re: Performance and cheap storage

2006-08-05 Thread Bron Gondwana
On Sat, 5 Aug 2006 16:02:44 -0700 (PDT), "David Lang" <[EMAIL PROTECTED]> said: > On Sat, 5 Aug 2006, Bron Gondwana wrote: > > > Your frontend only can make connections out using any port it likes, but > > there are only 65k of them, and at any one time, a fra

Re: [Cyrus-CVS] src/cyrus by jeaton

2006-08-06 Thread Bron Gondwana
On Wed, Aug 02, 2006 at 12:12:05AM -0400, [EMAIL PROTECTED] wrote: > Update of /afs/andrew.cmu.edu/system/cvs/src/cyrus > In directory > mail5.andrew.cmu.edu:/afs/andrew.cmu.edu/system/src/local/cyrus/111 > > Modified Files: > Tag: cyrus-imapd-2_3 > SMakefile > Log Message: > cmu cha

Re: Performance and cheap storage

2006-08-07 Thread Bron Gondwana
On Mon, Aug 07, 2006 at 05:59:33PM +0200, Phil Pennock wrote: > On 2006-08-07 at 12:15 -0300, Henrique de Moraes Holschuh wrote: > > On Mon, 07 Aug 2006, Kjetil Torgrim Homme wrote: > > > I think David is missing the issue: it's the proxied connection which is > > > problematic, not the connection

Re: Performance and cheap storage

2006-08-07 Thread Bron Gondwana
On Mon, Aug 07, 2006 at 10:47:10PM +0200, Phil Pennock wrote: > On 2006-08-07 at 19:23 +0200, Hack Kampbjorn wrote: > > Phil Pennock wrote: > > >The "easy" fix is theoretically to configure up extra private addresses > > >as aliases on the backend, and distribute the load over all of them. > > >Thi

Re: [Cyrus-CVS] src/cyrus by jeaton

2006-08-09 Thread Bron Gondwana
On Wed, 9 Aug 2006 21:01:17 -0400, "Jeffrey T Eaton" <[EMAIL PROTECTED]> said: > > On Aug 6, 2006, at 11:31 PM, Bron Gondwana wrote: > > > On Wed, Aug 02, 2006 at 12:12:05AM -0400, [EMAIL PROTECTED] wrote: > >> Update of /afs/andrew.cmu.edu/syst

Re: 2.3.7 replica with multiple partitions?

2006-08-16 Thread Bron Gondwana
urse. I wouldn't dream of doing it without a whole stack of templated auto-config generation goodness. > Replicas are Sun T2000, master servers are HP DL380 G4, storage is EMC > CX series. Each replica host will have two Cyrus instances (slave to 2 > masters). Interesting, wh

Re: OT: Mulberry availiable again and for free

2006-08-21 Thread Bron Gondwana
cyrus > Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Multiple username/passwords pointing to the same mailbox .. possible?

2006-08-21 Thread Bron Gondwana
sily. It already rewrites the username to connect to the backend so we can gracefully handle switching to [EMAIL PROTECTED] logins for machines as we domain split them. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

sync_client bails out after 3 MAILBOXES need upgrading to USER in one run

2006-08-26 Thread Bron Gondwana
has been any progress then that's good enough for me - start over with the whole list of unmarked folders again without incrementing the failure count. It can't stave (always one more folder marked per loop) but it sure could get slow if every folder was a subfolder for a user that

Another sync-client issue

2006-08-26 Thread Bron Gondwana
just above and is an unreachable path. Bron. -- Bron Gondwana [EMAIL PROTECTED] cyrus-perm-check-uniqueid.diff.proposed Description: Binary data Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.ed

Re: sync_client stalls the rest of cyrus while 'no route to host'

2006-08-26 Thread Bron Gondwana
x27;m seriously considering writing a replacement to sync_client that does a bunch of different things including multiple replicas, maintaining log files, etc. All of this drops out pretty easily from a pattern which produces a single log file per day and calls the sync_client fork children with a byt

Re: sync_client stalls the rest of cyrus while 'no route to host'

2006-08-26 Thread Bron Gondwana
On Sat, Aug 26, 2006 at 08:32:24PM -0400, Wesley Craig wrote: > On 26 Aug 2006, at 16:22, Paul Dekkers wrote: > >I don't know if this is a known issue: as soon as I enable replication > >and the sync_client gets a "No route to host" from the replica, the > >rest > >of the cyrus startup seems to s

Re: sync_client stalls the rest of cyrus while 'no route to host'

2006-08-28 Thread Bron Gondwana
On Mon, Aug 28, 2006 at 02:19:31PM -0400, Wesley Craig wrote: > On 26 Aug 2006, at 21:42, Bron Gondwana wrote: > >Though it is dying less as we discover bugs and patch them. See > >my post last night (au time) about the "three MAILBOX -> USER > >promotions and you

Re: failover scenario's for replication

2006-08-28 Thread Bron Gondwana
On Mon, Aug 28, 2006 at 02:23:22PM -0400, Wesley Craig wrote: > On 26 Aug 2006, at 16:09, Paul Dekkers wrote: > >Right now, it looks tricky to me to enable replication after failover, > >or the replicated machine itself if you're not sure that the > >replica is > >identical and the sync-processes

Re: sync_client stalls the rest of cyrus while 'no route to host'

2006-08-29 Thread Bron Gondwana
On Tue, 29 Aug 2006 09:51:49 +0100 (BST), "David Carter" <[EMAIL PROTECTED]> said: > On Sun, 27 Aug 2006, Bron Gondwana wrote: > > > To tell you the truth, I'm seriously considering writing a replacement to > > sync_client that does a bunch of different

Re: Problems with a crashed BDB

2006-08-30 Thread Bron Gondwana
Luckily for you, you haven't lost any actual emails, just meta data. The emails are still on the disk as individual files. Do you know which specific DB file is corrupted? You can probably nuke deliver.db at start up (we do). Worst case, just move your mailboxes.db somewhere else and run reconst

sync_server "memory leak" with giant new mailbox first sync

2006-09-10 Thread Bron Gondwana
or each run to fail thanks to the insanely high IO load on that drive unit, so debugging was more of a pain than you'd hope. I hope something inspired by this can be merged upstream to solve the "spam sync_server until it falls over" failure mode. Bron. -- Bron Gondwana [EM

Re: sync_server "memory leak" with giant new mailbox first sync

2006-09-12 Thread Bron Gondwana
lica will be in an intermediate state with UIDNEXT set quite high but a bunch of messages not there yet. On the flip side, if it keeps failing then the folder on the replica side contains no messages at all, which is somewhat worse in a failure situation where you actually need to cu

Re: sync_client bails out after 3 MAILBOXES need upgrading to USER in one run

2006-09-13 Thread Bron Gondwana
ust about everything than could possibly go wrong means days of downtime, and users _hate_ that) Hrm... first edge case that sounds interesting, deleting a folder that has subfolders without deleting the subfolders as well... My urgent todo list is down to about 10 items now, and I'm sure a

Re: Restrict cyrus admins to certain hosts

2006-09-18 Thread Bron Gondwana
de our security perimeter. Something similar with a proxy may be an option. Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: sync_client stalls the rest of cyrus while 'no route to host'

2006-09-27 Thread Bron Gondwana
On Sat, Aug 26, 2006 at 10:22:15PM +0200, Paul Dekkers wrote: > Hi, > > I don't know if this is a known issue: as soon as I enable replication > and the sync_client gets a "No route to host" from the replica, the rest > of the cyrus startup seems to stall: no imap, no lmtp... just because a > repl

Re: replication, how to see if it 'up to date'

2006-09-28 Thread Bron Gondwana
delay, so generally it will get the same value on one of the retries unless the folder is seeing a lot of traffic. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-16 Thread Bron Gondwana
On Thu, Nov 16, 2006 at 07:24:32PM +0300, Igor Zhbanov wrote: > The main problem is to build a shared storage that can survive server > crashes, where mail will be stored. I have found that MySQL-cluster is > reliable and fast. My god. You are aware that MySQL-cluster only supports in-memory dat

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Bron Gondwana
On Fri, Nov 17, 2006 at 11:54:39AM +1000, Sarah Walters wrote: > Why don't you look at throwing two beefy boxes at this problem in a > hot-spare > configuration? Have a single large box managing the mail and a heartbeat > so > that if one goes down the other immediately takes over its IP and just >

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Bron Gondwana
On Fri, Nov 17, 2006 at 03:31:52AM +0300, Igor Zhbanov wrote: > Yes, I need the cluster exactly. Have I lots of domains, I could store > mailboxes of each domain on separate server. But I have only one big > domain. So, I need to spread mailboxes on one domain across several > servers. And than I n

[BUG] Replication synchronisation fails when message size on disk doesn't match index data

2006-11-25 Thread Bron Gondwana
eplication fail since we have monitoring scripts that will scream at us when that happens and we'll get in and fix things pronto. Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED] diff -ur --new-file cyrus-imapd-cvs.orig/imap/sync_client.c cyrus-imapd-cvs/imap/sync_client.c --- cyru

Re: Replication and virtual domains revisited

2006-11-27 Thread Bron Gondwana
On Mon, Nov 27, 2006 at 04:21:56PM +0100, Rudy Gevaert wrote: > Janne Peltonen wrote: > >Hi! > > > >I was wondering about replication and virtual domains. Last May, it > >wasn't supported yet: > > > > http://lists.andrew.cmu.edu/pipermail/info-cyrus/2006-May/021943.html > > > >-- the 2.3.7 from las

Re: Bug with rename INBOX -> INBOX.blah and replication

2006-12-04 Thread Bron Gondwana
h the rename, so that seen information is retained for all other users. Hmm... Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

<    1   2   3   4   5   6   7   8   9   10   >