potential pop3d memory leakage (2.1.16)
First I realise that 2.1.16 is 'dead tree' now, however inside of openinbox popd_msg is xmalloc-ed but as far as I can tell NEVER free'd anywhere and is then leaked between sessions. Can anyone confirm this? -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Home Page: http://asg.web.cmu.edu/cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: potential pop3d memory leakage (2.1.16)
Also proxyd.c ignores servername:, I've got a few other patches going against mine but right at the top of cmdloop() (line 1427 my file which is probably wrong) we have a gethostname and a hostname variable isntead of using the common config_servername. Not bad bug, just inconsistent. Thanks for the popd_msg patch, I was sort of loathing trying to figure out where that one really needed to be! --On Thursday, March 25, 2004 21:06 -0500 Ken Murchison <[EMAIL PROTECTED]> wrote: Michael Loftis wrote: First I realise that 2.1.16 is 'dead tree' now, however inside of openinbox popd_msg is xmalloc-ed but as far as I can tell NEVER free'd anywhere and is then leaked between sessions. Can anyone confirm this? You are correct. Its been around for a while. Here's the fix for 2.1 https://bugzilla.andrew.cmu.edu/cgi-bin/cvsweb.cgi/src/cyrus/imap/pop3d.c .diff?r1=1.142.2.1&r2=1.142.2.3 -- Kenneth Murchison Oceana Matrix Ltd. Software Engineer 21 Princeton Place 716-662-8973 x26 Orchard Park, NY 14127 --PGP Public Key--http://www.oceana.com/~ken/ksm.pgp -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Home Page: http://asg.web.cmu.edu/cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
SASL or lmtpengine bug?
Cyrus IMAPD 2.1.16 Cyrus SASL 2.1.18 I've been using SASL indirectly through Cyrus IMAP (2.1.16) and I am having intermittent SASL -4 No worthy mechs found errorsIT's totally inconsistent. What I've found is that when it happens SASL has somehow not realised that PLAIN is a plugin available to it, only EXTERNAL comes out of a call to sasl_listmechs()...I can't reproduce this manually, it happens sporadically. But the mechs allowed/available are always passed in the same (PLAIN) and I've verified that the LMTP Server is sending back AUTH PLAIN and that the lmtpengine do_auth code is handing that back to SASL. But SASL never manages to find it's PLAIN plugin so returns -4 occasionally. I'm sort of at a loss as to how to further debug this and am trying to see if anyone else has seen this? It would be very difficult to make a call to sasl_listmechs and log that for every connection because that would be a huge amount of logs. I'm not even entirely sure where the mechlist gets built, but obviously there is something going occasionally wrong. -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Home Page: http://asg.web.cmu.edu/cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Syncing pop3 -> imap mailboxes
Well...fetchmail, but that would require passwords and likely be ugly. :) Hey, it's just an idea..never said it was a GOOD idea ;) --On Monday, March 29, 2004 11:24 -0500 Lenny <[EMAIL PROTECTED]> wrote: I'm currently trying to migrate a server using qmail and vpopmail (mail is Maildir) that only allows pop3 connections to the new cyrus system. I'm at a loss and somewhat stumped as to how I can migrate current mail from this server (pop or Maildir) to cyrus. I currently use imapsync to migrate imap->imap. Does anyone have any ideas on this? Thanks. Lenny -- "Wisdom is to a man an infinite Treasure" - Anonymous" --- Home Page: http://asg.web.cmu.edu/cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Home Page: http://asg.web.cmu.edu/cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: BIG PROBLEM: Need help with production box
I'm cynical, but I'd say it's a Redhat problem LOL...more seriously though
what is the size of your dbs mailboxes file, what DB type? Any
particularly 'bushy' mailboxes?
--On Friday, April 02, 2004 02:54 -0500 Curtis Robinson
<[EMAIL PROTECTED]> wrote:
Hello,
I need major assistance. We have a dual cpu w/ 2GB of RAM. Recently,
lmtpd and imapd processes have been eating up all available memory to the
point the machine stops responding. I have try to reconstruct every
mailbox and fix the mailbox database, but nothing has fixed it. Some of
the ctl_ commands fail too by eating up memory. None of the users have
very large mailboxes either. Any help would be great. Thank you.
Setup:
6600 Accounts
Redhat 9.0
Cyrus IMAPD 2.1.16
Cyrus SASL 2.1.10
OpenLDAP 2.1.23
Sendmail
cyrus.conf:
# standard standalone server implementation
START {
# do not delete this entry!
recover cmd="ctl_cyrusdb -r"
# this is only necessary if using idled for IMAP IDLE
# idledcmd="idled"
}
# UNIX sockets start with a slash and are put into /var/imap/sockets
SERVICES {
# add or remove based on preferences
imap cmd="imapd" listen="imap" prefork=5 maxchild=120
imaps cmd="imapd -s" listen="imaps" prefork=1 maxchild=120
pop3 cmd="pop3d" listen="pop3" prefork=3 maxchild=60
pop3s cmd="pop3d -s" listen="pop3s" prefork=1 maxchild=60
sieve cmd="timsieved" listen="sieve" prefork=0
# at least one LMTP is required for delivery
# lmtp cmd="lmtpd" listen="lmtp" prefork=0
lmtpunix cmd="lmtpd" listen="/var/imap/config/socket/lmtp"
prefork=5 maxchild=8
# this is only necessary if using notifications
# notify cmd="notifyd" listen="/var/mail/imap/socket/notify"
# proto="udp" prefork=1
}
EVENTS {
# this is required
checkpointcmd="ctl_cyrusdb -c" period=15
# this is only necessary if using duplicate delivery suppression
delprune cmd="ctl_deliver -E 3" at=0400
# this is only necessary if caching TLS sessions
tlsprune cmd="tls_prune" at=0400
}
imapd.conf:
configdirectory: /var/imap/config
servername: fit.edu
partition-default: /var/imap/data
admins: cyrusadm
sasl_pwcheck_method: saslauthd
tls_ca_file:
tls_key_file:
tls_cert_file:
end of imapd.conf
---
Curtis Robinson
crobinso.at.it.fit.edu
---
Home Page: http://asg.web.cmu.edu/cyrus
Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
--
Undocumented Features quote of the moment...
"It's not the one bullet with your name on it that you
have to worry about; it's the twenty thousand-odd rounds
labeled `occupant.'"
--Murphy's Laws of Combat
---
Home Page: http://asg.web.cmu.edu/cyrus
Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: FW: Insert artificial delay into IMAP server responses (to workaround OL2002)
--On Tuesday, April 13, 2004 13:43 -0400 Doug Koobs <[EMAIL PROTECTED]> wrote: Andy, We are only having the problem when selecting folders that have thousands of emails in it (which, of course, would only be the executives!). The version is OL2002, SP3. OE and Squirrelmail have no problem at all accessing these folders. You say 'problems' what more precisely are the symptoms? Sorry I seem to have missed them on the threads. -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Insert artificial delay into IMAP server responses (to workaround OL2002)
--On Tuesday, April 13, 2004 11:08 -0700 Peter Friend <[EMAIL PROTECTED]> wrote: I wasn't able to view this link. At a protocol level the problem doesn't make much sense to me, since Outlook has to read everything that Cyrus is sending it, regardless of how fast it is being sent. The data would have to actually be ditched by Outlook , or there is some nasty thread collision problem that is causing the data to be lost and not processed. If this isn't causing any protocol errors it would seem that the data loss is specific to certain items. I have a lot of Outlook users talking to a Cyrus server (hacked extensively, but not at protocol level) so I am interested in what is actually happening here. Putting an artificial load on the system should not alter the order that Cyrus writes data. Perhaps this load is delaying writes enough to cause a larger number of smaller packets to be sent over the wire, which really shouldn't matter. I would be doing tcpdump comparisons at this point. I wouldn't' discount it so quicklyin fact I'm quite certain of an intermittent bug somewhere in Cyrus SASL or in prot.c that shows a similar sort of symptoms between the lmtpproxyd and lmtpd'sThey occasionally choke out with 'no worthy auth mech's found', but intermittently. Reproducing this is difficult, but it DOES happen. And when it does SASL thinks that it never saw AUTH PLAIN in the output from lmtpd, when looking at the protocol traces/dumps from over the wire it clearly WAS sent and arrived intact. I wrote a message to the list about it but received no response. -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Insert artificial delay into IMAP server responses (to workaround OL2002)
--On Tuesday, April 13, 2004 12:47 -0700 Joe Rhett <[EMAIL PROTECTED]> wrote: Sorry for the dumb question, but are you certain that plain was enabled in sasl? It's not enabled by default, you have to explicitly configure it during compile time. That might be why the mismatch. Yes I am because as I said, it works most of the time but intermittently it spits out that error. -- Joe Rhett Chief Geek [EMAIL PROTECTED] Isite Services, Inc. -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Quota
Cyrus is not just an IMAP server, Cyrus is a whole mail storage system. You can not simply run modern Cyrus from inetd/xinetd. By BSD what do you mean BSDi, OpenBSD, FreeBSD, NetBSD? What version of Cyrus. You'll probably have to go back and start fromt eh beginning. But if you use Cyrus you have to use all Cyrus. Cyrus has it's own mail spool format and keeps it's messages in it's own area, it also has it's own delivery agents and they don't interact well with procmail, it has Sieve to fill that niche. If you don't want to make POP3 available you can disable Cyrus' pop3d. But you can not choose to run Cyrus IMAPD and some other POP3 Daemon, it will not work. --On Monday, April 19, 2004 15:17 -0300 Eicke Felipe <[EMAIL PROTECTED]> wrote: I need to use Cyrus only for IMAP, but I read somethings about changes into Postfix main.cf and POP server too. Could you help me? Eicke. - Original Message - From: "Tarjei Huse" <[EMAIL PROTECTED]> To: "Eicke Felipe" <[EMAIL PROTECTED]> Cc: "Cyrus List" <[EMAIL PROTECTED]> Sent: Monday, April 19, 2004 3:07 PM Subject: Re: Quota On Mon, 2004-04-19 at 18:40, Eicke Felipe wrote: > Hi folks, I am newer user. > > I am needing an imap server with quota supports. I have a BSD Mail server > running Postfix,IMAP (UW), POP3 and Squirrelmail. To enable a squirrelmail > quota plug in I need an imap server with quota supports and I decided > to use > cyrus-imapd. > > I read some docs and tried no success install and configure the server. When > I try to test the following error occours: <-snip-> > The imapd is started from inetd. Imapd cannot be started from inetd. You must start cyrus as a standalone server , preferably using a initscript or : /usr/sbin/master& Tarjei > Could you help me? > Regards, > Eicke. > > --- > Cyrus Home Page: http://asg.web.cmu.edu/cyrus > Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: ipurge with virtual domains
not sure who told you % is a wildcard. you've been doing entirely too much SQL. * is the wildcard character, % is just an SQL brain damage. --On Monday, April 19, 2004 22:52 -0400 "Robin M." <[EMAIL PROTECTED]> wrote: How can I use ipurge to delete mail from a trash folder called "Deleted Items" for all users in all domains using ipurge. The following command succesfully works, but I cannot figure out how to wildcard the domain name portion. ./ipurge -f -d 7 "user/%/Deleted [EMAIL PROTECTED]" I have tried unsuccessfull commands such as ./ipurge -f -d 7 "user/%/Deleted Items" ./ipurge -f -d 7 "user/[EMAIL PROTECTED]/Deleted Items" ./ipurge -f -d 7 "user/[EMAIL PROTECTED]/Deleted Items" ./ipurge -f -d 7 "user/%/Deleted [EMAIL PROTECTED]" ./ipurge -f -d 7 "user/%/Deleted Items%" I have the following items in my /etc/imapd.conf unixhierarchysep: yes altnamespace: yes virtdomains: userid defaultdomain: localdomain --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: empty the duplicates databaes
Checkpoint lays down a marker of 'all transactions up to this marker are complete and in the tables' recovery finds the last checkpoint, does a consistency check, then runs the transactions remaining after that forward until it gets to the end of the transactions logs. --On Wednesday, April 28, 2004 16:01 +0200 Pieter Vanmeerbeek <[EMAIL PROTECTED]> wrote: Hi, Ken Murchison wrote: Pieter Vanmeerbeek wrote: Hi, can anyone tell me how to empty the duplicates database ? I found out that cyr_expire -E days allows to erase duplicates older than days days. But this doesn't work with days equal to 0. Is there some other trick to empty the duplicates database? Using days=0 will leave all entries. The closest you can get to with cyr_expire is days=1. If you truly want to empty deliver.db, then stop the server, checkpoint (and possibly recover) the BDB environment and then remove deliver.db. This works fine ,thanks. Although I do have one question left. The *ctl_cyrusdb allows *to checkpint with the -c flag and to recover with the -r option. From what I understand checkpointing is needed to have a good backup if something goes wrong. And the recover restores all database files from the latest checkpoint. But what happens with changes or new mail received between the last checkpoint and failure point? kind regards, Pieter * * -- __ aXs GUARD, internet communication solutions do IT safe, do IT with aXs GUARD Able NV Leuvensesteenweg 282 - B-3190 Boortmeerbeek - Belgium Phone: + 32 15 50.44.00 - Fax: + 32 15 50.44.09 Mobile: +32 497 44.52.52 http://www.axsguard.com http://www.doITsafe.net -- aXs GUARD has completed security and anti-virus checks on this e-mail (http://www.axsguard.com) --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus HA Scalable Solution? Rsync
--On Tuesday, May 25, 2004 14:39 -0700 Kevin Baker <[EMAIL PROTECTED]> wrote: Thought? This is obviously just a sketch... but I haven't seen a this done before as far as the failover solution with rsync and thought it might work pretty well. rsync sucks for large numbers of files/directories. It has to build an in-memory tree before it even starts syncing. what would be 'nice' to see is something built inside of cyrus to handle multiple backends but that's a pretty complicated bit of beast. (no i'm not volunteering ;) ) -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Corrupt inbox, related to size?
cyrus versions, filesystems, postfix versions, cyrus database formats being used. 1k messages is nothing, i have severa with 300k or more, one with a million messages or more. No problems I've used 1.6.x series nad now I'm in the 2.2.x series. Only time I had corrupt mailboxes was from an unclean nasty shutdown and from bad RAM. --On Wednesday, May 26, 2004 10:23 -0700 Kevin Baker <[EMAIL PROTECTED]> wrote: I had to reconstruct my first cyrus user inbox today. I have to say it makes me a bit nervous. We are running Postfix+Cyrus+LDAP with about 500 user, pretty good traffic, on 512Ram Raid1. This particular user had about 1000 messages in her inbox. It was fine after I ran reconstruct, but this is very inconvient as I need to take down cyrus during the process. Does anyone have ideas as to what would cause this. Could it be related to the number of messages in her inbox? Thanks, Kevin --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus dies
I suggest you use 'top', 'ps', and 'pstree' to find out what's running. BEcause obviously something is. In Linux if something is blocking on Disk I/O it will push up the load average. IT sounds almost like your daily cron jobs are scanning the cyrus mail spool and pushing over some cheap IDE drives. --On Wednesday, May 26, 2004 21:26 +0100 Colin Bruce <[EMAIL PROTECTED]> wrote: Dear All, Another problem which may be related to the one I reported earlier but I don't think so. The facts cyrus imap 2.2.3 Linux 2.4.25 The server only runs cyrus imap. There are no other services on this machine and only a few administrators can login. The Problem As far as I can tell every night at approximately 21:15 the server dies. Here is some uptimes as that times approaches. [EMAIL PROTECTED]: uptime 21:01:19 up 40 days, 22:48, 21 users, load average: 0.88, 0.55, 0.33 [EMAIL PROTECTED]: uptime 21:17:33 up 40 days, 23:05, 21 users, load average: 0.18, 0.27, 0.31 [EMAIL PROTECTED]: uptime 21:17:37 up 40 days, 23:05, 21 users, load average: 0.18, 0.27, 0.31 [EMAIL PROTECTED]: uptime 21:17:55 up 40 days, 23:05, 21 users, load average: 0.74, 0.39, 0.34 Following that last one I cant type anything at all. I also can't login to the server and anyone using it will find that they can't read any e-mail. After 10 or 15 minutes like this it will start responding again and the load average will be falling from somewhere between 80 and 100. It will fairly quickly fall to values of less than 1 again. There are no cron or at jobs running at this time. This seems to happen most evenings. Does anyone know what might be the cause? Best wishes. Colin Bruce --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Corrupt inbox, related to size?
--On Wednesday, May 26, 2004 18:13 -0700 Kevin Baker <[EMAIL PROTECTED]> wrote: How about this. I found out that the previous administrator was restarting Cyrus and Flushing Postfix every couple hours as Cyrus seemed to be having problems with hanging. A sneaky hidden cron... God that'd cause corruption heh. No need to restart it like that. And oyu said there were no crons! ;) Need to check your logs :) So I will look into this... but If the user happened to be accessing Cyrus when the server was "bounced" could this corrupt the mailbox. That is great to know about not restarting Cyrus.. I was just following a man of mine. I guess I'm curious how it would handle receiving a message while reconstructing. E_TEMPFAIL/RC=75/4xx depending on what layer you're talking about. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Cyrus dies
The trail I'm seeing say something more wrong with the machine than cyrus. The machine is not doing ANY I/O or is so busy doing some other I/O it stops doing anything useful. Not running XFS filesystem per chance are you? If the machine were OK it would bog down under nasty load, but it wouldn't' STOP DEAD like that. You need to look around poke at things, try to find whats broken causing it to stop dead like that, and it's probably not Cyrus. It could be if it's going amok, but I really doubt it. Linux has a LOT of known problems with huge amounts of memory...try reducing your memsize to 3Gb or 4Gb either by physically pulling chips or memsize= on the boot line Lilo you can say something like 'linux memsize=4096M' in GRUB you have to use 'e' to edit one of the options, then scroll down to the line containing kernel and add memsize= to the end of it by 'e' editing that line, then you can use b to boot. See if that helps your performance. There is a reason, I'm just REALLY doubting it's actually Cyrus at the heart of this one. --On Thursday, May 27, 2004 16:50 +0100 Colin Bruce <[EMAIL PROTECTED]> wrote: Dear Michael and Rob Sorry I should have said what the hardware is. We are running Cyrus on an IBM X345 with dual 3GHz processors, 8GB of memory, dual Gigabit network cards and 6 ultra 320 73GB SCSI disks which are not in a RAID configuration of any kind. I'm afraid there are no IDE drives in the machine. I've checked the cron tables and there are no cron jobs running at the time this happens. Unfortunately it isn't possible to run anything when it happens because the machine is totally locked. It doesn't even respond to me pressing the enter key on the console. I can try running top beforehand and hopefully when it happens it will show something but I think it will stop displaying. The last time master was started was May 17 at 18:36:53. What events could it be running? I know there are some mentioned in the config files but are there any that are hard coded that might be running? I had a look at the logfiles afterwards last night and everything stops. There are no entries in the log files between 9:17PM and 9:35PM. Afterwards everything returns to normal. Best wishes.. Colin -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: sieve spam+virus filtering
Not unless someone writes the extensions. And even then Sieve has no global script definitions, just per user. So really no. --On Sunday, June 20, 2004 19:57 +0200 Antoine Jacoutot <[EMAIL PROTECTED]> wrote: On Sunday 20 June 2004 19:50, Jim Levie wrote: Take a look at MailScanner (http://www.sng.ecs.soton.ac.uk/mailscanner/index.html) Oh, I know mailscanner... as a matter of fact, I also used mimedefang, amavis... but I was wondering if sieve could globally check for spam and viruses. Antoine --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Need help to install a Cyrus Server on a FC2
As an aside, make darn certain you upgrade to and run the latest 2.6.6 kernel. I've had numerous crashes and disk lockups under the 2.6.5 kernel shipped on the tettnang CD/DVD. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: High availability ... again
--On Wednesday, June 23, 2004 11:48 -0700 Kevin Baker <[EMAIL PROTECTED]> wrote: David, This is exactly what I had in mind. Could you maybe give a quick overview of how you have the replication and failover setup; specifically "application level replication vs block" application lvel means exactly that. The actual program/server software involved does it's own replication. Like Oracle RAC or MySQL replication. block level means soemthing at the disk I/O layer does it all, without the app's knowledge. While the idea of a standby server that uses block level replication seems very great, if possible I'd like to have the reliability while still being able to use both machines. Is it something like this: - Server A - active accounts 1-100 - replicate accounts 101-200 from Server B - Server B - active accounts 101-200 - replicate accounts 1-100 from Server A If B goes down, A takes over the accounts it had replicated from B. Thanks, On Tue, 22 Jun 2004, Etienne Goyer wrote: Does somebody on the list use this solution or a similar one and could comment and the practicality of it ? Perhap M. Carter (if you read the list) could give us a status update for his particuliar project ? There's really not a whole lot to say. We've been using the code on our main 32k user mail system since about this time last year for data migration, fast incremental backup to a tape spooling system, and rolling replication for live updates. We also used the replication system to migrate from a UW based system to Cyrus. We have 16 small Linux servers running as 8 pairs. All the systems are live Cyrus servers, half the accounts on each system are replica versions. One of the 16 had a hardware fault a couple of weeks back and noone has moaned at me after we switched to the replica which is always a good sign. From my perspective the advantage of application level replication over block level replication like DRDB is flexibility. Read/write access to both master and replica systems can be useful: we maintain databases of MD5 checksums for all the messages and cache entries on each server. Its also rather cute to run PINE against both master and replica version of a given mailbox and watch the replica play follow my leader :). -- David Carter Email: [EMAIL PROTECTED] University Computing Service,Phone: (01223) 334502 New Museums Site, Pembroke Street, Fax: (01223) 334679 Cambridge UK. CB2 3QH. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Problems with idle pop3 connections locking mailboxes
--On Monday, July 12, 2004 17:16 -0500 Michael Sims <[EMAIL PROTECTED]> wrote: As promised, I'm following up to the list on the status of this problem, in case anyone has an issue like this in the future. It does appear to have been caused by our intrusion detection device. Our network manager configured this device to avoid scanning POP3 connections and for the past two weeks I have not seen any more pop3 daemons stuck in the middle of a write(). I may be jinxing myself by saying that the problem is resolved but it certainly appears to be so. write() to disk or network? if network then sounds like a nasty deadlock in the NIDS. i never did like NIDS that required inserting themselves into the traffic stream. Thanks a lot to everyone who helped me with this. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Virtual Memory Consumption of Cyrus IMAPd
We useta see that at my place of work as well, all the way back into RH7.3, but *ONLY* on the RedHat systems. nothing else. --On Monday, July 19, 2004 16:46 -0400 Lenny <[EMAIL PROTECTED]> wrote: Not sure about RHEL, but on Fedora Core 1 the saslauthd process eats tons of swap until eventually there's no memory left. Great fun! This of course stops cyrus from being able to process imap and pop logins (if you're using saslauthd for authentication). A simple restart usually fixes this particular problem. This may or may not be related to what you're seeing, but I figured I'd throw this out there. Lenny -- "Wisdom is to a man an infinite Treasure" - Anonymous" Quoting Mohamed Magdi Abbas <[EMAIL PROTECTED]>: I'm running cyrus impad(v 2.2.6), used to run 2.1.16, on RHEL 3.0 and noticed that the amount of swap space free is decreasing. When I was running v2.1.16, the swap free would decrease until the kernel oom(out of memory) killer would activate and start killing processes which essentially grinds the system to a halt. I doubt that this is normal. Could this point to a memory leak in cyrus. Just for note, I have not yet experienced this with the latest version, but the swap free is decreasing. By the way I'm using simons RPMS from invoca.ch. Could someone shed some light on this. Anything will help... Mohamed Magdi Abbas Systems Engineer Longwood University [EMAIL PROTECTED] --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Running Cyrus IMAP with 32Mb RAM [Was: migrating from maildir (courier) to cyrus]
--On Wednesday, July 28, 2004 13:16 -0700 Vadim <[EMAIL PROTECTED]> wrote: Based on cyrus documentation, imap server need up to 512 K RAM per connection. Assuming 5 connection per user (mozilla default), it is up to 2.5Mb per user, so with 32Mb Ram and only apache2/mail server running that's just for the connection struct. when you start doing large operations on large mailboxes the requirement goes up significantly. I should be able to support up to 4 users without any problems. -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: can't see subfolder created in cyradm
MAke sure you've subscribed that user to it. Evo only displays folders you've subscribed to. --On Wednesday, August 11, 2004 11:26 -0700 Kevin Williams <[EMAIL PROTECTED]> wrote: All, I think I'm missing something REALLY obvious here. For some reason I can't see a subfolder (spam) I created using cyradm. I've set up cyrus imap and am accessing it via Evolution. I've created an account user.testuser1 and a subfolder user.testuser1.spam. When I logged into my email via evolution I only had access to the main folder though. I was able to create a subfolder in evolution called spam2 which showed up as user.testuser1.spam2 in cyradm. Here are some results from cryadm: server01.tarity.com>lam user.testuser1* user.testuser1: testuser1 lrswipcda user.testuser1.spam: cyrus cd testuser1 lrswipcda user.testuser1.spam2: testuser1 lrswipcda AND server01.tarity.com> lm user.testuser1 (\HasChildren) user.testuser1.spam (\HasNoChildren) user.testuser1.spam2 (\HasNoChildren) So why can't I see the spam folder in evolution? Thanks in advance, Kevin Williams --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: sievec core dumps when hitting 'address' or 'envelope'
Probably has to do with 64 bit alignment and pointers versus 32 bit
alignment and pointers. by reordering the int/pointer pair the union
becomes not so much a union in the sense that may be meant for it. didn't
look into it deeply at all myself, but it would ppear that the machine
code/variable space for each of the compiled versions of those mis-ordered
unions is quite different on 64 bit platforms.
--On Monday, August 30, 2004 00:42 -0400 Scott Adkins <[EMAIL PROTECTED]>
wrote:
We ran into a problem on Tru64 where the sieve compiler was core dumping
if it tried to compile a script that used 'address' or 'envelope' in it.
For example, the following script would core dump sievec:
if address :contains "To" "[EMAIL PROTECTED]" {
stop;
}
Changing 'address' to 'header' would work just fine.
I tracked it down to a header file, tree.h. Basically, there is a union
defined inside the 'Test' structure that itself defines a few structures
that would share the same memory space (so to speak... if you understand
C programming, then you should understand what unions are). The problem
is that two of the structures defined many of the same variables as each
other, but in different orders...
For example, the first structure in the union declares A, B, then C, but
the second structure in the union declares A, C, then B.
This shouldn't normally be a problem, but on Tru64 5.x, it certainly is.
I am not sure if it is a weirdness with 'cc', or if it is something
deeper.
The code compiles and without warnings, but it core dumps at runtime.
Simply changing the order in one structure or the other to match solves
the problem nicely.
This could very well be related to the following bug:
I submitted a patch, which I will include here, that should fix it. It
is a *very* small patch :)
Scott
--
+---+
Scott W. Adkinshttp://www.cns.ohiou.edu/~sadkins/
UNIX Systems Engineer mailto:[EMAIL PROTECTED]
ICQ 7626282 Work (740)593-9478 Fax (740)593-1944
+---+
PGP Public Key available at http://www.cns.ohiou.edu/~sadkins/pgp/
--
Undocumented Features quote of the moment...
"It's not the one bullet with your name on it that you
have to worry about; it's the twenty thousand-odd rounds
labeled `occupant.'"
--Murphy's Laws of Combat
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Sieve vacation problems
sieve requires :address(es?) lines and only responds to addresses listed in
tose lines in my experimentation.
--On Wednesday, September 01, 2004 14:07 +0300 Gil Freund
<[EMAIL PROTECTED]> wrote:
Hi,
I am having a problem using sieve for vacation notices. I am using Cyrus
2.1.16 (Debian Sarge) with LDAP and Postfix.
We are using Squirrelmail for reading mail and server side scripting. All
seem to work apart from the vacation.
This is the script generated by Squirrelmail (actually, avelsieve):
# This script has been automatically generated by avelsieve
# (Sieve Mail Filters Plugin for Squirrelmail)
# AVELSIEVE_VERSIONYTo0OntzOjU6Im1ham9yIjtpOjA7czo1OiJtaW5vciI7aTo5O3M6Nzo
# icmVsZWFzZSI7aToxMDtzOjY6InN0cmluZyI7czo2OiIwLjkuMTEiO30=
# AVELSIEVE_CREATED1094028473
# AVELSIEVE_MODIFIED1094028473
require
["fileinto","reject","vacation","imapflags","relational","comparator-i;as
cii-numeric","regex","notify"];
if
# START_SIEVE_RULEYTo1OntzOjQ6InR5cGUiO3M6MToiNCI7czo2OiJhY3Rpb24iO3M6MToi
# NiI7czoxMzoidmFjX2FkZHJlc3NlcyI7czowOiIiO3M6ODoidmFjX2RheXMiO3M6MToiNyI7
# czoxMToidmFjX21lc3NhZ2UiO3M6MTM3OiJJIHdpbGwgYmUgb3V0IG9mIG9mZmljZSB1bnRp
# bCBTZXB0ZW1iZXIgOXRoLiBJbiBjYXNlIG9mIHVyZ2VudCBtYXR0ZXJzLCBhIG1lc3NhZ2Ug
# Y2FuIGJlIGxlZnQgYXQgRGV2ZWxvZ2VuIElzcmFlbCwgcGhvbmU6ICs5NzIgOCA5Mzg3Nzc3
# LiI7fQ%3D%3DEND_SIEVE_RULE
true {
vacation :days 7 text:
I will be out of office until September 9th. In case of urgent matters, a
message can be left at Develogen Israel, phone: +972 8 938.
.
;
I see no error in the mail log.
Thanks
Gil
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
--
Undocumented Features quote of the moment...
"It's not the one bullet with your name on it that you
have to worry about; it's the twenty thousand-odd rounds
labeled `occupant.'"
--Murphy's Laws of Combat
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus crashed on redundant platform - need better availability?
BTW -- if you want Stable (in case you didn't understand that from ym previous mail) go back to FreeBSD 4.x (say 4.10-STABLE or -SECURE) -- you've probably run into a platform bug, not a bug in Cyrus, since the whole machine went. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus crashed on redundant platform - need better availability?
--On Friday, September 10, 2004 16:27 +0200 Paul Dekkers <[EMAIL PROTECTED]> wrote: What did the kernel improve? You are not using a clustered filesystem, right? RH kernels tend to coem up with bugs that noone else sees FYI (this is why my employer we're switching to Debian...) Well, it's UFS2 with softupdates, so yes. I'm afraid the journal was damaged in my case, there were serveral complaints while doing the fsck about softupdate inconsistencies. (The server crashed once more but since I mounted with -o sync now the fsck was much faster. I'll keep it that way for now untill we know what's really wrong - it was again with a large mail-folder synchronisation...) FWIW I can't call soft updates a journal. 9/10 times when i have had a crash, the soft updates journal either was corrupt, inconsistent, or made things worse. When running with soft updates many times I'd lose many days worth of mail on a restart. Hmm, I don't expect the problems to be SCSI-related. Maybe it has to do with GEOM and SMP in FreeBSD 5.2.1, but not the SCSI-bus itself. (There are two seperate controllers for both machines, they never see each other on the same SCSI bus...) Probably not, more likely something funkish in FBSD 5.2.1 I still think that it would be best to have two filesystems instead of one, so with mirroring on application level (cyrus)... :-) I tend to agree --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus crashed on redundant platform - need better availability?
The theory only translates if you're using a JOURNALED file system. Linux ext3, reiserfs AIX JFS, Sun/others veritas are all examples of this. AFAIK FreeBSD hasn't any journalling file systems, i could be wrong though since I haven't really looked for one (my freebsd boxes just run...and run...and run...) That said, the machine shouldn't' have crashed in the first place, but you are running 5.x which is clearly labeled as *NOT* production (4.10 for that)... All of my produciton boxen are 4.x based (of the FreeBSD herd) --On Friday, September 10, 2004 13:24 +0200 Paul Dekkers <[EMAIL PROTECTED]> wrote: Hi, We're implementing a new mailplatform running on two dell 2650-servers (2 xeon cpu's with each 3 Ghz, HTT and 3Gb of memory) and with a disk array of 4 Tb connected with a adaptec 39160 scsi controller for storage. We installed FreeBSD 5.2.1 on it, and - of course - cyrus 2.2.8 (from the ports) as IMAP server. Our MTA is postfix. There are two machines for redundancy. If one fails, the other one should take over: mount the disks from the array, and move on. Unfortunally, the primary server crashed twice already. The first time it did while synchronising two IMAP-spools from the old server to the new one. There was not much data on it back then. The second time was worse, around 10Gb of mail was stored on the disks. We discovered that the fsck took about 30 minutes, so although we have two machines for redundancy it takes still quite some time before the mail is available again. (And we still have about 90 Gb of mail to migrate, so when all users are migrated it takes much longer.) I mounted the filesystems synchronous now: although it slows down the system I hope it speeds up the fsck a bit when there is another crash. The second crash was while removing a lot of mailboxes (dm) while some of them where removed the same time using a webmail app (squirrelmail). I'm not sure why the box crashed; there was nothing in the logs, there was nothing on the screen when we came there, it just booted up again. Of course I'm interested if anyone has any thoughts on this. Although many on the list claim that this (having 2 boxes with 1 disk-array) is a nice way for redundancy I'm in doubt now if this is true. It still takes 30 mins before everything is back again! It seems to me that if there was a "live" version of cyrus available with a synchronised mail-spool, that there was no outage noticeable for users (except in losing a connection maybe). Am I right? Maybe it's time to continue on the "High availability ... again"-discussion we had a while ago. If the cyrus developers are able to implement this with some funding there are still some questions left for me: how much time would it take before a "stable" solution is ready? How many funding is expected? I still have to talk to management about this, but I would really support this development and I'm certainly willing to convince some managers. Regards, Paul --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: IOERROR Cannot create anymore mailboxes
What filesystem type? do a df -i ? sounds like you ran out of inodes maybe...or hit some sort of limit with the number of directories. Also need other details like what OS. --On Wednesday, September 15, 2004 19:51 +0100 "Boyle, Bernadette" <[EMAIL PROTECTED]> wrote: Hello, I have a terrible problem at the moment at the university with new students not being able to receive mail because I cannot create any more accounts. I am currently running cyrus-imapd-2.0.17. However I cannot create any more mailboxes. I receive the following error when trying to create new accounts ... Sep 15 19:05:16 sparrow imapd[7843]: [ID 721126 local6.error] IOERROR: creating directory /var/spool/cyrus1/user/jsnadd11: Too many links Sep 15 19:05:16 sparrow imapd[7843]: [ID 721126 local6.error] IOERROR: creating directory /var/spool/cyrus1/user/jtarra10: Too many links Sep 15 19:05:16 sparrow imapd[7843]: [ID 721126 local6.error] IOERROR: creating directory /var/spool/cyrus1/user/jvargh12: Too many links Sep 15 19:05:16 sparrow imapd[7843]: [ID 721126 local6.error] IOERROR: creating directory /var/spool/cyrus1/user/jwalsh14: Too many links Sep 15 19:05:16 sparrow imapd[7843]: [ID 721126 local6.error] IOERROR: creating directory /var/spool/cyrus1/user/jwatso26: Too many links and so it goes on I currently have 32,765 directories in this account and it seems like perhaps I have reached the quota. Is there anyway to stop this? Warm Regards Bernadette Boyle - -- Bernadette Boyle IT Services Caledonian University Harley Building, H035 70 Cowcaddens Road Glasgow G4 OBA 0141 331 3597 - - -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Funding Cyrus High Availability
--On Thursday, September 16, 2004 18:13 -0400 Lee <[EMAIL PROTECTED]> wrote: P.S. Ken, not sure if this would be easier or more complex, but another alternative here might be to write a mysql backend to cyrus, which would eliminate the need to worry about redundancy given mysql's multimaster functionality (this might also provide better searching/sort/access and enormous scaleability to the cyrus backends). mysql does not have multi-master functionality, and it's replication, is quite honestly, a joke. You may have mis-spoken and are talking about the up-and-coming mysql cluster or the mysql max product (both of which i'm much less familiar with). --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Funding Cyrus High Availability
--On Thursday, September 16, 2004 22:14 -0400 Earl Shannon <[EMAIL PROTECTED]> wrote: Hello, Question: Are people looking at this as both redundancy and performance, or just redundance? My $0.02 worth. Performance gains can be found the traditional way, ie, faster hardware, etc.Our biggest need is for redundance. If something goes wrong on one machine we still need to be able to let users use email. Cyrus already has this solved via MURDER, but FWIW, more smaller boxes isolate failures more effectively than one big box, also price/performance is still better at a certain size for any platform, and going up higher on the performance curve has HUGE price jumps. There's also the cost of administering multiple separate boxes to think about but carefully planned, this can be managed rather easily. The whole 'throw bigger and bigger boxen' at it method of 'scaling' doesn't scale. You hit the wall. One box can only do so much, granted you can spend LOTS of money and get pretty big boxes, but at some point it becomes ludicrous -- who would use a Sun E10k/E15k and a whole Symmetrix DMX for just mail? (and I'm excluding companies like AOL and IBM who actually can afford it and would maybe have a reason to scale to that size)... Price/Performance has a curve associated with it, most of us can't afford to always stay at the top end of the curve, and have to be at the middle. Further, does it make sense to re-invest in equipment every year to maintain growth? No, you should be able to expand, add another box, or two, and that scales fairly well. Better than the single big box approach. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Funding Cyrus High Availability
--On Monday, September 20, 2004 00:43 +0200 Jure Pe ar <[EMAIL PROTECTED]> wrote: On Sun, 19 Sep 2004 00:52:08 -0700 (PDT) David Lang <[EMAIL PROTECTED]> wrote: Nice review of replication ABC :) Here are my thoughts: 1. Active->Slave replication with manual failover This is really the simplest way to do it. Rsync (and friends) does 90% of the required job here; the only thing it's lacking is the concept of the "mailbox" as a unit. It would be nice if our daemon here would do its job in an atomic way. A few days ago someone was asking for an event notification system that would be able to call some program when a certain action happened on a mailbox. Something like this would come handy here i think :) we were doing this but really, rsync does not scale well. when you get lots of small files it takes it loner to figure out what to transfer, than it'd take to just transfer almost everything over (assuming a small 768kbit to about 1.5mbit link and a average sized messages mailstore). and unles you break it up into smaller chunks, it'll gobble up wads of RAM during the process. insane amounts like well over a gig or so for our mailstore with about humm 51Gb of mail. Not exactly sure the number of files off the top of my head though it could be figured if wanted. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: raw access to imap quotas, with mail user
--On Sunday, September 19, 2004 21:10 -0300 Felix Cuello <[EMAIL PROTECTED]> wrote: On Sun, Sep 19, 2004 at 09:55:45PM -0500, Edward Rudd wrote: What's wrong with just making an imap connect to ask for the quota root? (you don't have to run cyradm to check quatas..) Is to slow to do that in every page viewed by users [login with ldap access, then check imap quota]. Because the requirement is "Show Mailbox Usage on everypage"... then i was using IMAP::Admin but i want to do that faster... then i wrote a simple C code to read user quota without IMAP access. That's all... but mail users don't have read access to /var/imap/quota. Read it once, and then cache the result in the session information (or even in a cookie) along with a 'freshness' -- and when the timeout has expired, re-check it (say 1 minute, or five). Same thing with the LDAP auth. Re-authing every single page load is not necessary. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Cyrus POP3 Deadlocks in 2.1.16
--On Monday, September 27, 2004 11:24 -0500 Michael Sims <[EMAIL PROTECTED]> wrote: I hope you don't mind me shooting in the dark here... Not at all, because I've been shooting in the dark on this one for a while now :) Remember this thread: http://marc.theaimsgroup.com/?l=info-cyrus&m=108967188821511&w=2 Yes I recall that thread, but no, we don't have anything like that going on here. We also don't have any SYN attack going on. Cyrus POP3 just goes dumb and stops working. If/when it happens again I'll try to catch the netstat output, but as I said, it's Cyrus doing this for some reason. Do you think it could be relevant? What does the output of "netstat -anp" look like when this is happening? How about "lsof -ni TCP:pop3"? We had a problem with our main mail server a few days ago with SMTP. Clients would connect but never get a banner. Turns out that we had a lot of TCP connections stuck in SYN_RECV, which was again caused by the network device mentioned in the above thread. Do you see anything like that in your netstat output? --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus POP3 Deadlocks in 2.1.16
--On Monday, September 27, 2004 09:44 -0700 "Kevin P. Fleming" <[EMAIL PROTECTED]> wrote: This sounds EXACTLY like some other daemon is being started and is taking the POP3 port away from Cyrus' "master" process. I'm not sure how this would be possible, but it would depend on your OS and a lot of other factors. Linux, Debian Woody/Stableand no. Cyrmaster notes it's taking the connections and handing them off, spawning the pop3 processes (proxy or not, doesn't matter) but they just never banner, and hang forever -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: imap scalability
--On Thursday, October 07, 2004 09:54 +0600 denz-wavenet <[EMAIL PROTECTED]> wrote: hi! Requirements:host 10, IMAP mailboxes Usual setup: LDAP/SMTP-postfix/cyrus-iamp First -- do not run Cyrus over NFS, just don't do it. Second, do not share spool areas, cyrus does not handle this. If you've got compliant clients and servers then NFS *might* work. You can't use a Linux NFS server, it doesn't qualify. And I'm pretty sure the Linux NFS client is also in the doesn't' qualify area. And performance will suck unless you go full Gig-E on a separate back-end network, and even then, DAS or SAN will give you far more attractive results. Cyrus broaches the scaling issue with MURDER and using multiple back-ends but they DO NOT SHARE storage. At all. That server may or may not be enough. It really depends on what you mean by 10,000 users. IF you mean 10k concurrent connections, no. Also if it has IDE drives, even if you mean 10k mailboxes forget about it, IDE drives aren't going to keep up, you'll need about 3k random block io/second performance bare minimum using reiserfs and about 30-40G of mail data, other filesystems will have other patterns, ext2/3 will prolly see a LOT more read traffic due to the nature of it's inode layout. Those numbers come from my live system where we've got around 12k mailboxes and prolly 3k-4k users, and about a million envelopes/day of mail volume coming in, with a LOT being dropped before that count by using DNS blacklists up front. Scaling it also depends on your inbound mail, and mail flow, you going to be running AV scanning? how about SpamAssassin? going to allow the users to run scripts on their mail (i recommend not) -- and by that I mean *not* SIEVE, like procmail or similar. At first glance, presumign that box has a beefy, and i mean beefy -- like 7x10K RPM U160 SCSI drives on a real RAID subsystem, like a nice higher end ICP Vortex card -- it should manage, it may get a little tight at times but it should manage it alright. as long as you dont' mean 10k concurrent sessions, then you're outside the league of a single box, talking about a decent sized load balanced front-end/back-end group of systems. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Any ideas? Cyrus takes 5 minutes to start
--On March 17, 2006 10:03:07 PM +0200 Mika Iisakkila <[EMAIL PROTECTED]> wrote: Rosenbaum, Larry M. wrote: I did manage to get a couple minutes of truss output the other day but I had to kill it before it finished. It looked very repetitive, with a lot of this: Well, it has to wade through every mailbox to check out that they are OK. Five minutes for startup can be quite normal if you have lots of mailboxes. That's I/O intensive stuff, so those plenty of CPU cycles that you seem to have available might not help much there. Mine sure doesn't. We've got 10k+ mailboxes and if Cyrus were to walk them on startup it'd probably take an hour. It certainly doesn't. It might walk the DB tree to check it's consistency but it certainly doesn't walk the actual mailbox tree doing a consistency check during startup. If newer versions do this I don't know, we're running a patched up 2.1.17 here. If they do actually do that someone needs a cluebat, that's just a bad idea. If it is to be done it needs to be done in the background, if at all. It's better to assume things are OK and fix the errors as they come rather than preventing 10k+ people from getting their mail for well over an hour, all the while the support phones are ringing off the hook. Ours was taking a while to do startup, turned out to be something wrong with how cyrus is calling it's event handlers, the BDB log archives were never getting cleaned despite having an event to do that. The log has to be replayed every startup. If the BDB archive/aging was running right it'd be retiring older transactions. No idea whats up there haven't ahd time to look into it. It's not a major showstopper since it took nearly 2 yrs to get to a size where it was a problem. (Yes, I've always wondered myself what's happening back there too, but never bothered to find out. Apparently Cyrus does this in some brute-force way, one mailbox at a time -- in your truss segment, it seems to read in three megabytes' worth of mailboxes.db file over and over again.) --mika Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Global Sieve scripts?
--On March 27, 2006 12:16:29 PM +0200 Anders Norrbring <[EMAIL PROTECTED]> wrote: Thanks, but I don't think it does. First of all, I already have a system with 12000+ accounts... I'd like it to work just as a individual script, but in the global scope. I've been searching both list archives and on Google, but no good match so far. Maybe I'll have to modify my blacklist settings in Amavis-new to accomplish this... Sieve is the *WRONG* place to be doing this. Do it as early as possible, preferably inside your MTA if you can. Bouncing later will make you as bad as, or worse than the problem by creating backscatter. What I want to do is simply reject e-mail from certain accounts, and send them a note that their mail was rejected. It could be done in Amavis as well, if I just disable the auto-learning feature. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Too slow
--On April 7, 2006 8:58:57 PM +0200 Sascha Bieler <[EMAIL PROTECTED]> wrote: Hi there, I am running cyrus-imapd-2.1.12 on a Gentoo Linux with kernel 2.6.15. Got a Pentium 4 Xeon 2,8 GHz and 2 GB Ram. The cyruspartition is ext3 on a SCSI RAID 5. hdparm -tT /dev/sda says: /dev/sda: Timing cached reads: 2316 MB in 2.00 seconds = 1158.00 MB/sec Timing buffered disk reads: 80 MB in 3.01 seconds = 26.58 MB/sec Everythings working just fine, but when I want to delete an email it's so slowly... Has anyone a hint for me? Depends a LOT on your I/O load. 27MB/sec is pretty slow, and that's reads, RAID5 writes are often as slow as half, depending on your hardware, plus that's before the filesystem is in the way. Large directories slow ext3 down quite a bit. Expunge operations on our large mail backends are often pretty slow too, but aren't too bad, though we're using a lot bigger hardware and servers. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: unixhierarchysep: 1 ... web interfaces ...
--On April 18, 2006 5:55:41 PM -0300 "Marc G. Fournier" <[EMAIL PROTECTED]> wrote: does anyone know of any that actually allow to switch from . -> /? As an example, to check quotas, Horde webmail / IMP has a ' "userhierarchy' => 'user.'" setting ... but its "hardcoded", so I can't easily have a "one interface for multiple domains" ... so, I'm curious ... although the spec allows for it, does anyone actually every switch it to 1? I'm starting to think I'm just going to go back to 'no first.last mailboxes', since there doesn't appear to be any easy/safe way to switch between the two from a PHP/application level :( Quite a few installations of mine use it set to '1' -- the "spec" allows anything to be the hierarcy seperator. Compliant clients will ask the server when they connect, and the servers are more than happy to tell them what the correct seperator is for them. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: SAN based storage
--On April 19, 2006 6:40:27 PM +0200 Andrzej Kwiatkowski <[EMAIL PROTECTED]> wrote: Hi I'm going to build email-system based on cyrus with SAN storage. As an array i will use CX700. For every instance i'g going to build raid group from 9 146GB disks. I've noticed that in last version of imapd is possibility to separate mail files and meta files. Does it make sense to seperate mailboxes and metafiles, and/or sieve files, mboxlist partiotion when using SAN storage with big performance ? I know that with normal disk this is very important, bot it this situation i this this make no sense. If you mean separate filesystems, I'd tend to say yes still, depending on your base OS. Linux for example keeps queues and caches in different ways than Solaris. Irregardless of what OS you use you'll want some volume management, and a filesystem that can atleast grow online such as ReiserFS. I've heard that ext3 can be resized online, but I've never seen it myself so can't say one way or the other there. I've got one installation backed by a CX200 and the only issue we run into is I/O loading when we had the mail queues and the backend storage all on the same spindles. Once I seperated those out things got a lot better. We're talking quite a bit of I/O though, and the main mail store spindles also back part of the NFS server cluster as well. We use a Linux 2.4 kernel, ReiserFS, on top of LVM, on top of MD in multipath mode -- the reason for the MD multipath is at the time there wasn't a working qlogic driver with builtin failover support. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: SAN based storage
--On April 19, 2006 12:47:26 PM -0500 John Wade <[EMAIL PROTECTED]> wrote: We run cyrus on RedHat on a CX600. For our administrative users, we put the whole thing on a nine disk fibre channel RAIDgroup, split into 6 luns, 5 for mail spool partitions and 1 for all the other metadata. Total mail spool size is 300GB. We average about 300 concurrent users. The CX600 is heavily used by other applications. I/O performance has never been an issue as far as I can tell. The large write caches in the CX600 solve the write problem and the host memory caching seems to solve the read problem.Your mileage may vary. We couldn't do a direct cyrus SAN performance comparision because when we moved to this box, we migrated to the SAN and new server hardware at the same time, but tests on other systems where we just moved storage on to the array saw a huge performance boost vs. locally attached SCSI RAID 5 storage with no write cache enabled. Our mail cluster lives and dies by our CX200's write caches. When they get turned off (as can happen during a failover rebuild on the SAN, or if you lose a vault drive) the mail cluster starts choking. Even though we have used array's with write caching before the algorithms in the CX are definitely better. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: How to remove the Cyrus header in mail for security purpose?
--On April 25, 2006 10:13:01 AM +0800 "Patrick T. Tsang" <[EMAIL PROTECTED]> wrote: Hello, I have searched the old posts but I cannot find any hints to remove the Cyrus header in mail message. Anyone who can help me finding which files I should touch? Be more specific, which header precisely. Further you're not adding a single iota of security, and you'll be making debugging harder down the road. It's a bad idea(tm) to suppress things like Received headers in the name of some completely botched idea of 'security.' It won't make you any more secure. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: pop3 slow respond
Sounds almost like you've got a badly broken firewall in between you and your clients. The other part of it might be rDNS lookups since you're on a 10.x network. --On May 11, 2006 11:16:02 AM +0400 Andrey Kolbasenko <[EMAIL PROTECTED]> wrote: Hi all! I have installed Gentoo Linux with cyrus-imapd-2.3.3+postfix+virtual domains+mysql. When I connect to pop3 5 or more times, or about 10 or more client receive his mail, cyrus answer only after 10-30 sec, and when number of pop3 clients reach 20-30, cyrus completely not respond: telnet 10.26.1.4 110 Trying 10.26.1.4... Connected to 10.26.1.4. Escape character is '^]'. +OK ns.stv.stav Cyrus POP3 v2.3.3-Gentoo server ready <[EMAIL PROTECTED]> quit telnet 10.26.1.4 110 Trying 10.26.1.4... Connected to 10.26.1.4. Escape character is '^]'. +OK ns.stv.stav Cyrus POP3 v2.3.3-Gentoo server ready <[EMAIL PROTECTED]> quit telnet 10.26.1.4 110 Trying 10.26.1.4... Connected to 10.26.1.4. Escape character is '^]'. top command: top - 10:53:42 up 28 days, 2:52, 1 user, load average: 0.00, 0.02, 0.37 Tasks: 123 total, 2 running, 121 sleeping, 0 stopped, 0 zombie Cpu(s): 0.3% us, 0.3% sy, 0.0% ni, 99.3% id, 0.0% wa, 0.0% hi, 0.0% si Mem:906064k total, 836212k used,69852k free,82320k buffers Swap: 506036k total, 92k used, 505944k free, 541628k cached 29434 cyrus 16 0 30188 2624 2024 S 0.3 0.3 0:00.04 pop3d netstat -an tcp0 0 10.26.1.4:110 10.26.5.128:1330 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.224:2120 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.130.71:3230 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.4.105:2317 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.4.105:2319 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.172:1588 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.206:1367 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.72.11:3117 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.238:3453 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.238:3455 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.104:2579 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.228:1691 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.38:4004 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.166:2525 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.38:4002 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.166:2527 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.38:4000 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.197.2:1355 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.75.2:1220 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.52:1211 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.71.154:1449 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.5.220:1457 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.197.2:1371 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.132.5:2333 TIME_WAIT tcp0 0 10.26.1.4:110 10.26.132.5:2329 TIME_WAIT I need your suggestions.. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: how to delete old messages in all mailboxes excluding IMAP?
--On May 11, 2006 10:18:16 AM +0300 Igor Belikov <[EMAIL PROTECTED]> wrote: Hello info-cyrus, When I using "ipurge -f -d 30 -X" - it deletes messages older 30 days in all mailboxes, including those to which access are made using IMAP. But I need to delete messages only in mailboxes accessed using POP3. Is any simple way to do this exist? I don't want to write script that obtain all mailboxes, exclude from them IMAP mailboxes and do "ipurge" individually for each mailbox... There isn't any difference between an IMAP mailbox and a POP3 mailbox. So no. There was/is an extension to use some annotate data in ipurge's decision process, with that you could annotate people who're using pop3 but they could stop using pop3 and switch to IMAP at any time. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
--On May 23, 2006 8:37:45 AM +0200 Simon Matter <[EMAIL PROTECTED]> wrote: Cool, some of the patches look really interesting and I'm considering to include one or the other into my rpm packages. For example the statuscache patch seems very nice. Just to be sure, are there any license restrictions on the patches? I'd love to see some of the patches integrated upstream, it makes my own work easier :) Statuscache also piqued my interestDoes it give any win for POP3 clients? We've a *HUGE* number of Outlook users that have the terribly wrong idea that they just MUST poll every minute. That along with the seen state stuff would be a good thing for us. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
--On May 23, 2006 10:34:20 PM +1000 Robert Mueller <[EMAIL PROTECTED]> wrote: Statuscache also piqued my interestDoes it give any win for POP3 clients? We've a *HUGE* number of Outlook users that have the terribly wrong idea that they just MUST poll every minute. That along with the seen state stuff would be a good thing for us. No, it's only for IMAP clients and speeds up the STATUS IMAP command, it does nothing for POP3. I'm surprised you're having issues with lots of POP polling, generally POP is a lot less resource intensive than IMAP I always believed... Well being as the POP3d runs the mailbox list every time a client connects. :) It certainly would also help because a lot of our accesses are via webmail as well. Rob -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Routing messages to subfolders
Duplicate suppression. Messages with duplicate Message-ID's only get delivered once. --On May 26, 2006 10:44:40 AM +0200 Siqhamo Sifo <[EMAIL PROTECTED]> wrote: I run cyrus+postfix+fetchmail and i have a problem with mail routing to subfolders.Say , 4 example I have a mailbox user.test then I create user.test.linux and I assign the permission " p to anyone " 2 both folders i.e user.test and user.test.linux but when I send e-mail to [EMAIL PROTECTED] it only ends up in user.test not in user.test.linux. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: rsync /var/local/imap
No because you still have quota, mailbox database, seen state information, and sieve scripts to worry about. --On June 7, 2006 3:28:07 PM -0400 Michael Johnson <[EMAIL PROTECTED]> wrote: Hi all I'm looking for your experiences with combining two cyrus directories. Currently I have /var/local/imap and /var/local/imap2 on my machine because of some legacy stuff from an old machine and limited disk space. I'd like to combine the two directories into the /var/local/ imap one. I was hoping to rsync imap and imap2 together as /var/ local/imap and get rid of imap2 if I could. My plan so far: 1. Stop the IMAP server. (/etc/init.d/cyrus-imapd stop) 2. Run rsync /var/local/imap2 /var/local/imap 3. Check to see it worked. 4. rm -rf /var/local/imap2 5. Start the IMAP server. (/etc/init.d/cyrus-imapd start) Should this work as I want? Is there a better way to do this? -Michael --- There will always be those who dare to take great risks. Rather than mourn their loss, we should value their contributions. --Jesse Brown Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: OT: Mulberry for Unix anyone
If by the time I get home you don't have it I think I can put it upnot totally sure about the legality so I'll preface it with this is ONLY for users who legally obtained a copy before Cyrusoft went under but I have the following files from Cyrusoft: mulberry-4_0b4a-ppc.tgz mulberry-4_0b4a-rh6.tgz mulberry-4_0b4a-rh9.tgz mulberry-4_0b4a-sol8sp.tgz mulberry-4_0b4a-sol8x86.tgz Mulberry_v4_0_4.exe I also should have a copy of the Mac OS/X version installer too, I'm just not finding that right away here so I'm not going to commit to having it until I do find it :) --On June 8, 2006 3:00:34 PM -0600 "Eric S. Pulley" <[EMAIL PROTECTED]> wrote: --On June 8, 2006 2:59:37 PM -0600 "Eric S. Pulley" <[EMAIL PROTECTED]> wrote: Anybody got a link for a download location for Mulberry 3 or 4 for Solaris or Linux? There are a fare number of Universities that still have it but they restrict access to there DL servers. Thanks. -- There are only 10 kinds of people in this world: those who understand Binary, and those who don't. --- | Eric S. Pulley | | | Systems Administrator | /"\ ASCII Ribbon | | Hamilton Partners| \ / Campaign Against | |+1.801.297.7254 | X HTML Mail| | <[EMAIL PROTECTED]> | / \ | --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: What version of BDB are people using?
--On June 9, 2006 10:37:45 PM +1000 Robert Mueller <[EMAIL PROTECTED]> wrote: I'm just trying to get an informal survey of which version or Berkeley DB people are using successfully in large cyrus environments. We're currently using: db4-4.2.52-3.1 - old redhat based machines libdb4.2.52-18 - newer debian based machines Both of them seem to be a bit "flakey". We only use BDB for the deliver_db and use: duplicate_db: berkeley-nosync For the others we use the recommended skiplist (mailboxes, seen) or flat file (sub). I'm using slightly modified Cyrus 2.1.17 on a Woody with DB3 3.2.9-16 --- No problems at all using it with mailboxes, deliver, tls_sessions. No tweaks or other special configurations. Did/do have the occasional POP3 bind ups but that doesn't seem to be BDB relatedthough I haven't really tried that. POP3 bind ups -- occasionally, without reason, POP3 stops working. It never banners. I've been unable to reproduce it, and it requires a complete system reboot to recover, so it's something with saved state of somesort. I don't think it's BDB because that's all automatically recovered on restart so there shouldn't be a deadlock situation there between cyrus stop/starts. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: What version of BDB are people using?
--On June 12, 2006 3:06:15 PM -0400 Ken Murchison <[EMAIL PROTECTED]> wrote: http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/POP3DevRandomIssue Actually been over this on the list before. It's completely unrelated to that issue. It's not like some connections get through and some don't. It's completely unreproducible and *NO* POP3 connections get through at all until a reboot. It's not lack of entropy, as /dev/random is issuing plenty of random data during this time and apop isn't in use anyway. I don't think it's BDB related, though it could be, since when it happens it's just POP3 although it is *all* pop3proxyd's. I haven't had it happen in a while and I can't remember if I checked the pop3d and pop3proxyd, but I know that proxyd was locking. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Looking for a *good* X based GUI IMAP client for Cyrus IMAP ...
--On June 12, 2006 3:56:51 PM -0300 Andreas Hasenack <[EMAIL PROTECTED]> wrote: I would like to see an imap client who doesn't fetch all the headers from all messages available in a mailbox. It should fetch just the ones it can show at once plus a few dozens, and whatever messages are needed for threading purposes. This is precisely why I like, and use, Mulberry. Unfortunately cyrusoft went deep six somehow. -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Looking for a *good* X based GUI IMAP client for Cyrus IMAP ...
--On June 12, 2006 11:39:23 AM -0700 Nikola Milutinovic <[EMAIL PROTECTED]> wrote: --- Warren Turkal <[EMAIL PROTECTED]> wrote: On Saturday 10 June 2006 15:49, Daniel O'Connor wrote: > The least sucky email client I have tried so far is KMail. I have to concur. I use Kmail via Kontact almost exclusively. Any comment on Mozilla Thuderbird? Junk. Same as Outlook and many others, it's not an IMAP client at all. Just a NNTP/POP3 reader that can parrot IMAP. IE it has to download ALL headers in a mailbox...which is fine if you've only got a few hundred, but try dealing with this on a larger scale, or on a modem. -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: What version of BDB are people using?
--On June 12, 2006 5:46:51 PM -0400 "Greg A. Woods" <[EMAIL PROTECTED]> wrote: At Mon, 12 Jun 2006 14:39:14 -0600, Michael Loftis wrote: Actually been over this on the list before. It's completely unrelated to that issue. It's not like some connections get through and some don't. It's completely unreproducible and *NO* POP3 connections get through at all until a reboot. It would probably help an awful lot if you could figure out what minimally needs to be done to fix it _without_ a reboot. If the only thing that can fix it is a full reboot then it must be a kernel problem, not anything in any application. It's an app issue of somesort I'm pretty sure. Even though stopping/starting cyrus doesn't help. I can't remember the details though and I'm not sure if I posted them anywhere or not. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Mailstore filesystem
It would be nice to have more details about version of ReiserFS, what hash was being used, kernel version, hardware involved, and NFS or not (especially kernel NFSd)... That said we use ReiserFS on our mail and on our NFS servers running a 2.4.27 variant with about half a TB in NFS and about 120Gb in mail, no issues whatsoever. We did have an issue with the CX200 that caused some corruption in the NFS stores once, but that's resolved now. We were running old FLARE that caused the array to spit out multiple drives when it had a vault drive fail. --On July 3, 2006 11:12:01 PM +0200 Phil Pennock <[EMAIL PROTECTED]> wrote: On 2006-07-03 at 15:44 +0200, Daniel Eckl wrote: At the moment I have a temporary machine running the same system with reiserfs. While I still have the problem of occasional high load, the system now never freezes or hangs, just slowes down. On my private machine at home, I used ReiserFS until very recently; I had assumed that the negative publicity was scare-mongering based on historical problems and that by this time any problems would have been sorted out. I didn't believe the adage, "If you use ReiserFS and haven't lost data, then you haven't been using it for long enough." /home partition held regular /home, plus Cyrus IMAP content and a document repository updated nightly by rsync; the load is almost always trivial. Over-night, the load comes from: * occasional cron-jobs updating data; those should be read-only, storing to /var/, so irrelevant * the rsync of the documents * Cyrus IMAP mail deliveries and squatter, etc. It is rather disconcerting to see files which exist as directory entries but where the inode (or whatever its equivalent is) doesn't exist so that stat() fails. Race-conditions, fine, but this wasn't that. I bought an external HDD to spool the data off and migrated to xfs. Given this experience with a lightly-loaded system, I've joined the camp of "never use ReiserFS for production usage with data you value". I might consider using it for a Squid cache, I suppose. -- "Everything has three factors: politics, money, and the right way to do it. In that order." -- Gary Donahue Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Mailstore filesystem
I'd be very careful with softupdates. If you shut down uncleanly for any reason in the past it has caused *SEVERE* loss of data for me. Not just once, but many many times. It has gotten much better but I haven't put it to the test lately at all. --On July 10, 2006 10:17:57 AM -0400 Forrest Aldrich <[EMAIL PROTECTED]> wrote: For the record... what about file systems for the mail spool on non-linux systems, such as FreeBSD, et al. I've read a number of documents that addressed (classic) Usenet-based activity (applicable to cyrus) - most agree that FreeBSD UFS+SoftUpdates performs very well. Thanks. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: hardware recommendations for MURDER?
--On July 20, 2006 2:41:26 PM -0500 Phil Brutsche <[EMAIL PROTECTED]> wrote: Vincent Fox wrote: So lt looks like we are migrating our University to a murder setup. We are about 50,000+ users, with currently a number of mailstores (UWash) and users directly addressing them. We are looking towards adding new hardware for an MUPDATE box and some frontends. Anyone have recommendations on these? Sparc/Solaris versus X86/Linux? single-CPU versus duals? storage? I poked around in the mailing lists, didn't find anything really current. And we all know how our users email usage has gone up in the last couple of years. For the servers themselves I would go Linux on x86 using the hardware vendor of your choice. The back-ends would probably be better off with dual CPUs, but keep in mind that those will be *dual-core* dual-CPU systems. Go with an AMD Opteron or Intel 5100-series Xeon if you can, they'll give you better performance than the older stuff. It goes without saying that the disks should be SCSI/SAS, but the direct-attached SCSI vs SAN debate depends on how much ucdavis is willing to spend. IMO if you go with an iSCSI SAN you should definitely get a second physical CPU in each backend - without an iSCSI accelerator card like the Adaptec 7211C it's a CPU hog if you have heavy I/O, and accelerator cards that work outside of Windows are pretty rare. I don't imagine the front-ends would do a whole lot of heavy lifting, so a single CPU will be fine, but a dual-core CPU would be great if you're going to enable SSL. Depends on how you handle incoming mailFor us incoming mail gets a lot of Virus and SPAM checking done to it, and our incoming servers (right now) are shared with the frontends, so that uses quite a bit of CPU. OS-wise I would go with RedHat Enterprise or Novell's SuSE Enterprise, but if you are more of a *BSD guy that will work as well. -- Phil Brutsche [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: reconstruct while system is running?
--On July 25, 2006 3:37:43 PM +0200 "Heiling, Steffen" <[EMAIL PROTECTED]> wrote: Dear List, I'm just wondering if I can run "reconstruct -r" for all mailboxes while the system is running with mid load? I want to switch all mailboxes to a new server with more space and without a big downtime. I would do a sync (with replication) and after that, reroute connections with iptabels to the new server and start a reconstruct on it. Is it ok when users doing their imap-stuff while it's running? I don't want to stop the server because a complete reconstruct takes about 2 hours. Ah, and one second (stupid) question: ATM I'm running replication without UUID's. When I want to active it, I have to set the number on the production server to (e.g.) 1 and on the backup server to 2? In the docs it's not clear where to set the value (backend or replica). I'm not sure if your entire plan is safe, however, reconstruct is safe. An individual mailbox or folder just gets locked during the actual reconstruct. Note that it'll increase your I/O load by a pretty large amount during the reconstruct. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: reconstruct while system is running?
--On July 26, 2006 7:23:38 AM +0200 "Heiling, Steffen" <[EMAIL PROTECTED]> wrote: Zitat von Michael Loftis <[EMAIL PROTECTED]>: I'm not sure if your entire plan is safe, however, reconstruct is safe. An individual mailbox or folder just gets locked during the actual reconstruct. Note that it'll increase your I/O load by a pretty large amount during the reconstruct. Why isn't my plan safe? Currently there are 2 servers running. Same setup, and every night all stuff besides cyrus gets rsynced, and all the cyrus stuff I sync with replication. Both servers are running and when I login to the same accounts on both I'm seeing identical mailboxes (also seen-state). Is there a better/safer plan to migrate? I never said that it *wasn't* I just said I didn't know if it was. The two are not the same. I've not used the newer sync replication so I don't know any of the gotchas or anything like that. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: performance issue (imap spool on san)
--On July 26, 2006 12:02:41 PM +0200 Rudy Gevaert <[EMAIL PROTECTED]> wrote: Hi, I've installed the latest cyrus release and I'm having trouble with large mailboxes. I was going to try if the 4Gig limit is gone and I'm filling up a mailbox with mails. If I open the mailbox trough mutt it gets loaded at a acceptable (lighting fast) speed. However when using thunderbird it gets very slow, I haven't been able to open the mailbox of 294M. This is a thunderbird problem, not a Cyrus problem. Thunderbird is NOT an IMAP client. It's a POP3/NNTP reader, that's been taught to badly parrot IMAP. It attempts to download and locally index *all* headers. This means that for large mail stores, it'll take a LONG time to figure out whats going on, and lots and lots of RAM too. And this is all on the Client. <...> The above logs are only an extract of the output. These messages are going in slow bursts. The imap spool and configdirectory are on a SAN. How can I further debug this? Your SAN is fine, your client is the problem. Unfortunately since Cyrusoft went under (they made Mulberry) aside from Mutt and Pine I don't really have any suggestions for loading large mailboxes. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: performance issue (imap spool on san)
--On July 26, 2006 9:31:40 PM +0200 Daniel Eckl <[EMAIL PROTECTED]> wrote: Hi Michael! Thunderbird is NOT an IMAP client. <...> The first time you open a large IMAP folder is not very fast, I have to admit, but I didn't find any other comparable IMAP client without this problem. Perhaps there are some, but I didn't try them because of the lack of other basic email features. This is why they aren't IMAP clients. IMAP servers make all manner of searching, sorting, retrieval, and storage options completely available to the client, without having to download even all the headers. This is why Mulberry, Pine, Mutt, and Kmail are so much faster. If TBird would just do that instead of insisting on blindly attempting to download all the headers and performing all sorting and searching on the client. TBird and most of the others have their roots and brains seated back in the POP3 dark ages near as I can tell and that's how they treat all mail stores. IMAP allows the clients to easily ask for threaded views (unless you turn the index options off or something like that) from the server, as well as partial sets of headers in batch. This massively speeds things up when you're on a modem, or working with large mailboxes, or mailboxes you only occasionally open. I'm not trying to start a flamewar either, I'm stating the observed behavior. They're not IMAP clients. They speak IMAP but they make no real use of the protocol. I really do wish there were more better clients out there, there aren't. I totally agree with you there that Pine and Mutt are not a replacement for a GUI client. I've never used Kmail extensively though. Anyway: I'd happily listen to other suggestions for full featured graphical IMAP clients which could be better than thunderbird. There surely are things in thunderbird which could be a lot better! I just need an alternative which I was not able to find yet. I haven't found one other than Mulberry either. It seems developers widely assume you're not on a modem anymore, which for me is all to often not the case. It's faster for me to use SquirrelMail, IMP, or Horde than to use TBird when I don't have access to Mulberry. The size in MB of the folder has little to do with IMAP client speed, it's mostly the number of files. Older versions of EXT3 (before they added directory hashing support) had pretty terrible performance in this regard. I don't use Ext3 much of anywhere anymore but I know there are some documents on how to enable that in l later model Linux kernels. It may or may not help your mail spool performance. It's doubtful TBird/etc will ever load a mailbox with 20-30k+ messages in a very fast manner on first open unless they start to implement and make use of the IMAP extensions for partial loading combined with a local header cache as the view is scrolled. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: About *good* IMAP clients
--On August 20, 2006 11:21:36 AM +0200 Sebastian Hagedorn <[EMAIL PROTECTED]> wrote: -- Kamijo <[EMAIL PROTECTED]> is rumored to have mumbled on 20. August 2006 08:54:04 +0200 regarding About *good* IMAP clients : I've got a mail today saying that Mulberry is back. http://www.mulberrymail.com/ Not only is it back, it's free! So good riddance to Thunderbird. Who needs you when there's Mulberry. Wow! ROCK! Thanks for pointing this out Sebastian! Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Usernames with "+" in it
That will likely prove to be far more trouble than it's worth. Both Cyrus and most Unix MTA's treat + as a seperator/extender, so info+example.com == info (but tells cyrus to try to file it into the example.com folder if permissions allow) It's certainly possible to login as that user, the problem comes in delivery, you'll need to change or disable the + separator in your MTA and in Cyrus. Then you can have usernames with + in them. Better though to just follow the 'de facto' standards, use .'s as separators in usernames. --On September 6, 2006 3:51:01 PM +0200 Sven Lepiorz <[EMAIL PROTECTED]> wrote: Hi, we have to take over all mailboxes from an other provider to our own server. The login names on the old provider is nearly the full email address but with a "+" instead of "@", i.e. info+example.com. How can i deliver mail to such a user? Or is it possible to login with the username info+example.com but act as an other user? Sven Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Sieve only for lmtp?
It most definitely is not since IMAP isn't a mail delivery protocol. LMTP applies the Sieve rules during delivery. --On September 28, 2006 10:10:36 PM + Ross Boylan <[EMAIL PROTECTED]> wrote: Is sieve involved with mail delivered directly via IMAP? I think not (the docs say "Sieve is a mail filtering language that can filter mail into an appropriate IMAP mailbox as it is delivered via lmtp."), but I want to double-check. I'm using cyrus 2.2. Thanks. -- Ross Boylan wk: (415) 514-8146 185 Berry St #5700 [EMAIL PROTECTED] Dept of Epidemiology and Biostatistics fax: (415) 514-8150 University of California, San Francisco San Francisco, CA 94107-1739 hm: (415) 550-1062 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Failing to authenticate on the frontends
--On October 4, 2006 4:18:41 PM +0100 Jesus Roncero <[EMAIL PROTECTED]> wrote: <...>> So, the question is, isn't the frontend supposed to contact the backend responsible of that mailbox in order to authenticate the user? or it needs to have "joe"'s password at the frontend as well? Authentication of the user happens at the frontend. The frontend then uses the proxy credentials to authorize as the user on the backend. The backends don't need a full user database, just the proxy information. Best wishes. -- Jesus Roncero <[EMAIL PROTECTED]> System Developer Tel: +44 (0) 845 666 7778 http://www.mxtelecom.com Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Failing to authenticate on the frontends
--On October 4, 2006 10:17:46 AM -0700 Andrew Morgan <[EMAIL PROTECTED]> wrote: On Wed, 4 Oct 2006, Michael Loftis wrote: --On October 4, 2006 4:18:41 PM +0100 Jesus Roncero <[EMAIL PROTECTED]> wrote: <...>> So, the question is, isn't the frontend supposed to contact the backend responsible of that mailbox in order to authenticate the user? or it needs to have "joe"'s password at the frontend as well? Authentication of the user happens at the frontend. The frontend then uses the proxy credentials to authorize as the user on the backend. The backends don't need a full user database, just the proxy information. Yes and no. If an IMAP client support referrals, the frontends will return a referral to the appropriate backend. So, the client may connect to the backend as well in some cases. Oops, I forgot about that detail. We locally patched referrals out of our IMAP proxies. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Failing to authenticate on the frontends
--On October 5, 2006 10:30:55 AM +0100 Jesus Roncero <[EMAIL PROTECTED]> wrote: Umm, isn't there an option on the configuration to disable referrals? If not, do you have that patch available? Not in 2.0.x for sure. Maybe in newer releases. We're running a 'very old' release of Cyrus here. Also, one question on the communication between the frontends and backends. I made them speak using TLS and plain, but would like to use CRAM-MD5 or DIGEST-MD5 and no TLS at all. Is that possible? Because when I disable TLS and force it to use the MD5 thing, the frontend complains that there are no mechs available. -- Jesus Roncero <[EMAIL PROTECTED]> System Developer Tel: +44 (0) 845 666 7778 http://www.mxtelecom.com -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Failing to authenticate on the frontends
--On October 5, 2006 11:42:36 AM +0100 Jesus Roncero <[EMAIL PROTECTED]> wrote: Umm, I got it to work using DIGEST-MD5, but apparently, all communications are encrypted after the authentication. Is there a way in which all the communications between the frontends and the backends are *not* encrypted, except, probably, the authentication dialog? I guess that's what CRAM-MD5 is for, but the frontend refuses to talk to the backend if it is presented with CRAM-MD5 only. Is there any way to do this or I am doing something really wrong? :) See earlier in this thread. It's not at all possible in stock Cyrus. You have to patch it to allow that. I've got one for older versions of cyrus, 2.1.17 ish, but they'll need cleanup. Thanks to Henrique de Moraes Holscuh who provided me with them. 1813.patch Description: application/text Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus, Solaris 10, ZFS? (and NIS?)
--On October 5, 2006 4:46:54 PM -0400 Chaskiel M Grundman <[EMAIL PROTECTED]> wrote: mynewstate is taking 8s to run, and very little of the time is taken up in local subroutines. auth_unix.c:mynewstate calls getpwnam, and then iterates over all the groups using getgrent(), checking to see what groups the user is in. The fact that imapd does this twice might be a bug, but even if it didn't do it twice, it would still be slow. Is running "getent group" slow? We had to patch this out of our Cyrus frontends using LDAP as well because it iterates instead of retrieves. We just decided not to support groups in the ACL's. I'd suspect this is exactly whats going on is this code is still there in latest Cyrus and it's building the ACL representation. If you don't care about groups you can find, and remove, that code as we did. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: very slow syncing, any ideas?
--On October 19, 2006 8:10:13 PM +0200 Marten Lehmann <[EMAIL PROTECTED]> wrote: Hello, I'm about to migrate several thousand mailboxes from Maildir to Cyrus using the tool imapsync. It does its job very well and when I tested the migration on a small development server it was very fast. But now on the production system the synchronisation is very slow with a maximum of one message per second (and we have gigabytes of messages in the storage, partically > 10,000 messages per mailbox!). The general load of the system isn't very high, maybe a load average of 30. I disabled the duplicate message suppression. The mailboxes.db is about 8 megabytes big with approx. 13,000 mailboxes and 4 default folders each (Drafts, Junk, Sent, Trash). Uhm... LA of 30 is very high. What OS? I assume Linux, vmstat 5 will tell you where you're hitting the wall, but unless you've got an 8 CPU machine LA 30 is rather quite high. Linux LA is a measurement of processes blocked on I/O, processes running and processes waiting to run on a CPU. -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: very slow syncing, any ideas?
--On October 19, 2006 11:25:07 PM +0200 Marten Lehmann <[EMAIL PROTECTED]> wrote: Hello, Uhm... LA of 30 is very high. What OS? I assume Linux, vmstat 5 will tell you where you're hitting the wall, but unless you've got an 8 CPU machine LA 30 is rather quite high. Linux LA is a measurement of processes blocked on I/O, processes running and processes waiting to run on a CPU. yes, Linux (2.6.9, RHEL4): Looking at taht i'd say you're VERY badly CPU bound. a simple dd/cp doesn't do anything to the mail but IMAP ops will require some CPU workCyrus also will probably be forcing syncs but your I/O load doesn't look that high (my mfe's run more I/O and they're not storing any mail, just logs and temporary files for virus/spam scanning heh, and they only have a little IDE HDD each) the numebrs in the procs->r column indicate you've got a lot of processes vying for CPU time. the b column indicates you've got a little bit of blocking going on. Processes in the 'D' state may show up in ps or top output (doubtfully top unless you change the default sort). I'd guess you're being CPU bound and cyrus is probably running (usually does by default) at a bit lower priority than your interactive cp operations. 2.6 kernel scheduler does a lot of weird stuff if it determines you're interactive, and then tends to give you priority over daemons. it's very non-deterministic, but I don't think you're running into this. quite likely some inefficiencies in the cyrus code (or intentional backoffs?) but mostly just being CPU bound. I know our MBEs can generally scp or rsync quite a bit faster than they can perform a XFER/RENAME command that moves between mail store servers (IE MURDER host to MURDER host). Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: japanese headers getting corrupted
Check the actual mail spool files. Chances are it's not Cyrus but your mail client. Most windows machines don't have the required fonts to render Japanese. --On November 2, 2006 8:40:59 PM +0530 Ramprasad <[EMAIL PROTECTED]> wrote: I have cyrus-imapd-2.2.3 on FC1 When mail is delivered from postfix to cyrus , via unix lmtp some mails with japanese characters in headers ( from: and Subject: ) get changed The headers get replaced with "XX" ( non-ascii chars become X ) but the body is not changed at all something like this Reply-To: "XXXc X^XX" <[EMAIL PROTECTED]> From: "XXXc X^XX" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Subject: XX Do I have to do any setting to allow japanese characters ? Thanks Ram Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- "Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds." -- Samuel Butler Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: DB_CONFIG
--On Saturday, December 04, 2004 04:11 +0200 ocl <[EMAIL PROTECTED]> wrote: Andreas Hasenack wrote on 2004-12-03 14:12: On Fri, Dec 03, 2004 at 12:53:13AM -0500, Igor Brezac wrote: You need to run the command from cyrus configdirectory/db or db_stat -m -h configdirectory/db. And it has to have a DB environment (aka, those __db* files). Now, I am really confused. What do you mean by 'DB environment'? I keep getting these messages in system log ctl_cyrusdb[5750]: DBERROR db4: /DB_CONFIG: line too long There's your answer. Take a look at DB_CONFIG. It's a plain text configuration file. ctl_cyrusdb[5750]: DBERROR: dbenv->open '/var/lib/imap/db' failed: Invalid argument ctl_cyrusdb[5750]: DBERROR: init /var/lib/imap/db: cyrusdb error By 'env' it means the DB Environment *NOT* the environment variables/shell variables. Totally separate concepts. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: DB_CONFIG
I highly doubt your deliver.db, mailboxes.db, and everything all combined are even more than 1Gb. First rule of system tuning, don't just turn everythign to the max because it sounds better. Heck under 32-bit you CAN'T access more than 2Gb by default anyway in cache. Since it's a 2/2 split. There are patches to produce other splits, but htats the default. --On Saturday, December 04, 2004 05:02 +0200 ocl <[EMAIL PROTECTED]> wrote: I am sorry, I posted too early. I think I am getting somewhere, but not quite there yet. This is the contents of /var/lib/imap/db/DB_CONFIG set_cachesize2 0 8 set_lg_regionmax 268435456 set_lg_bsize 67108864 set_flags DB_TXN_WRITE_NOSYNC IOW, I am going for -- cachesize of 2 GB in 8 buckets. -- regionmax of 256 MB -- bsize of 64 MB I have 8 GB RAM on this machine, I want to have /large/ allowances for BDB --just to be on the safe side. Trouble is, I have no idea what /safe side/ means in this context. What complicates the issue more is the result of 'db_stat -m', which reads as below. Now, where is my 2GB cache? 259KB 896B Total cache size (266112 bytes). 1 Number of caches. 270336 Pool individual cache size. 52664 Requested pages found in the cache (100%). 0 Requested pages mapped into the process' address space. 229 Requested pages not found in the cache. 0 Pages created in the cache. 229 Pages read into the cache. 259 Pages written from the cache to the backing file. 2 Clean pages forced from the cache. 166 Dirty pages forced from the cache. 0 Dirty buffers written by trickle-sync thread. 63 Current clean buffer count. 0 Current dirty buffer count. 67 Number of hash buckets used for page location. 52851 Total number of times hash chains searched for a page. 5 The longest hash chain searched for a page. 80851 Total number of hash buckets examined for page location. 119878 The number of region locks granted without waiting. 1 The number of region locks granted after waiting. =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Pool File: /var/lib/imap/tls_sessions.db 4096Page size. 44 Requested pages found in the cache (96%). 0 Requested pages mapped into the process' address space. 2 Requested pages not found in the cache. 0 Pages created in the cache. 2 Pages read into the cache. 9 Pages written from the cache to the backing file. =-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-= Pool File: /var/lib/imap/deliver.db 4096Page size. 52620 Requested pages found in the cache (100%). 0 Requested pages mapped into the process' address space. 227 Requested pages not found in the cache. 0 Pages created in the cache. 227 Pages read into the cache. 250 Pages written from the cache to the backing file. Cheers, Ray --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Disabling PURGE/DELETE
Remove the 'd' ACL, and probably the 'a' ACL as well from the users mailboxes. However this isnt' the solution your'e looking for. You want to do backups. --On Saturday, December 04, 2004 19:37 +0200 ocl <[EMAIL PROTECTED]> wrote: Hi, We have had an employee delete all his mails and then leave the company. Now, the management is asking me to make it impossible for mail users to delete any mails. We do have an 'archive' mailbox which --in a way-- serves this purpose but, it is not the same thing: It does not have the same folder structure the user has, it is a lot of work to recreate a mailbox that contains that particular user's mailbox. Getting the stuff back from a backup does not necessarily mean an easier task, because I have no idea when an important mail has been deleted. In short, despite all its potential drawbacks, I would very much like everyone *not* to be able to delete (purge) any mail at all. Can it be done? If so, how? Cheers, Ray --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Problem moving cyrus installation from 32 -> 64 bit system
--On Saturday, December 11, 2004 03:30 +0100 Palle Girgensohn <[EMAIL PROTECTED]> wrote: Hi! I'm trying to move an entire cyrus installation from FreeBSD 4.10 on IA32 (aka x386) to a new Dell 2850 running FreeBSD 5.3 (amd64, or really EM64T). I use DB3, 3.3.11, on both machines. Cyrus imapd 2.2.8 on the old one, 2.2.10 on the new one. I've dumped/restored /var/imap & /var/spool/imap to the new system. The db3 files, deliver.db and tls_sessions.db, I had to db_dump @ old system && db_load back on the new system; it seems db3 uses a native format that differs between 32 & 64 bit, ctl_cyrusdb -r crashed signal 11 otherwise. I don't recall offhand if cyrus automatically re-creates them but both tls_sessions.db and deliver.db are (fairly) safe to zero out, tlse_sessions.db is definitely, and deliver.db is mostly safe. deliver is use to de-duplicate messages. Hence why it is purged of entries older than N days (I use 3, others may use more or less) --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Question about lmtp.lock
--On Monday, December 13, 2004 10:38 -0500 David G Mcmurtrie <[EMAIL PROTECTED]> wrote: We've installed cyrus imapd 2.1.17 on a 4-node Veritas cluster and we're now testing it. Our /var/imap filesystem is on a clustered filesystem. We noticed that all of the lmtpd processes are just sitting in a blocking fcntl() call waiting for a lock on /var/imap/socket/lmtp.lock. When we run this in a clustered environment, each lmtpd is consuming CPU resources while blocking. In a non-clustered ufs environment they do not. Is there any reason that the lmtpd processes need to be serialized across different nodes in a cluster? If not, we'll just write these lock files to local ufs space on each cluster node. There are a number of different lockfiles that cyrus uses during it's lifecycle. Though one thing you need to know is that it is not designed to run like you're attempting to run it. Each cyrus instance is meant to be standalone, and running them all from a shared disk could very likely cause mailbox corruption, as well as skiplist corruption for the seen/subs entries and such. The only part of cyrus that may be multi-node from same storage safe is the BerkeleyDB stuff used for the mailboxes and deliver DBs. Take a look at MURDER, that's what you'll want if you want to cluster Cyrus. MURDER+heartbeat with a shared storage medium provides for failover (heartbeat is a separate, generic failover package). While I'm on the subject, what is the purpose of /var/imap/socket/imap.lock? Thanks, --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Messages lost
--On Friday, December 17, 2004 17:21 +0100 Jimmy Karlsson <[EMAIL PROTECTED]> wrote: Hi! Noob question, I have very little experience with Cyrus and may have misunderstood everything. I have a problem with Cyrus losing messages (or I have misunderstood the log). The following three messages was simply lost. The common thing is that none of them have any message id set, I have checked my Exim log and the id's are missing at arrival. As noted by soemone else more versed in Exim you need to reconfigure Exim so it does the right thing and adds message-id's. Furthermore IMAP clients may not be able to locate a message without a message-id, nor a message with a non-unique message ID -- depending on how the IMAP Client chooses to access the folders. Cyrus is capable of storing duplicates, but by default does duplicate delivery suppression (a good thing, really). The only time you may run into problems are situations like these, with broken MTAs or MUAs. It's better now, Outlook/Microsoft OLE stuff at one time would only generate one message ID per day or per boot -- I never really figured out which. I discovered that one by accident while using UW-IMAP back in the day. There were also atleast two other broken Windows MUAs and probably 2 or 3 Unix ones. They all seem gone now though, thankfully. Anyway, just my $0.02 --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Large email account
--On Monday, December 20, 2004 16:14 -0800 Prasanna Buddhika <[EMAIL PROTECTED]> wrote: Hi, I have win2000 server running exchange 2000 server. There are 2 large email accounts (70 emails in a single account) which we don't want to delete. But I want to move these 2 accounts to Linux machine with cyrus-imap server. Migration went very well. Only problem is the speed. When the 2 mail accounts on the exchange server and when I use exchange method to access the account via Microsoft outlook client it won't take even 1 minute to show all the massages. But if I use cyrus-imap to retriew (sync) the email it takes 30 minutes. But after sync itÂ’s fast. Only problem is when ever I logged off the system and log back in to the system again I have to wait 30 minutes to access the mail. Can anyone have a good suggestion to speedup this apart from deleting emails.:) Ditch outhouse, get a real MUA. Mulberry does really well with large message stores, not sure about others offhand. Hell even PINE does better than Outlook. The problem is Outlook speaks Exchange, and POP. It doesn't do IMAP, nor does Thunderbird/NetScape. I can hear you all screaming 'BUT THEY SPEAK IMAP!' -- no they don't. If they spoke IMAP they wouldn't' need to 'syncronize' at all. They use IMAP to download ALL the message headers. And then they work it like a regular local mail store, except the bodies point off to the IMAP system. Mulberry (Again Mulberry and PINE are the only two I can think of offhand that do it RIGHT, not to say that there aren't others!!!) will let the server do the work, and the server has Indices. I can open basically unlimited size mailboxes instantly. Mulberry and PINE both just as for the messages inside the view range. Running a current enough version of Cyrus threading is even done server side. Searches are always done server side. Outlook is not an IMAP client AFAIC. It's a POP client that's been botched to try to use IMAP, same with T-bird. Given a choice I'll still use T-bird over Outlookbut given my free reign, I'll use something else. Ohh yeah Evolution is one that I think does it right too...can't remember I'll have to ask one of my coworkers. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Large email account
--On Tuesday, December 21, 2004 07:59 +0100 Simon Matter <[EMAIL PROTECTED]> wrote: The nice thing about Thunderbird is that it works fine. Same goes for recent kmail versions. Mulberry and PINE may do it better, but they don't look better. That'd be a significant change for the better if T-bird finally did it right. I'll have to ask the T-bird users at the office to get ahold of the latest version an see. I know the last time most of them upgraded they still couldn't look into our support archive easily (20k+) because it'd sit and try to pull down all the headers instead of doing it right and just asking for the ones around where it was. It's not that I ever disliked T-bird as a mail client, it's that it's IMAP behaviour was exactly as if it were an NNTP server. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Software Quality rant (was Re: Large email account)
--On Tuesday, December 21, 2004 08:53 -0200 Henrique de Moraes Holschuh <[EMAIL PROTECTED]> wrote: On Tue, 21 Dec 2004, Simon Matter wrote: The nice thing about Thunderbird is that it works fine. Same goes for recent kmail versions. Mulberry and PINE may do it better, but they don't look better. We are talking Unix here (industrial strenght tools, focus on doing things right, etc) or are we talking "Microsoft-based Professional Software" here (the "MAIL FROM: [EMAIL PROTECTED]" crowd)? Not that Thunderbird is that bad. It is *not*. But it really saddens me to see more and more developers get caught on the "pretty is more important than functionality" mentality. This has nothing to do with Thunderbird. And I have to agree with Henrique here, and not just because he keeps Cyrus backported for my older Woody installs :) Working at a web host we deal with all of the major PHP packages. I won't name any names, but most of them are pretty poorly written. Riddled with bugs and security holes. Because they're written to do one thing, look pretty. Security is bolted on as an afterthought. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Where's my mail???
MY first and most obvious suggestion is to check your logs. In particular
/var/log/maillog as it's called on RH. See what they say about the
disposition of the daemons and the mail, and go from there. Unix does a
good job of telling you whats going on if you check log files, unlike
Windows.
--On Monday, January 10, 2005 11:45 -0500 Thomas Kessler
<[EMAIL PROTECTED]> wrote:
O.K. here's the deal, I'm a Cyrus newbie and I am so close to getting
everything working correctly, but there is something wrong and I don't
know what it is. Here is my situation:
I'm trying to use sendmail and cyrus together. I am on Fedora 3. I'm
using the packaged sendmail and cyrus. I setup my mail accounts using
cyradm. I can send mail out, but am unable to receive mail. I can log
into my IMAP account, but there is never any mail??? Please help me!!!
Here are all the different files I setup, let me know if there is
something missing or wrong:
system.conf
***
local6.debug /var/adm/imapd.log
auth.debug /var/adm/auth.log
***
imapd.conf
***
configdirectory: /var/lib/imap
partition-default: /var/spool/imap
admins: cyrus root
sievedir: /var/lib/imap/sieve
sendmail: /usr/sbin/sendmail
hashimapspool: true
sasl_pwcheck_method: saslauthd
sasl_mech_list: PLAIN
tls_cert_file: /usr/share/ssl/certs/cyrus-imapd.pem
tls_key_file: /usr/share/ssl/certs/cyrus-imapd.pem
tls_ca_file: /usr/share/ssl/certs/ca-bundle.crt
allowanonymouslogin: no
xinetd.conf
defaults
{
instances = 60
log_type= SYSLOG authpriv
log_on_success= HOST PID
log_on_failure= HOST
cps = 25 30
}
disable = no
includedir /etc/xinetd.d
imap stream tcp nowait cyrus /usr/lib/cyrus-imapd/imapd imapd <
what does this line do?
*
is it correct???
hosts.allow
*
cyrus-imapd: 192.168.1.2: ALLOW
*
sendmail.mc
*
define(`confLOCAL_MAILER', `cyrusv2')dnl MAILER(`cyrusv2')dnl
MAILER(local)dnl MAILER(smtp)dnl
*
cyrus.conf
*
I did not touch this file. Just left it as the default setup
*
When I run tests everything seems fine:
telnet
*
[EMAIL PROTECTED] /]# telnet server imap
Trying 127.0.0.1...
Connected to localhost.localdomain (127.0.0.1).
Escape character is '^]'.
* OK server.audiocollagerecordings.com Cyrus IMAP4
v2.2.10-Invoca-RPM-2.2.10-3.fc3 server ready
*
imtest
*
[EMAIL PROTECTED] ~]# /usr/lib/cyrus-imapd/imtest -m login server
S: * OK server.audiocollagerecordings.com Cyrus IMAP4 v2.2.10-Invoca-
RPM-2.2.10-3.fc3 server ready
C: C01 CAPABILITY
S: * CAPABILITY IMAP4 IMAP4rev1 ACL QUOTA LITERAL+ MAILBOX-REFERRALS
NAMESPACE UIDPLUS ID NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND
BINARY SORT THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE IDLE
STARTTLS LISTEXT LIST-SUBSCRIBED X-NETSCAPES: C01 OK Completed Please
enter your password:
C: L01 LOGIN root {10}
S: + go ahead
C:
S: L01 OK User logged in
Authenticated.
Security strength factor: 0
**
--
Undocumented Features quote of the moment...
"It's not the one bullet with your name on it that you
have to worry about; it's the twenty thousand-odd rounds
labeled `occupant.'"
--Murphy's Laws of Combat
---
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: POP3d not usable - how to debug?
--On Monday, January 24, 2005 14:53 +0100 Marcel Karras <[EMAIL PROTECTED]> wrote: Hello, I've got some problems with pop3d. My IMAP configurations works well and is still in productive use but my POP3/POP3s services aren't working. Whenever I connect to either port the pop3d child process will be created and seems to stay alive to infinity. The client itself won't get any response. Neither a server identification message will be shown nor will there be any chance to get out of the loop. The client process stays connected (on TCP/IP stack) but doesn't transmit any data to the client - there will be nothing and the client waits till timeout. Could someone help me solving the problem. I just tried to configure debug_command to "/usr/bin/strace -o /var/log/pop3d.log", but /var/log/error tells me that strace exited with code 256. The other log files aren't helpful. Just for kicks, try rebooting. I'm running a large site and have been chasing a very intermittent pop3d gremlin that causes pop3d to hardlock while all other services are fine. only thing that clears it is a complete reboot. we can go for months without a single one, then have three in a day. i can't find a single bit of reason or logic for it. i'm hoping one of these times i'll catch it with some time to look at it in gdb. but last time i tried it under gdb it worked fine -- but only the process under gdb heh. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: POP3d not usable - how to debug?
--On Monday, January 24, 2005 13:59 -0200 Andre Nathan <[EMAIL PROTECTED]> wrote: On Mon, 24 Jan 2005, Marcel Karras wrote: Like already mentioned: All works well exept pop3d. It is reproducable but I can't figure why. How do you define debug_command to get gdb into the game? Just setting it to "/usr/bin/gdb" won't be useful to me because the only output I'm getting is: gbd exit status (0). I had this same problem this morning, and found that this was the reason: http://www.mail-archive.com/info-cyrus@lists.andrew.cmu.edu/msg10338.html A "cat /dev/random" would just block. Rebooting solved it for me, though. YEah I'm aware of that, it'd block until more entropy was available, but we use urandom to get around just that. Not sure what the problem is but it ONLY affects pop3 (both variants) --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: rm'd the account instead of dm
My previous message was meant to read as 'educate them first or just dont let them try to admin your box' rather than to imply anything else, sorry. A little sick and just had a BAD emergency here. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: rm'd the account instead of dm
reconstruct/cyrreconstruct.if you rm or rm -rf a mailbox you need to recreate the tree manually (mkdir) ctl_mboxlist -d |grep user.blah to find all their mailboxes, once you've crecreated them int eh foilesystem with the right permissions you can use reconstruct to reconstruct the cyrus.* files. the best thing is to not let incompetent people onto the server in the first place ;) --On Saturday, February 19, 2005 16:27 -0800 Eric Wagar <[EMAIL PROTECTED]> wrote: > And, when I try to sam the user.ericwa mailbox, sam returns: > localhost> sam user.ericwa cyrus +all > setaclmailbox: root: +all: System I/O error > When I look in the SYSLOG of the system, I find: > Feb 19 14:49:35 3W:hades imapd[18944]: IOERROR: opening > /var/imap/user/ericwa/cyrus.header: No such file or directory > which would correspond to me doing an rm instead of a dm. IMHO the easiest way to correct this would be: - create another cyrus account - mkdir /var/imap/user/ericwa - change owner and group to whatever your cyrus uses - copy /cyrus.* to /var/imap/user/ericwa - reconstruct -r user.ericwa - delete both mailboxes I tried this. And, I came out with the same errors as before. So, since Iam the only user on the system, at the moment, I deleted the mailboxes.db. I only like this solution because it is me on the system, and no one else. What are the other options for when I install Cyrus onto the real mail server? I don't want someone else to make the mistake I made. Thanks for the help! eric --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Could not connect to socket /var/run/imap/lmtp
Looks/sounds like a deadlock problem on a berkeleydb... db2+ have a utility called db_deadlock -- I'm not sure but you might just need to update/upgrade your version of berkeley though. db_deadlock and use with cyrus I havent' tried, but that may solve your problem. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Playing with replicated murder
--On Thursday, March 03, 2005 16:59 +0100 Christoph Moench-Tegeder <[EMAIL PROTECTED]> wrote: Hi, my employer wants to spend some money and buy a cluster filesystem for our IMAP servers (not that we currently need it, with only about five thousand active users on the largest server). The powers that be want to have "high availability" and "load balancing" (what load?). This sounds like a replicated murder to me. We already do have a SAN (fiberchannel and some spare gigabytes on an EMC) and a cluster filesystem (currently we are evaluating Polyserve, has anyone had some experience with psfs?). I am a little confused over the location of configdirectory, some of its contents (like the DB environment, the socket und the proc directorys) should be kept per node (I believe), while others (as quota files) should be shared between nodes. What about the replicated mailboxes.db? What am I missing? Two Cyrus can not use the spool concurrently at present. MURDER provides only for load distribution. Replication/failover has to be done seperately 'somehow' Basically the only thing you can do is active/passive setup, as active/active for a given backend is NOT supported in current MURDER. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Playing with replicated murder
--On Friday, March 04, 2005 00:03 +0100 Christoph Moench-Tegeder <[EMAIL PROTECTED]> wrote: ## Michael Loftis ([EMAIL PROTECTED]): Two Cyrus can not use the spool concurrently at present. That's true for the stable distribution, but we are testing (and only testing) with code from CVS. I was not clear on that. Our production servers do run 2.2.12 and are running fine. Sorry, my assumption you were running stable :) Let us know how it goes, I'm interested in this -- I have a somewhat similar setup with my current MBEs backed by an EMC Clariion CX200. Good luck with it :) --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Rebuild cyrus quotas?
Well there's definetly a quota bug, not sure how/what/where but my quotas are not decreasing on our 2.1.17 Cyrus MURDER cluster. I've got a user who I know to have freed up atleast 300+MB of his 1gb quota, and i can see there is only about 500 or 600MB of data in his entire mail tree (including indices). Cyrus reports 900+MB and NEVER went down for all the stuff we deleted from the account so obviously it's broken. Short term i need to reconstruct atleast this users quota obviously, and probably let the machine chug through and get everyones. How to do this? anyone? -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Message-IDs in Sent Items folder from Exchange
--On Tuesday, March 15, 2005 13:26 -0500 David Base <[EMAIL PROTECTED]> wrote: We've recently migrated mail from Exchange to Cyrus IMAP. All went well (I think, so far), except messages moved from the Exchange Sent Items folders don't have Message-IDs in their headers. The problem is that our sort-of-custom java mail imap client needs to see Message-IDs. I'm toying with the idea of writing a script that inserts unique MessageIDs in the headers of the Sent Items messages that don't have them, but I'm wondering what effect this might have on the cyrus.cache, cyrus.headers, and cyrus.index file in the Sent Items directories. Anyone know if this is do-able? Would I then have to reconstruct the user/username/Sent Items directories? If you make any changes to the underlying files yes you will need to do a reconstruct on the affected folders. You may also have to do a quota reconstruct as well. Got to love crappy exchange servers, always breaking something. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Problem while deleting mailbox on a private spool on NFS
--On Tuesday, March 15, 2005 6:55 PM +0100 Christophe Boyanique <[EMAIL PROTECTED]> wrote: hello all, I have two Cyrus IMAP server strictly identical. One with a local spool and another one with a private spool on a NFS server. Don't use Cyrus over NFS. It's not safe. You *WILL* end up with corrupt mailboxes. There might be some NFS Client+Server combinations that are safe, but since you've a Linux client I'm guessing your NFS server is also Linux, a known not-safe configuration. The reason is file locking doesn't' really work on NFS. The Cyrus IMAP server are version 2.1.17-3 on Debian Sarge. When I delete a mailbox (via cyradm for example), the mailbox directory is not deleted on the server with the NFS spool; but the content of the mailbox is deleted (including the cyrus.header, cache et index). On the server with the local spool, the mailbox folder is correctly deleted. Is this a known problem ? Christophe. -- Undocumented Features quote of the moment... "It's not the one bullet with your name on it that you have to worry about; it's the twenty thousand-odd rounds labeled `occupant.'" --Murphy's Laws of Combat --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: rollback to archiving checkpoint? Need help!!
I should also add the logs are not for rollback purposes, they're for consistent recovery of the system to a known working state, IE to recover from unclean shutdowns. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: rollback to archiving checkpoint? Need help!!
--On Monday, April 04, 2005 23:22 +0200 Alex Meier <[EMAIL PROTECTED]> wrote: Hi, list! is there a possibility to rollback the cyrus databases to a recent checkpoint? As I have understood the mechanisms, there is a archiving checkpoint process which stores the changes to the mail database to a log. How does this work? Is it possible to rollback a few hours? Only the folders database, possibly duplicates, and some other things are in that, and then only if you're using Berkeley DB instead of say skipdb or one of the other options. So no, unless he was taking backups, he just screwed himself. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: rollback to archiving checkpoint? Need help!!
--On Tuesday, April 05, 2005 5:38 AM +0200 Alex Meier <[EMAIL PROTECTED]> wrote: (this is actually response to Jules Agee's posting as well, but as en email cannot have multiple addressees...) I should also add the logs are not for rollback purposes, they're for consistent recovery of the system to a known working state, IE to recover from unclean shutdowns. I understand that the logs are just for recovery purposes, but I'm wondering if I could use them for, let's say, simulating a crash and let the system do a "consistent recovery" which actually is a rollback. I am not sure if this is possible. Even if it is not very gentleman-like, it is very much an option because the damage in case of a complete data loss would be quite severe. So, I noticed that there are some log (?) files in the db directory, named __db.001 to __db.005, one of which has 18 MB: -rw---1 cyrusmail 8192 2005-03-11 16:50 __db.001 -rw---1 cyrusmail 270336 2005-03-11 16:50 __db.002 -rw---1 cyrusmail98304 2005-03-11 16:50 __db.003 -rw---1 cyrusmail 18563072 2005-03-11 16:50 __db.004 -rw---1 cyrusmail32768 2005-03-11 16:50 __db.005 -rw---1 cyrusmail 211602 2005-04-05 04:56 log.02 -rw---1 cyrusmail4 2005-03-11 16:50 skipstamp Hm...I'm asking myself what the __db.004 would contain? 18 MB seem to be a little too much for just storing metadata - but could be, if the content of __db.XXX is never expunged but always appended. [...5 mins later...] I just took a look at the __db.004 file and it seems not promising at all, for the majority of the 18 MB it seems to contain only a sequence of approx. 70 bytes (mostly null values), repeated over and over again. So to me this seems to be the only weak, distant glimpse of hope: IF the _db.XXX files contain mail bodies in some compressed/internal representation, it could be possible to extract them from there, at least most of them. I just told you, they don't. The only way you'll recover mail is with proper backups *or* forensic recovery on the drive/filesystem itself. Could there be a way to extract to extract the mail bodies from the __db.XXX files (for example by forcing the system into an inconsistent state so that cyrus uses its binary checkpoint and archiving files to recover) - or are the mail bodies _really_ just stored in the individual files (which have been definitely deleted) as Jules Agee pointed out? No, being as there isn't any mail stored there. The mail itself is all in the filesystem. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: restrict frequency of login attempts?
--On Tuesday, April 12, 2005 10:00 AM +0200 Sebastian Hagedorn <[EMAIL PROTECTED]> wrote: In our experience this doesn't work very well, because users don't understand what is happening. And neither do a number of MUAs (particularly those by MS, but Eudora and others flip out too). But yes, same/similar sort of experience. Users just don't get it. They don't realise that they don't get that much email, that they really are not that important, and that waiting another 4.5 minutes is not going to kill them. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: restrict frequency of login attempts?
--On Tuesday, April 12, 2005 09:08 -0700 Andrew Morgan <[EMAIL PROTECTED]> wrote: And for the love of god, let pop3 die. If your users whine, tell them to use imap, a sensible remote mail protocol. :) Just because the protocol is sensible, doesn't' mean the majority of the clients aren't still senseless. ;) --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Invalid Header
--On Monday, April 18, 2005 15:10 -0500 "Vernon A. Fort" <[EMAIL PROTECTED]> wrote: My setup is FC3 with postfix + cyrus-2.2.10-3. I had several messages in the queue stating "Invalid header". After searching for hours, I attempted to save the message using postcat so I could see what part of the header was invalid. There was/is a line: Message-ID: with nothing after the line. I removed the line and re-sent the message successfully. Why would single line called Message-ID: cause lmtpd message header errors? Ahh yeah, RFC822, specifically:: optional-field = / "Message-ID"":" msg-id / "Resent-Message-ID" ":" msg-id / "In-Reply-To" ":" *(phrase / msg-id) / "References"":" *(phrase / msg-id) / "Keywords" ":" #phrase / "Subject" ":" *text / "Comments" ":" *text / "Encrypted" ":" 1#2word / extension-field ; To be defined / user-defined-field ; May be pre-empted msg-id = "<" addr-spec ">"; Unique message id nothing about it is allowed to be blankthe field is optional, but can't be blank. Plus IMAP clients will use the Message-ID as the 'key' for finding a message. It's funny your posting this because we just had a customer have an issue with that... Please point me to some RFC or documentation. I need to present to the higher-UPS a decent explanation on why this message took 6 hours to get delivered. Vernon -- GPG/PGP --> 0xE736BD7E 5144 6A2D 977A 6651 DFBE 1462 E351 88B9 E736 BD7E --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: question about sieve "discard"
--On Wednesday, April 27, 2005 15:46 -0300 Andreas Hasenack <[EMAIL PROTECTED]> wrote: Note how the if/elsif structure is broken and a new if statement begins later on. That was a copy&paste error (the second "if" should have been "elsif" to continue the case-like structure). The interesting thing is that a message from "[EMAIL PROTECTED]" survived the discard. Is that because there should be a "stop;" after the discard action? It matched some other rule down the road in the second "if" structure. Not sure if it relates or not but beware that what MS Outlook displays as 'from' and what's in the 'From' header can (and quite often are) different. There's a FAQ somewhere in the Mailman or http://list.org/ site that documents this and I've seen it as well. Not all versions behave like this though, but it *might* factor in. I'm pretty sure discard implies stop. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
