Re: Cyrus-imapd memory tuning

2014-03-13 Thread Frank Richter
On Thu, Mar 13, 2014, at 04:18 AM, David R Bosso wrote: I've been wondering if anyone has any positive experience with using recent XFS. We use XFS on 5 backends (virtual servers, Scientific Linux 6) with 15 partitions altogether (500 to 800 GB each) for many years without serious crashes.

Re: Cyrus-imapd memory tuning

2014-03-12 Thread Bron Gondwana
On Thu, Mar 13, 2014, at 04:18 AM, David R Bosso wrote: > I've been wondering if anyone has any positive experience with using recent > XFS. This question comes up every so often. I tried a couple of years back, and the server crashed within 6 hours under the heavy load of copying data in, and

Re: Cyrus-imapd memory tuning

2014-03-12 Thread Bron Gondwana
On Thu, Mar 13, 2014, at 04:18 AM, David R Bosso wrote: > Just curious about what filesystem (and any special mount options) you're > using these days for large cyrus stores. We've been using ext4 for a while > now (we used to use reiser) and have seen performance degradation over > time. I've

Re: Cyrus-imapd memory tuning

2014-03-12 Thread David R Bosso
--On March 12, 2014 11:53:03 PM +1100 Bron Gondwana wrote: > > Looks like on a medium-loaded server we have about 15,000 connections open > at the moment. It's about 40% masters, 40% replicas, 20% unallocated. > >> About disk, what is the high size of a single partition managed by Cyrus? > > We

Re: Cyrus-imapd memory tuning

2014-03-12 Thread Bron Gondwana
On Wed, Mar 12, 2014, at 08:11 PM, Marco wrote: > > On Mon, Mar 10, 2014, at 07:49 PM, Marco wrote: > >> With 8GB RAM, > > > > I would recommend you increase that... > [...] > > As an interesting datapoint, the big ones cost about US$20k fully > > stocked, including 40Tb of RAID6 storage for emai

Re: Cyrus-imapd memory tuning

2014-03-12 Thread Marco
> On Mon, Mar 10, 2014, at 07:49 PM, Marco wrote: >> With 8GB RAM, > > I would recommend you increase that... [...] > As an interesting datapoint, the big ones cost about US$20k fully > stocked, including 40Tb of RAID6 storage for email, plus 6Tb of > RAID1 for search indexes and 800Gb of RAID1

Re: Cyrus-imapd memory tuning

2014-03-10 Thread Andrew Morgan
xchild=100 I tuned the maxchild setting to balance our usage patterns between the imap and imaps ports. Our highest open connection count is about 1500 total, so there is quite a bit of headroom. > I see that an IMAPD process takes in average 22-25MB. With 8GB RAM, > the server would swap a

Re: Cyrus-imapd memory tuning

2014-03-10 Thread Bron Gondwana
On Mon, Mar 10, 2014, at 07:49 PM, Marco wrote: > With 8GB RAM, I would recommend you increase that... even before you swap, you'll be seeing a drop in performance as hot files (indexes, mailboxes.db) get evicted from cache. Memory is relatively cheap these days. I realise you may be constrain

Re: Cyrus-imapd memory tuning

2014-03-10 Thread Marco
[...] > So best would be to use pmap on a "typical" imapd on your system and > add some margin for additional helper around to get a estimate how > far you can get. I'll try to understand carefully. I estimated memory usage with 'ps' and the RSS field. I'm trying with pmap. I now see value

Re: Cyrus-imapd memory tuning

2014-03-10 Thread lst_hoe02
ady with less than 400 conns; it not happens, so this evaluation is wrong or too many conservative. I think that I better consider differences between RSS and SHR memory to tuning imapd processes number, but I'm not sure. Hello, not sure where you get the number of 22-25MB per imapd from, b

Cyrus-imapd memory tuning

2014-03-10 Thread Marco
is wrong or too many conservative. I think that I better consider differences between RSS and SHR memory to tuning imapd processes number, but I'm not sure. Could you help me in this tuning? In particular I'm interested on relation between memory usage and maxchild imapd processes. Mea

Debian Linux kernel tuning for low latency on small files

2012-05-29 Thread Andre Felipe Machado
Hello, This could be useful for improving a poor performance at some environments: "Low latency is a key factor to a good user experience. With the Debian GNU / Linux 6.x kernel tuning, combined with the previous articles hints about XenServer I/O latency, tuning filesystems, config

Re: Cyrus Postfix LMTP tuning

2011-10-14 Thread John Madden
>> lmtp_destination_concurrency_limit = 50 >> lmtp_destination_recipient_limit = 5000 >> lmtp_connection_cache_on_demand = no >> lmtp_data_done_timeout = 3600s > > Why do you set lmtp_connection_cache_on_demand = no? I had issues with the cached connections. I don't remember the specifics, just

Re: Cyrus Postfix LMTP tuning

2011-10-14 Thread Andrew Morgan
On Thu, 13 Oct 2011, John Madden wrote: >> Our Postfix relays (there are 3) seem to make one lmtp connection per >> message, rather than sending multiple messages down a single connection. >> >> Do any Cyrus+Postfix users out there have tuning recommendations? I see a

Re: Cyrus Postfix LMTP tuning

2011-10-14 Thread k...@rice.edu
ather than sending multiple messages down a single connection. > >>> > >>> Do any Cyrus+Postfix users out there have tuning recommendations? I see a > >>> lot of postfix lmtp_* config options, but I know little about Postfix. > >> > >> I make no g

Re: Cyrus Postfix LMTP tuning

2011-10-14 Thread Andrew Morgan
t; Do any Cyrus+Postfix users out there have tuning recommendations? I see a >>> lot of postfix lmtp_* config options, but I know little about Postfix. >> >> I make no guarantees about these, but try this out: >> >> lmtp_destination_concurrency_limit = 50 >> l

Re: Cyrus Postfix LMTP tuning

2011-10-14 Thread Henrique de Moraes Holschuh
On Thu, 13 Oct 2011, John Madden wrote: > > Our Postfix relays (there are 3) seem to make one lmtp connection per > > message, rather than sending multiple messages down a single connection. > > > > Do any Cyrus+Postfix users out there have tuning recommendations? I see a

Re: Cyrus Postfix LMTP tuning

2011-10-13 Thread John Madden
> Our Postfix relays (there are 3) seem to make one lmtp connection per > message, rather than sending multiple messages down a single connection. > > Do any Cyrus+Postfix users out there have tuning recommendations? I see a > lot of postfix lmtp_* config options, but I know littl

Cyrus Postfix LMTP tuning

2011-10-13 Thread Andrew Morgan
I'm looking for some advice on tuning Cyrus and Postfix to speed up LMTP delivery. We ran a test of our emergency alert system today, which generated 20,000 separate emails for delivery. From the message headers, it appears that delivery of some messages took 30 minutes (the one sent t

Re: Tuning defaults for 2.5

2011-03-07 Thread Simon Matter
> On Thu, Mar 03, 2011 at 08:09:46AM +0100, Simon Matter wrote: >> - improved_mboxlist_sort to 1 >> I don't know about this one but it hurts reading we have to >> "dump/convert/undump their mailboxes.db" :( > > This is the most important one - but I actually don't think it > will be required to hav

Re: Tuning defaults for 2.5

2011-03-04 Thread Bron Gondwana
On Thu, Mar 03, 2011 at 08:09:46AM +0100, Simon Matter wrote: > - improved_mboxlist_sort to 1 > I don't know about this one but it hurts reading we have to > "dump/convert/undump their mailboxes.db" :( This is the most important one - but I actually don't think it will be required to have an optio

Re: Tuning defaults for 2.5

2011-03-04 Thread Dan White
On 04/03/11 13:36 +, Jeroen van Meeuwen (Kolab Systems) wrote: >Simon Matter wrote: >> I've checked the options you suggest and here is where I don't agree: > >Thanks Simon for your feedback! > >> - altnamespace to 1 >> I don't remember any problems with altnamespace = 0 so why change it? I >>

Re: Tuning defaults for 2.5

2011-03-04 Thread Dennis Davis
On Fri, 4 Mar 2011, Jeroen van Meeuwen (Kolab Systems) wrote: ... > I'm not aware of any systems that currently still have > /usr/lib/sendmail indeed, other then perhaps those currently no > longer supported by their respective upstreams. Solaris5.10, which is supported, has sendmail as /usr/lib

Re: Tuning defaults for 2.5

2011-03-04 Thread Jeroen van Meeuwen (Kolab Systems)
Simon Matter wrote: > I've checked the options you suggest and here is where I don't agree: > Thanks Simon for your feedback! > - altnamespace to 1 > I don't remember any problems with altnamespace = 0 so why change it? I > prefer to have the "nontranslated" namespace everywhere by default, whic

Re: Tuning defaults for 2.5

2011-03-02 Thread Simon Matter
> Hello, > > I just wanted to let those of us on this list, but not the development > list, > know about a review of default configuration values that you may be > interested > in; > > http://lists.andrew.cmu.edu/pipermail/cyrus-devel/2011-March/001742.html I've checked the options you suggest a

Tuning defaults for 2.5

2011-03-02 Thread Jeroen van Meeuwen (Kolab Systems)
Hello, I just wanted to let those of us on this list, but not the development list, know about a review of default configuration values that you may be interested in; http://lists.andrew.cmu.edu/pipermail/cyrus-devel/2011-March/001742.html Kind regards, Jeroen van Meeuwen -- Senior Engine

Re: Tuning some defaults for 2.5: lmtp_downcase_rcpt

2011-02-14 Thread Andrew Morgan
On Fri, 11 Feb 2011, Jeroen van Meeuwen (Kolab Systems) wrote: > Hi there, > > (This is a re-posted message from our development mailing list.) > > In our IRC channel, it was suggested to look at RFC 2821, section 2.4, quoted > as saying: > > "However, exploiting the case sensitivity of mailbox lo

Re: Tuning some defaults for 2.5: lmtp_downcase_rcpt

2011-02-11 Thread Jeroen van Meeuwen (Kolab Systems)
André Schild wrote: > @bücher.ch is allowed. > In dns this is represented as a IDN encoded name in the form of*** > > xn--bcher-kva.ch* is the ACE string, and it is this string that is > entered in the DNS. > Fine, let me rephrase; The IDN<->ACE string conversion, while ASCII-only not being a

Re: Tuning some defaults for 2.5: lmtp_downcase_rcpt

2011-02-11 Thread André Schild
Am 11.02.2011 15:06, schrieb Jeroen van Meeuwen (Kolab Systems): André Schild wrote: > Hello, > > Am 11.02.2011 14:11, schrieb Jeroen van Meeuwen (Kolab Systems): > > Long story short; the proposal is to ship with a default > > lmtp_downcase_rcpt of 1. > > Sound OK for me. > > When chan

Re: Tuning some defaults for 2.5: lmtp_downcase_rcpt

2011-02-11 Thread Jeroen van Meeuwen (Kolab Systems)
André Schild wrote: > Hello, > > Am 11.02.2011 14:11, schrieb Jeroen van Meeuwen (Kolab Systems): > > Long story short; the proposal is to ship with a default > > lmtp_downcase_rcpt of 1. > > Sound OK for me. > > When chaning upper/lowercases we always have to consider character sets. > For the

Re: Tuning some defaults for 2.5: lmtp_downcase_rcpt

2011-02-11 Thread André Schild
Hello, Am 11.02.2011 14:11, schrieb Jeroen van Meeuwen (Kolab Systems): Hi there, (This is a re-posted message from our development mailing list.) In our IRC channel, it was suggested to look at RFC 2821, section 2.4, quoted as saying: "However, exploiting the case sensitivity of mailbox l

Tuning some defaults for 2.5: lmtp_downcase_rcpt

2011-02-11 Thread Jeroen van Meeuwen (Kolab Systems)
Hi there, (This is a re-posted message from our development mailing list.) In our IRC channel, it was suggested to look at RFC 2821, section 2.4, quoted as saying: "However, exploiting the case sensitivity of mailbox local-parts impedes interoperability and is discouraged." The problem state

Re: tuning cyrus?

2007-08-28 Thread Bob Bob
And the integrity of the pst cache file might need checking. This is done by running "scanpst.exe", that is somewhere in the Office pgm directory. I have also seen some strange slowdowns using Cyrus and a damaged pst., mostly at first opening of Outlook. Deleting the pst file cache and allowing

RE: tuning cyrus?

2007-08-27 Thread Ciprian Marius Vizitiu
> The "solution" to all of this is to leave Outlook running all > the time. I've seen Outlook fetching headers for like 100 new messages (from a 2000 messages box) in a matter of seconds on Monday morning fresh start; and it did it on 2 years old WS hardware plus 3 years old server hardware. But

RE: tuning cyrus?

2007-08-27 Thread Ciprian Marius Vizitiu
> One user mentions that "it still takes several minutes in the > morning to 'fetch headers'." This user has Outlook 2003 on MS > XP as the mail client. > I have less than 20 users using cyrus-imapd 2.3.1 on a fedora > core 5 box with current rpms. > >

Re: [INFO-CYRUS] Re: tuning cyrus?

2007-08-27 Thread Nik Conwell
On Aug 27, 2007, at 11:14 AM, Mike Eggleston wrote: [...] > Where is the server logging sub-directory? I do not see one in > /var/lib/cyrus-imapd (those are all binaries) nor do I see one in / > var/log. It should be a subdirectory called "log" in whatever directory "configdirectory" is set

Re: tuning cyrus?

2007-08-27 Thread Nik Conwell
I have less than 20 users using cyrus-imapd 2.3.1 on a fedora core 5 > box with current rpms. > > Does anyone have any tuning hints? Some way to speed things for > this user? > No one else has mentioned any problems. > > Mike > > Cyrus Home Page: http://cyrusimap

Re: tuning cyrus?

2007-08-27 Thread Mike Eggleston
On Mon, 27 Aug 2007, Nik Conwell might have said: > This is typically an Outlook problem. The client runs various > filters, and possibly has perf issues on local disk (look for disk > light activity on the PC) as it's updating its caches. > > Turn on Cyrus logging for the particular user (i

tuning cyrus?

2007-08-27 Thread Mike Eggleston
One user mentions that "it still takes several minutes in the morning to 'fetch headers'." This user has Outlook 2003 on MS XP as the mail client. I have less than 20 users using cyrus-imapd 2.3.1 on a fedora core 5 box with current rpms. Does anyone have any tuning hint

imapd memory tuning

2007-08-03 Thread Janne Peltonen
Hi! Would you happen to have any pointers to tips on how to reduce memory usage of Cyrus imapd processes? Running multiple independent Cyrus instances on a single physical server appears to require quite an amount of memory... I wonder how many gigs of RAM the people at fastmail.fm have... --Jan

Re: MURDER : tuning for increasing load

2005-05-24 Thread John Madden
>In fact, 100 000 users represent more or less 600 000 folders & > subfolders. The choice of murder is high availability, even if one > backend falls down, only 25% of the users will loose the mail service. I see. > Any idea on optimizing Berkeley DB cache? I assume reading berkeley

Re: MURDER : tuning for increasing load

2005-05-24 Thread Simon Matter
> John Madden wrote: >>>I have to deal with increasing charge of by now 500 users that will grow >>>up to 100 000. >>>All mailboxes exist, for a 65Mb mailboxes.db on mupdate >> >> Is murder even necessary for such a configuration? Based on the numbers >> on Cyrus' >> pages, I assumed 200k accounts

Re: MURDER : tuning for increasing load

2005-05-24 Thread LaurentG
In fact, 100 000 users represent more or less 600 000 folders & subfolders. The choice of murder is high availability, even if one backend falls down, only 25% of the users will loose the mail service. Each server has 2 CPU & 5 GB RAM. Any idea on optimizing Berkeley DB cache? Laurent. Joh

Re: MURDER : tuning for increasing load

2005-05-24 Thread Etienne Goyer
John Madden wrote: I have to deal with increasing charge of by now 500 users that will grow up to 100 000. All mailboxes exist, for a 65Mb mailboxes.db on mupdate Is murder even necessary for such a configuration? Based on the numbers on Cyrus' pages, I assumed 200k accounts on one big, beefy

Re: MURDER : tuning for increasing load

2005-05-24 Thread John Madden
> I have to deal with increasing charge of by now 500 users that will grow > up to 100 000. > All mailboxes exist, for a 65Mb mailboxes.db on mupdate Is murder even necessary for such a configuration? Based on the numbers on Cyrus' pages, I assumed 200k accounts on one big, beefy box would be ok

MURDER : tuning for increasing load

2005-05-24 Thread LaurentG
ct values for configuring BDB cache a 65Mb mailboxes.db (Berkeley 3.2) on each type of murder server, as I found very poor docs on that subject. If any other point to look at for fine tuning, please tell me. Thanks in advance for your help (Had no time for real tests under heavy load so can't

Tuning /proc/sys on Linux for Cyrus

2004-05-25 Thread Sebastian Hagedorn
management of 32-bit Linux 2.4 on large memory machines. We have now reduced the memory of the machines to 2 GB, which has improved matters to some degree. Now RH support has recommended tuning /proc/sys/vm/pagecache and possibly other parameters. Does anybody have experience tuning these values for

XFS filesystem tuning for Cyrus imap server

2004-02-23 Thread Rajesh Saxena
Hi Everyone I have a brief question. I have read in archives that some users here use XFS for Cyrus imap server but I am wondering what tricks they use to fine tune XFS for imap server purposes. For example XFS is meant for large files and directories but I am curius if it performs just as brilli

Re: performance tuning

2004-01-28 Thread Jure Pečar
On Tue, 27 Jan 2004 19:38:41 -0600 "Joe Hrbek" <[EMAIL PROTECTED]> wrote: > As a side note, when I run my programs, it brings my dual xeon 2.4ghz > processors to 80% utilization (2 gigs of ram and raid 0). :D Not > important to the problem I don't think, but there ya go anyway, just if > you are

Re: performance tuning

2004-01-28 Thread Simon Matter
> Hi everyone! > > I've been trying to tweak my cyrus system to improve performance. I have > a > few programs (smtp-sink that came with postfix) that I use to test my > server. I used smtp-sink to send 100 messages to a random set of 20 > different accounts (2,000 messages total; average time to

performance tuning

2004-01-27 Thread Joe Hrbek
Hi everyone! I've been trying to tweak my cyrus system to improve performance. I have a few programs (smtp-sink that came with postfix) that I use to test my server. I used smtp-sink to send 100 messages to a random set of 20 different accounts (2,000 messages total; average time to send is abou

RE: Tuning Suggestions

2003-06-10 Thread John Straiton
> > I come seeing suggestions for things I could check or > change in order > > to resolve this before it gets to being more of a problem > than it is. > > I figured I'd start with Cyrus and then move down to the OS level. > > One thing you might want to try is to use /dev/urandom > instead o

Re: Tuning Suggestions

2003-06-10 Thread Michael Bacon
PROTECTED]> wrote: Funny that I haven't found much in the lines of tuning suggestions for Cyrus on googlegroups or in the info-cyrus archives but I think I may be in need of it. I'm using a 4.8-STABLE FreeBSD machine, Dual 600Mhz with 1.5GB of RAM and plenty of RAID5 space. We use Cyrus+Pos

Re: Tuning Suggestions

2003-06-10 Thread Rob Siemborski
On Tue, 10 Jun 2003, John Straiton wrote: > I come seeing suggestions for things I could check or change in order to > resolve this before it gets to being more of a problem than it is. I > figured I'd start with Cyrus and then move down to the OS level. One thing you might want to try is to use

Tuning Suggestions

2003-06-10 Thread John Straiton
Funny that I haven't found much in the lines of tuning suggestions for Cyrus on googlegroups or in the info-cyrus archives but I think I may be in need of it. I'm using a 4.8-STABLE FreeBSD machine, Dual 600Mhz with 1.5GB of RAM and plenty of RAID5 space. We use Cyrus+Postfix+AMAVISd+Sp

tuning

2001-09-17 Thread Kiarna Boyd
Hi guys, I am looking for good tuneing docs for 2.0.16. Any one have favorites? Thanks! -Kiarna

Sleepycat DB erorrs and performance tuning

2001-06-14 Thread Shawn Sivy
In an effort to try to speed along our conversion process I've been testing out running many simultaneous scripts for creating mailboxes and doing reconstructs on mail folders. So far I'm up to about 100 simultaneous scripts (logins) either doing IMAP mailbox creations or running reconstruct. I'