[Mailman-Users] High CPU Usage After Mailman 2.1 Upgrade

2020-05-02 Thread Warren Toomey 
Hi all, I upgraded to Mailman 2.1.26 on my Ubuntu 18.04 server yesterday. Now
when a new list posting arrives, this process goes to 100% and stays there:

/usr/bin/python /var/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s

What I'm also seeing is in the /var/lib/mailman/qfiles/out directory, there
is a single file whose name keeps changing rapidly (more than once a second):

-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+30d2fb4556d99a0ae3967d4f156a9e37069f2b14.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+16609e67dc7e96df4c609daa7fb191d95ff88c1e.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+244bef1ee56e03c655a25be85f32f52fe024f490.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+47968ab9ef49616d8cf56ebbadf7b7e9bb8d1215.pck
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+26bf2448f8506ed3bb742443a11c585206734e5d.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+c0e083e1150af6689df9f2cf37106fbac46ff70a.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+fb9e3a19e7b44b94aa8069f5e15115dcef5d8553.pck.tmp
-? ? ??   ?? 
1588366105.234102+d304ac33f4e60a5f00a437a0a28ad5d9c86b.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+f6744d91674f74b69f9b87769d70b8b127910e58.pck.tmp
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+71590cfc364222b97078ab1ed1a289a435d25800.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+a7c3a89487a2c3dd1a69b8a7178508f6a70a7e8d.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+ce6fa22d1f4071a2d6d42e0e49ce1770323cbc97.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+17f5ce08abd8a27a9a05f721e4704848ff8ce960.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+205cbad43f5e65fce34a4068cbe0dfb8c2cb174e.bak
-rw-rw 1 list list 6620 May  2 07:51 
1588366105.234102+4abd3744c6c5a471df7c0e6489d2253e9b47dea8.bak

I can't see anything amiss in the log file. In fact, no output is being added
to them while this process is racing.

Does anybody have suggestions as to what the cause might be, or what I can
do to diagnose the issue?

For now I'm shutting down the mailman service, removing the queue file and
restarting the service.

Many thanks in advance, Warren

P.S. The list has been running since 1994 :-)
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/

[Mailman-Users] Re: High CPU Usage After Mailman 2.1 Upgrade

2020-05-02 Thread Mark Sapiro 
On 5/1/20 3:01 PM, Warren Toomey wrote:
> Hi all, I upgraded to Mailman 2.1.26 on my Ubuntu 18.04 server yesterday.

Since you upgraded to 2.1.26 and not 2.1.30, I assume you upgraded with
the Debian/Ubuntu mailman package. Please see



> Now
> when a new list posting arrives, this process goes to 100% and stays there:
> 
> /usr/bin/python /var/lib/mailman/bin/qrunner --runner=OutgoingRunner:0:1 -s
> 
> What I'm also seeing is in the /var/lib/mailman/qfiles/out directory, there
> is a single file whose name keeps changing rapidly (more than once a second):


There is an issue in 2.1.26 only that can cause this. See
. The fix for this is
.

-- 
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/

[Mailman-Users] Re: High CPU Usage After Mailman 2.1 Upgrade

2020-05-02 Thread Mark Sapiro 
On 5/2/20 10:12 AM, Mark Sapiro wrote:
> 
> There is an issue in 2.1.26 only that can cause this. See
> . The fix for this is
> .


Note: the thing that triggers this is a temporary failure (4xx status)
in delivery to one or more list members. You should see these in your
mail.log and you can remove the problem addresses from the list.

-- 
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/

[Mailman-Users] Re: High CPU Usage After Mailman 2.1 Upgrade

2020-05-02 Thread Warren Toomey 
> On 5/1/20 3:01 PM, Warren Toomey wrote:
> > Hi all, I upgraded to Mailman 2.1.26 on my Ubuntu 18.04 server yesterday.
 
On Sat, May 02, 2020 at 10:12:55AM -0700, Mark Sapiro wrote:
> There is an issue in 2.1.26 only that can cause this. See
> . The fix for this is
> .

Thanks Mark. I think I worked out what happened, but I'm not 100% sure.
Yes, I upgraded to 2.1.26 using Ubuntu's package management system.

However, two years ago I had applied the patch you mentioned to the previous
Mailman installation. I had also put the original python source files into
version control using RCS, just in case the patch needed to be backed out.

What I think has happened is that some sub-component of the upgrade process
(e.g. make) has checked out the old source files back out from the RCS
storage. Thus, I ended up with those two source files before the patch was
applied.

Anyway, I've restored the files to the current version and Mailman is
working normally again. I've also checked in the patched files so it won't
happen again.

Cheers, Warren
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/

[Mailman-Users] Re: High CPU Usage After Mailman 2.1 Upgrade

2020-05-02 Thread Barry S. Finkel 

On 5/2/2020 5:01 PM, Warren Toomey wrote:

On 5/1/20 3:01 PM, Warren Toomey wrote:

Hi all, I upgraded to Mailman 2.1.26 on my Ubuntu 18.04 server yesterday.
  
On Sat, May 02, 2020 at 10:12:55AM -0700, Mark Sapiro wrote:

There is an issue in 2.1.26 only that can cause this. See
. The fix for this is
.


Thanks Mark. I think I worked out what happened, but I'm not 100% sure.
Yes, I upgraded to 2.1.26 using Ubuntu's package management system.

However, two years ago I had applied the patch you mentioned to the previous
Mailman installation. I had also put the original python source files into
version control using RCS, just in case the patch needed to be backed out.

What I think has happened is that some sub-component of the upgrade process
(e.g. make) has checked out the old source files back out from the RCS
storage. Thus, I ended up with those two source files before the patch was
applied.

Anyway, I've restored the files to the current version and Mailman is
working normally again. I've also checked in the patched files so it won't
happen again.

Cheers, Warren
--



As I have written before, when I was a Mailman administrator
(before I retired) I looked at Ubuntu packages, and their Mailman had
many undocumented patches, as well as one patch that deleted a
library that sometimes was needed.  So I spent time creating my
own Ubuntu package for Mailman from the source.  I assume that my
method would work for the current release of Mailman.  For information
contact me off-list.  My procedure is not complex.

--Barry Finkel
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
   https://mail.python.org/archives/list/mailman-users@python.org/