[Mailman-Users] Re: Excessive or fatal bounces issue

2023-08-04 Thread Stephen J. Turnbull
Florin Pasăre writes:

 > Thank you for your response. I know we should upgrade, but because
 > of company policies this is not really an option at the moment,

Like Carl and Mark, I strongly recommend upgrading to most recent
Mailman 2.  This is straightforward, and during the process you can
get round-the-clock support here because everyone has done it several
times.  You don't need to get the attention of developers, community
support is excellent.

You do not have to worry about losing archives from a Mailman 2
upgrade, because the archival format is just the mbox that your MTA
produces for you.  The web pages are a presentation that can be
rebuilt (at some cost in time) at any time.  In fact, the most recent
month's pages are rebuilt from mboxes every day by a cron job.  Even
the URLs of individual messages remain the same (unless you edit the
mbox by removing or reordering messages).  (If you use an alternative
to the bundled "Pipermail" archiver, you still probably have all the
mboxes somewhere in the system, but you should check that.)

 > at least not an upgrade to Mailman 3.

That is a project that will require some planning in any case.  You
can preserve the mbox files (and even leave the old Mailman 2 archive
CGIs running), and in that sense you won't lose archives.  However,
the version of the Python email package in Python 3 does not cope well
with some of the weird things you find in Mailman 2, and we have not
yet learned how to catch and repair all of them at import time.  Also,
importing messages into HyperKitty changes all the message URLs
(completely different format based on hashed Message-IDs rather than
serial number).  So you probably should think in terms of a man-week
for planning, and a man-week or so for execution, anyway.

I recommend you start "softening up" the CIO for a migration in a year
or two.  Eventually it's going to become painful to maintain Python 2
applications because even the oldest LTS distributions don't provide
old system libraries needed by Python 2, or because QA or CISO says
you can't use them any more because they're too old/vulnerable.

Steve
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/
Member address: arch...@jab.org


[Mailman-Users] Re: Excessive or fatal bounces issue

2023-08-04 Thread Florin Pasăre
Hello and thank you.
I will forward these replies to the dev that manages the servers and see if
we can get an upgrade to the latest version of Mailman 2 and continue from
there.
Thank you again for your time.

Florin Pasăre,


On Fri, Aug 4, 2023 at 10:26 AM Stephen J. Turnbull <
turnbull.stephen...@u.tsukuba.ac.jp> wrote:

> Florin Pasăre writes:
>
>  > Thank you for your response. I know we should upgrade, but because
>  > of company policies this is not really an option at the moment,
>
> Like Carl and Mark, I strongly recommend upgrading to most recent
> Mailman 2.  This is straightforward, and during the process you can
> get round-the-clock support here because everyone has done it several
> times.  You don't need to get the attention of developers, community
> support is excellent.
>
> You do not have to worry about losing archives from a Mailman 2
> upgrade, because the archival format is just the mbox that your MTA
> produces for you.  The web pages are a presentation that can be
> rebuilt (at some cost in time) at any time.  In fact, the most recent
> month's pages are rebuilt from mboxes every day by a cron job.  Even
> the URLs of individual messages remain the same (unless you edit the
> mbox by removing or reordering messages).  (If you use an alternative
> to the bundled "Pipermail" archiver, you still probably have all the
> mboxes somewhere in the system, but you should check that.)
>
>  > at least not an upgrade to Mailman 3.
>
> That is a project that will require some planning in any case.  You
> can preserve the mbox files (and even leave the old Mailman 2 archive
> CGIs running), and in that sense you won't lose archives.  However,
> the version of the Python email package in Python 3 does not cope well
> with some of the weird things you find in Mailman 2, and we have not
> yet learned how to catch and repair all of them at import time.  Also,
> importing messages into HyperKitty changes all the message URLs
> (completely different format based on hashed Message-IDs rather than
> serial number).  So you probably should think in terms of a man-week
> for planning, and a man-week or so for execution, anyway.
>
> I recommend you start "softening up" the CIO for a migration in a year
> or two.  Eventually it's going to become painful to maintain Python 2
> applications because even the oldest LTS distributions don't provide
> old system libraries needed by Python 2, or because QA or CISO says
> you can't use them any more because they're too old/vulnerable.
>
> Steve
>
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/
Member address: arch...@jab.org


[Mailman-Users] Questions About "An embedded message was scrubbed..."

2023-08-04 Thread Michael Reeder -- Hygeia MS
Apologies if this is too simple for this list -- I have tried looking 
through the online documentation and even this list's archive...


SIMPLE VERSION OF QUESTION:
I'm trying to find out how to stop a list from scrubbing embedded messages.

Does it have something to do with content filtering?  ( 
https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/handlers/docs/filtering.html 
)



BACKGROUND:
I have GNU Mailman List #1 that is an announcements only list.  It 
receives multiple emails of multiple rss feeds from blogtrottr.com (an 
RSS feed to email service), collects them, then sends them all out as a 
daily digest.  So essentially it is a GNU Mailman digest of multiple 
Blogtrottr RSS feed digests.


**When List #1 is sent to an individual email address it works fine.**

When sent to a GNU Mailman List #2:
a) The email digest of List #1 NEVER gets emailed to List #2 members
b) The email digest of List #1 DOES appear in the archive of List #2 as 
having been sent.
c) In the archive of List #2 -- for each email in the List #1 digest -- 
the message "An embedded message was scrubbed..." appears.


It looks like this in the List #2 archive:

--START MESSAGE--
.
-- next part --
**THIS IS AN ANNOUNCEMENTS-ONLY LIST.**

RSS Feed articles from ACA Counseling Today, APA PsychPort, Healthcare 
Info Security, Health IT Security, NASW Social Workers Speak, NYT 
Psychology & Psychologists, NYU Information for Practice, Scientific 
American Mind & Body, Social Psychology Psychology Headlines, & The New 
Social Worker Careers Magazine.

__
-- next part --
Today's Topics:

   1. Your Daily digest for NYT Psychology & Psychologists Daily
  Digest (Article Digests for Psychology & Social Work)
   2. Your Daily digest for Social Psychology Psychology Headlines
  Daily Digest (Article Digests for Psychology & Social Work)
   3. Confirm your unsubscription from 'NYT > Psychology and
  Psychologists' (Article Digests for Psychology & Social Work)
   4. Your Daily digest for NASW Social Workers Speak Daily Digest
  (Article Digests for Psychology & Social Work)
   5. Your Daily digest for NYU Information for Practice Daily
  Digest (Article Digests for Psychology & Social Work)
-- next part --
An embedded message was scrubbed...
From: Article Digests for Psychology & Social Work
 
Subject: Your Daily digest for NYT Psychology & Psychologists Daily Digest
Date: Thu, 03 Aug 2023 20:08:07 +
Size: 3372
URL: 
<http://lists.clinicians-exchange.org/private.cgi/clinicians-exchange-clinicians-exchange.org/attachments/20230804/ed6c3463/attachment.eml>

-- next part --
An embedded message was scrubbed...
From: Article Digests for Psychology & Social Work
 
Subject: Your Daily digest for Social Psychology Psychology Headlines 
Daily Digest

Date: Thu, 03 Aug 2023 20:09:05 +
Size: 10905
URL: 
<http://lists.clinicians-exchange.org/private.cgi/clinicians-exchange-clinicians-exchange.org/attachments/20230804/ed6c3463/attachment-0001.eml>

-- next part --
An embedded message was scrubbed...
From: Article Digests for Psychology & Social Work
 
Subject: Confirm your unsubscription from 'NYT > Psychology and 
Psychologists'

Date: Thu,  3 Aug 2023 20:20:56 + (UTC)
Size: 965
URL: 
<http://lists.clinicians-exchange.org/private.cgi/clinicians-exchange-clinicians-exchange.org/attachments/20230804/ed6c3463/attachment-0002.eml>

-- next part --
An embedded message was scrubbed...
From: Article Digests for Psychology & Social Work
 
Subject: Your Daily digest for NASW Social Workers Speak Daily Digest
Date: Fri,  4 Aug 2023 14:29:54 + (UTC)
Size: 18553
URL: 
<http://lists.clinicians-exchange.org/private.cgi/clinicians-exchange-clinicians-exchange.org/attachments/20230804/ed6c3463/attachment-0003.eml>

-- next part --
An embedded message was scrubbed...
From: Article Digests for Psychology & Social Work
 
Subject: Your Daily digest for NYU Information for Practice Daily Digest
Date: Fri, 04 Aug 2023 19:51:59 +0000
Size: 95307
URL: 
<http://lists.clinicians-exchange.org/private.cgi/clinicians-exchange-clinicians-exchange.org/attachments/20230804/ed6c3463/attachment-0004.eml>

-- next part --
-
Replies to this list not permitted -- announcement-only list.

UNSUBSCRIBE: http://unsubscribe-article-digests.clinicians-exchange.org

SUBSCRIBE: http://subscribe-article-digests.clinicians-exchange.org

READ ONLINE: http://read-the-rss-mega-archive.clinicians-exchange.org

Contact article-digests-owner at clinicians-exchange.org with questions 
or concerns.


--STOP MESSAGE--

EXPLANATION OF WHY:
While I will ultimately have people sign-up

[Mailman-Users] Re: Questions About "An embedded message was scrubbed..."

2023-08-04 Thread Michael Reeder -- Hygeia MS

Alright -- This is embarrassing...

I may have outsmarted myself...

I was expecting the message to go to my subfolder for List #2 in my 
Thunderbird email client.  Of course it did not.  I have a separate 
subfolder for List #1.  So it went to List #1's message subfolder 
because List #2 was merely a member receiving the message from List #1.


**No need to respond to this one unless I look at it for a day or two 
and still find further issues.**


Time for a beer...

Thanks,
Michael


*Michael Reeder, LCPC
*
*Hygeia Counseling Services : Baltimore / Mt. Washington Village location*
*410-871-TALK / michael(at)hygeiacounseling.com*


On 8/4/2023 6:35 PM, Michael Reeder -- Hygeia MS wrote:
Apologies if this is too simple for this list -- I have tried looking 
through the online documentation and even this list's archive...


SIMPLE VERSION OF QUESTION:
I'm trying to find out how to stop a list from scrubbing embedded 
messages.


Does it have something to do with content filtering?  ( 
https://docs.mailman3.org/projects/mailman/en/latest/src/mailman/handlers/docs/filtering.html 
)



BACKGROUND:
I have GNU Mailman List #1 that is an announcements only list.  It 
receives multiple emails of multiple rss feeds from blogtrottr.com (an 
RSS feed to email service), collects them, then sends them all out as 
a daily digest.  So essentially it is a GNU Mailman digest of multiple 
Blogtrottr RSS feed digests.


**When List #1 is sent to an individual email address it works fine.**

When sent to a GNU Mailman List #2:
a) The email digest of List #1 NEVER gets emailed to List #2 members
b) The email digest of List #1 DOES appear in the archive of List #2 
as having been sent.
c) In the archive of List #2 -- for each email in the List #1 digest 
-- the message "An embedded message was scrubbed..." appears.


It looks like this in the List #2 archive:

--START MESSAGE--
.
-- next part --
**THIS IS AN ANNOUNCEMENTS-ONLY LIST.**

RSS Feed articles from ACA Counseling Today, APA PsychPort, Healthcare 
Info Security, Health IT Security, NASW Social Workers Speak, NYT 
Psychology & Psychologists, NYU Information for Practice, Scientific 
American Mind & Body, Social Psychology Psychology Headlines, & The 
New Social Worker Careers Magazine.

__
-- next part --
Today's Topics:

   1. Your Daily digest for NYT Psychology & Psychologists Daily
  Digest (Article Digests for Psychology & Social Work)
   2. Your Daily digest for Social Psychology Psychology Headlines
  Daily Digest (Article Digests for Psychology & Social Work)
   3. Confirm your unsubscription from 'NYT > Psychology and
  Psychologists' (Article Digests for Psychology & Social Work)
   4. Your Daily digest for NASW Social Workers Speak Daily Digest
  (Article Digests for Psychology & Social Work)
   5. Your Daily digest for NYU Information for Practice Daily
  Digest (Article Digests for Psychology & Social Work)
-- next part --
An embedded message was scrubbed...
From: Article Digests for Psychology & Social Work
 
Subject: Your Daily digest for NYT Psychology & Psychologists Daily 
Digest

Date: Thu, 03 Aug 2023 20:08:07 +
Size: 3372
URL: 
<http://lists.clinicians-exchange.org/private.cgi/clinicians-exchange-clinicians-exchange.org/attachments/20230804/ed6c3463/attachment.eml>

-- next part --
An embedded message was scrubbed...
From: Article Digests for Psychology & Social Work
 
Subject: Your Daily digest for Social Psychology Psychology Headlines 
Daily Digest

Date: Thu, 03 Aug 2023 20:09:05 +
Size: 10905
URL: 
<http://lists.clinicians-exchange.org/private.cgi/clinicians-exchange-clinicians-exchange.org/attachments/20230804/ed6c3463/attachment-0001.eml>

-- next part --
An embedded message was scrubbed...
From: Article Digests for Psychology & Social Work
 
Subject: Confirm your unsubscription from 'NYT > Psychology and 
Psychologists'

Date: Thu,  3 Aug 2023 20:20:56 + (UTC)
Size: 965
URL: 
<http://lists.clinicians-exchange.org/private.cgi/clinicians-exchange-clinicians-exchange.org/attachments/20230804/ed6c3463/attachment-0002.eml>

-- next part --
An embedded message was scrubbed...
From: Article Digests for Psychology & Social Work
 
Subject: Your Daily digest for NASW Social Workers Speak Daily Digest
Date: Fri,  4 Aug 2023 14:29:54 + (UTC)
Size: 18553
URL: 
<http://lists.clinicians-exchange.org/private.cgi/clinicians-exchange-clinicians-exchange.org/attachments/20230804/ed6c3463/attachment-0003.eml>

-- next part --
An embedded message was scrubbed...
From: Article Digests for Psychology & Social Work
 
Subject: Your Daily digest for NYU Information for Practice Daily Dig

[Mailman-Users] Re: Questions About "An embedded message was scrubbed..."

2023-08-04 Thread Mark Sapiro

On 8/4/23 15:55, Michael Reeder -- Hygeia MS wrote:

Alright -- This is embarrassing...

I may have outsmarted myself...

I was expecting the message to go to my subfolder for List #2 in my 
Thunderbird email client.  Of course it did not.  I have a separate 
subfolder for List #1.  So it went to List #1's message subfolder 
because List #2 was merely a member receiving the message from List #1.


So is it the case that the message you received contained the actual 
messages and they were only scrubbed in the archive and not in the 
message delivered to List #2 members?


If so, that is a limitation of the archiver.

--
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
   https://mail.python.org/archives/list/mailman-users@python.org/
Member address: arch...@jab.org


[Mailman-Users] Re: Questions About "An embedded message was scrubbed..."

2023-08-04 Thread Richard



...snip...

So is it the case that the message you received contained the actual messages 
and they were only scrubbed in the archive and not in the message delivered 
to List #2 members?


If so, that is a limitation of the archiver.



Um...

OK, it's not a confirmed archiver issue but... I seem to recall that just 
within the last day we read that Mailman 2 stores the archives "as was" in 
a simple mbox, but Mailman 3 does not: Is this a potential Mailman 3 
issue?


As a potential Mailman 3 user someday (vs v2 holdout)... did I miss 
something?


Tnx,
R
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
   https://mail.python.org/archives/list/mailman-users@python.org/
Member address: arch...@jab.org


[Mailman-Users] Missing emails

2023-08-04 Thread tom
I have a list using 2.1.39 in Cpanel.  When I send a message through the list 
subscribers at Gmail, Hotmail, Yahoo, Q.com, and CenturyLink do not receive the 
message.  It does not bounce or go into spam or any folder.  They just seem to 
disappear.  Other email providers seem to be getting the messages.  Any ideas 
on how to fix this?
--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
https://mail.python.org/archives/list/mailman-users@python.org/
Member address: arch...@jab.org


[Mailman-Users] Re: Questions About "An embedded message was scrubbed..."

2023-08-04 Thread Mark Sapiro

On 8/4/23 18:07, Richard wrote:


...snip...

So is it the case that the message you received contained the actual 
messages and they were only scrubbed in the archive and not in the 
message delivered to List #2 members?


If so, that is a limitation of the archiver.



Um...

OK, it's not a confirmed archiver issue but... I seem to recall that 
just within the last day we read that Mailman 2 stores the archives "as 
was" in a simple mbox, but Mailman 3 does not: Is this a potential 
Mailman 3 issue?


Mailman 2.1 archives messages in a mbox, but the OP's issue was with the 
web HTML archive which is created from that and the web archive is 
flattened to plain text and all non-plain text parts are stored aside 
and replaced by links.


HyperKitty archives in Mailman 3 are similar in that the plain text 
message content is stored in the database in a hyperkitty_email table 
and non-plain text parts are stored in a hyperkitty_attachment table.


See 
https://mail.python.org/archives/list/hy...@python.org/message/KK6DQWWZEJOGQCF4YNEZUQA3MCBCGQQF/ 
for an example of what this looks like in HyperKitty.


--
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
   https://mail.python.org/archives/list/mailman-users@python.org/
Member address: arch...@jab.org


[Mailman-Users] Re: Missing emails

2023-08-04 Thread Mark Sapiro

On 8/4/23 09:52, t...@barefoottom.com wrote:

I have a list using 2.1.39 in Cpanel.  When I send a message through the list 
subscribers at Gmail, Hotmail, Yahoo, Q.com, and CenturyLink do not receive the 
message.  It does not bounce or go into spam or any folder.  They just seem to 
disappear.  Other email providers seem to be getting the messages.  Any ideas 
on how to fix this?



Either ensure that General Options -> from_is List is either Munge From 
or Wrap Message to apply DMARC mitigations to all mail or in Privacy 
options... -> Sender filters,


dmarc_moderation_action is Munge From or Wrap Message
dmarc_quarantine_moderation_action is Yes

and if the issue is with mail From: the gmail.com domain

dmarc_moderation_addresses contains ^.*@gmail\.com$

Also your list domain should publish an spf record and should DKIM sign 
all outgoing mail.


--
Mark Sapiro The highway is for gamblers,
San Francisco Bay Area, Californiabetter use your sense - B. Dylan

--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
   https://mail.python.org/archives/list/mailman-users@python.org/
Member address: arch...@jab.org


[Mailman-Users] Re: Questions About "An embedded message was scrubbed..."

2023-08-04 Thread Michael Reeder -- Hygeia MS

Mark,

"So is it the case that the message you received contained the actual 
messages and they were only scrubbed in the archive and not in the 
message delivered to List #2 members?  If so, that is a limitation of 
the archiver."


YES.  The issue was this silly.  Thanks for fielding it.  For reasons 
mentioned earlier, I did not spot my error until too late.


Thanks,
-- Michael

*Michael Reeder, LCPC
*
*Hygeia Counseling Services : Baltimore / Mt. Washington Village location*
*410-871-TALK / michael(at)hygeiacounseling.com*


On 8/4/2023 8:00 PM, Mark Sapiro wrote:

On 8/4/23 15:55, Michael Reeder -- Hygeia MS wrote:

Alright -- This is embarrassing...

I may have outsmarted myself...

I was expecting the message to go to my subfolder for List #2 in my 
Thunderbird email client.  Of course it did not.  I have a separate 
subfolder for List #1.  So it went to List #1's message subfolder 
because List #2 was merely a member receiving the message from List #1.


So is it the case that the message you received contained the actual 
messages and they were only scrubbed in the archive and not in the 
message delivered to List #2 members?


If so, that is a limitation of the archiver.


--
Mailman-Users mailing list -- mailman-users@python.org
To unsubscribe send an email to mailman-users-le...@python.org
https://mail.python.org/mailman3/lists/mailman-users.python.org/
Mailman FAQ: http://wiki.list.org/x/AgA3
Security Policy: http://wiki.list.org/x/QIA9
Searchable Archives: https://www.mail-archive.com/mailman-users@python.org/
   https://mail.python.org/archives/list/mailman-users@python.org/
Member address: arch...@jab.org