How to filter based on "garbage" subjects ... ?
I've yet to be able to come up with a sieve rule that will allow me to filter all "garbage" subjects to a seperate folder ... you know the ones that look like: Subject: =?euc-kr?q?(=B1=A4=B0=ED)=B5=F0=C1=F6= I've even tried to use Pine filtering to filter based on 8bit subjects, but it doesn't pick them up either ... For instance, under Pine, if I try to select all subjects with =B1= in them, which the above contains, it selects nothing, so I'm figuring there has to be some control characters in there somewhere ... ? Thoughts?
Re: How to filter based on "garbage" subjects ... ?
On Tue, Sep 30, 2003 at 11:32:56AM -0300, Marc G. Fournier wrote: > > I've yet to be able to come up with a sieve rule that will allow me to > filter all "garbage" subjects to a seperate folder ... you know the ones > that look like: > > Subject: =?euc-kr?q?(=B1=A4=B0=ED)=B5=F0=C1=F6= I am not quite sure that this would be desirable. The Subject: here have just been encoded in a different character set; that's RFC-compliant AFAIK. You MUA should display the correct text, if it is possible. In your example, it is probably not since this look like a Korean character set, I guess. If you want, I can shoot you an email off-list that will have 8-bit character encoded this way in the subject. -- Etienne GoyerLinux Québec Technologies Inc. http://www.LinuxQuebec.com [EMAIL PROTECTED]
Re: How to filter based on "garbage" subjects ... ?
Hi Marc, --On Tuesday, September 30, 2003 11:32 -0300 "Marc G. Fournier" <[EMAIL PROTECTED]> wrote: | | I've yet to be able to come up with a sieve rule that will allow me to | filter all "garbage" subjects to a separate folder ... you know the ones | that look like: | | Subject: =?euc-kr?q?(=B1=A4=B0=ED)=B5=F0=C1=F6= | | I've even tried to use Pine filtering to filter based on 8bit subjects, | but it doesn't pick them up either ... | | For instance, under Pine, if I try to select all subjects with =B1= in | them, which the above contains, it selects nothing, so I'm figuring there | has to be some control characters in there somewhere ... ? | | Thoughts? | From the SIEVE RFC: | Implementations decode header charsets to UTF-8. Two strings are | considered equal if their UTF-8 representations are identical. | Implementations should decode charsets represented in the forms | specified by [MIME] for both message headers and bodies. | Implementations must be capable of decoding US-ASCII, ISO-8859-1, | the ASCII subset of ISO-8859-* character sets, and UTF-8. i.e. SIEVE should be decoding the =?euc-kr? header into its utf8 form BEFORE doing the comparison with the text you provide. i.e. the =B1 quoted-printable encoded character will have been decoded into the utf8 representation of that for the euc-kr character set, and thus won't match the text you provide. Actually the euc-ky character set is a multibyte character set so in fact the unicode character is made up of =B1 and =A4. By my reckoning that is the unicode character 0xad11 - I'll leave you to work out the utf8 encoding of that! Basically you are going to have a hard time trying to filter on arbitrary unicode characters in some random character set given that sieve expects utf8 in its scripts. -- Cyrus Daboo
Re: How to filter based on "garbage" subjects ... ?
On Tue, 30 Sep 2003, Cyrus Daboo wrote: > i.e. SIEVE should be decoding the =?euc-kr? header into its utf8 form > BEFORE doing the comparison with the text you provide. i.e. the =B1 > quoted-printable encoded character will have been decoded into the utf8 > representation of that for the euc-kr character set, and thus won't match > the text you provide. Actually the euc-ky character set is a multibyte > character set so in fact the unicode character is made up of =B1 and =A4. > By my reckoning that is the unicode character 0xad11 - I'll leave you to > work out the utf8 encoding of that! > > Basically you are going to have a hard time trying to filter on arbitrary > unicode characters in some random character set given that sieve expects > utf8 in its scripts. Note that there may be some breakage in Cyrus's sieve UTF-8 handling. At the very minimum: https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=1710 https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=1725 -Rob -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Rob Siemborski * Andrew Systems Group * Cyert Hall 207 * 412-268-7456 Research Systems Programmer * /usr/contributed Gatekeeper
Re: How to filter based on "garbage" subjects ... ?
--On Tuesday, September 30, 2003 11:32:56 -0300 "Marc G. Fournier"
<[EMAIL PROTECTED]> wrote:
I've yet to be able to come up with a sieve rule that will allow me to
filter all "garbage" subjects to a seperate folder ... you know the ones
that look like:
Subject: =?euc-kr?q?(=B1=A4=B0=ED)=B5=F0=C1=F6=
I've even tried to use Pine filtering to filter based on 8bit subjects,
but it doesn't pick them up either ...
For instance, under Pine, if I try to select all subjects with =B1= in
them, which the above contains, it selects nothing, so I'm figuring there
has to be some control characters in there somewhere ... ?
As another poster noted, these are not 'garbage'; they just have a
non-default character set specified. Since they look like garbage
to you; you are obviously not using a MUA that can handle that charset
(or possibly can't handle the charset identifiers at all); so filtering
them as a personal choice is reasonable.
The charset identifier is the bit at the beginning that starts with '=?'
and runs through the next question mark. I haven't tried filtering that
in sieve; I don't know if it's automatic conversion effectively hides the
charset identifier. But I do have an Exim ACL rule to reject a couple of
asian charsets on a domain where I know that nobody can read them. (Gets
rid of a lot of apparent spam.) Filtering for '=?euc-kr?' and a small
number of similar values ('=?big5?', '=?gb2312', etc.) should get rid
of them.
-Pat
Sieve interface for spam filtering scripts?
Hello, Does anyone have a simple sieve web interface for creating a filter for spam-tagged messages? We'll be tagging spam messages with a "X-Spam-Status: Yes" header or somesuch and now I'm looking for an easy Sieve interface for creating simple sieve scripts to filter spam-tagged messages. At the moment some of our users are using Websieve but I would like to offer an easier web form. Does anyone already have one? If there is one publicly available, I'd be happy to see it. Otherwise I'll just have to make one. :-) Thanks, -- Tuuli Tuominen
Sieve interface for spam filtering scripts?
Hello, Does anyone have a simple sieve web interface for creating a filter for spam-tagged messages? We'll be tagging spam messages with a "X-Spam-Status: Yes" header or somesuch and now I'm looking for an easy Sieve interface for creating simple sieve scripts to filter spam-tagged messages. At the moment some of our users are using Websieve but I would like to offer an easier web form. Does anyone already have one? If there is one publicly available, I'd be happy to see it. Otherwise I'll just have to make one. :-) Thanks, -- Tuuli Tuominen
Re: Sieve interface for spam filtering scripts?
On Tue, 30 Sep 2003, Tuuli K Tuominen wrote: > Hello, > Does anyone have a simple sieve web interface for creating a filter > for spam-tagged messages? We'll be tagging spam messages with a You might want to look at the Horde projects Ingo. If your users are used to use Imp as their email client then it's interface is quite intuitive. The cvs releng version of ingo should and does work with horde 2.x versions. Though, the releng version of ingo does have some features, which might make it unsuitable to your enviroment, especially if you are using a setup that consists of multiple separate imap servers. -- Leena Heino University of Tampere / Computer Centre ( liinu at uta.fi ) ( http://www.uta.fi/laitokset/tkk )
Re: Sieve interface for spam filtering scripts?
Squirrelmail has a sieve plugin. Maybe give that a try ;) On Tue, 2003-09-30 at 15:03, Tuuli K Tuominen wrote: > Hello, > Does anyone have a simple sieve web interface for creating a filter > for spam-tagged messages? We'll be tagging spam messages with a > "X-Spam-Status: Yes" header or somesuch and now I'm looking for an easy > Sieve interface for creating simple sieve scripts to filter spam-tagged > messages. At the moment some of our users are using Websieve but I would > like to offer an easier web form. Does anyone already have one? If there > is one publicly available, I'd be happy to see it. Otherwise I'll just > have to make one. :-) > > Thanks,
Re: Sieve interface for spam filtering scripts?
we use ingo, which is part of the whole horde framework ... On Tue, 30 Sep 2003, Tuuli K Tuominen wrote: > Hello, > Does anyone have a simple sieve web interface for creating a filter > for spam-tagged messages? We'll be tagging spam messages with a > "X-Spam-Status: Yes" header or somesuch and now I'm looking for an easy > Sieve interface for creating simple sieve scripts to filter spam-tagged > messages. At the moment some of our users are using Websieve but I would > like to offer an easier web form. Does anyone already have one? If there > is one publicly available, I'd be happy to see it. Otherwise I'll just > have to make one. :-) > > Thanks, > -- > Tuuli Tuominen >
Re: Sieve interface for spam filtering scripts?
On Tue, 30 Sep 2003, Pat Lashley wrote: > I've recently upgraded my Exim setup to include ExiScan-ACL and > SpamAssassin. It is configured to add several headers for different > levels of filtering capability. (The ones I chose were taken from > the examples for ExiSan-ACL and SA; so they should be fairly common. > They differ slightly from the set which SA can be configured to add.) (lots of interesting stuff snipped) Ah, very good. How do your users create their sieve scripts then? I assume you have some basic ways of creating filters and then more advanced users can create their own scripts? Do your users use Websieve? -- Tuuli Tuominen
Re: Sieve interface for spam filtering scripts?
--On Tuesday, September 30, 2003 21:45:11 +0300 Tuuli K Tuominen
<[EMAIL PROTECTED]> wrote:
Hello,
Does anyone have a simple sieve web interface for creating a filter
for spam-tagged messages? We'll be tagging spam messages with a
"X-Spam-Status: Yes" header or somesuch and now I'm looking for an easy
Sieve interface for creating simple sieve scripts to filter spam-tagged
messages. At the moment some of our users are using Websieve but I would
like to offer an easier web form. Does anyone already have one? If there
is one publicly available, I'd be happy to see it. Otherwise I'll just
have to make one. :-)
I've recently upgraded my Exim setup to include ExiScan-ACL and
SpamAssassin. It is configured to add several headers for different
levels of filtering capability. (The ones I chose were taken from
the examples for ExiSan-ACL and SA; so they should be fairly common.
They differ slightly from the set which SA can be configured to add.)
The X-Spam-Score header contains a floating-point number, which may
include a leading sign, followed by a parenthesized string. In the
string will be a single slash, or a series of plus or minus signs.
The number of plus or minus signs equals the integer portion of the
spam score. Thus:
X-Spam-Score: 12.1 ()
It is very easy for even fairly primitive mail filtering programs
to recognize a number of plus or minus signs. In Sieve:
if header :contains [ "X-Spam-Score" ] [ "++" ] {
fileinto "INBOX.SPAM.score-10+" ;
}
elsif header :contains [ "X-Spam-Score" ] [ "+" ] {
fileinto "INBOX.SPAM.score-5+" ;
}
elsif header :contains [ "X-Spam-Score" ] [ "-" ] {
fileinto "INBOX.HAM.score-5+" ;
}
I also provide an X-Spam-Score-Int; which is just the spam score multiplied
by 10 to create an integer. (For filters that can deal with integers but
not floating point.)
And there's an 'X-Spam-Flag: YES' header added if the spam score is over
some site-specified limit. (But lower than the automatic rejection limit.)
(I also include the SA spam report as a header; which could be used by
more sophisticated filters based on particular tests matched by SA.)
-Pat
Summary/Confirmation - RedHat sasl libraries don't work with 2.2.x
I'd like to note for the record (and anyone else searching) that the sasl that ships with Redhat WILL NOT work with 2.2.1. It returns OK with an empty realm. For unknown reasons, Cyrus then returns an "Login failed: can't request info until later in exchange" I'm not sure why Cyrus 2.2.1 is unhappy with the OK response, but it is. As per the only thread I could find on this subject, upgrading to sasl 2.1.15 solved the problem. I left the Redhat plugins and saslauthd in place, just replaced the shared library and it works. So Rob's suggestion was correct. (Sorry, can't find the original thread handy) Can someone with a RedHat contract persuade them to provide updates from 2.1.10-3 to 2.1.15 ? As stated above, I'm just reaffirming this for other searchers. When I'm searching for solutions to problems, I always appreciate finding confirmation that a problem was replicable. -- Joe Rhett Chief Geek [EMAIL PROTECTED] Isite Services, Inc.
2.2.1-beta, Redhat 8; lmtpd continuously stuck on select( 0, ...)
Okay, I've had no drama at all getting recent versions of 2.2 to work like
a champ on Solaris, but Redhat appears to be a beast of a different color.
So the imap server is up and running and seems to be working. Squirrelmail
is happy anyway ;-) But delivering mail to the system is hanging. Running
deliver by hand hangs, and stracing deliver shows that it opens the LMTP
socket and then waits for a response.
strace of the running lmtpd process shows only:
select(0, NULL, NULL, NULL, {1, 0}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {1, 0}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {1, 0}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {1, 0}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {1, 0}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {1, 0}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {1, 0}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {1, 0}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {1, 0}) = 0 (Timeout)
select(0, NULL, NULL, NULL, {1, 0}) = 0 (Timeout)
$ lsof /var/imap/socket/lmtp
COMMAND PID USER FD TYPE DEVICE SIZENODE NAME
master 24362 cyrus 19u unix 0xc3c0a580 3308812 /var/imap/socket/lmtp
lmtpd 24376 cyrus4u unix 0xc3c0a580 3308812 /var/imap/socket/lmtp
The only thing related to this I can find -- and I'm not sure it's related
at all, is:
http://www.irbs.net/internet/info-cyrus/0209/0163.html
I'm happy to debug this, but I need to know what to look for. Tell me what
you need to know.
1. Is there anything about linux iptables that might intercept sockets?
2. What syntax can I put in cyrus.conf run lmtp in debug mode? Or strace?
It does not appear to enjoy "strace lmtpd 2>&1 /tmp/lmtpd.debug" as the
daemon to invoke. Should I make this a script and redirect, or ..?
Also, Ken! I could have swore you put a "-v" in deliver a while back so that we could
watch the LMTP conversation .. or am I misremembering?
--
Joe Rhett Chief Geek
[EMAIL PROTECTED] Isite Services, Inc.
Re: Sieve interface for spam filtering scripts?
--On Tuesday, September 30, 2003 22:12:04 +0300 Tuuli K Tuominen <[EMAIL PROTECTED]> wrote: Ah, very good. How do your users create their sieve scripts then? I assume you have some basic ways of creating filters and then more advanced users can create their own scripts? Do your users use Websieve? Ah, well, err, um, mumble... At the moment, only users with shell access can install sieve scripts. I'm still checking out various possibilities for mail-only users. Since I have Horde set up with IMP for webmail access; onoe of the things I'll be checking out is Ingo. (Horde filtering interface. To be integrated into the next major version of IMP.) I'll also be checking out Websieve, Smartsieve, and "damn, none of these do what I want so I'll have to roll my own". -Pat
Re: Sieve interface for spam filtering scripts?
On Tue, Sep 30, 2003 at 10:08:21PM +0300, Leena Heino wrote: > On Tue, 30 Sep 2003, Tuuli K Tuominen wrote: > > > Hello, > > Does anyone have a simple sieve web interface for creating a filter > > for spam-tagged messages? We'll be tagging spam messages with a > > You might want to look at the Horde projects Ingo. If your users are used > to use Imp as their email client then it's interface is quite intuitive. > The cvs releng version of ingo should and does work with horde 2.x > versions. Though, the releng version of ingo does have some features, > which might make it unsuitable to your enviroment, especially if you are > using a setup that consists of multiple separate imap servers. I would second that suggestion. Also, Ingo come with vacation, forward, and white/blacklisting ready-made script. Currently, it only support PLAIN authentication, but I have a patch that implement CRAM/DIGEST-MD5 if you are interested. My patch also implement REFERRAL in case you use it in a Murder environment. -- Etienne GoyerLinux Québec Technologies Inc. http://www.LinuxQuebec.com [EMAIL PROTECTED]
Problem connecting to cyrus-imapd
I found a strange problem with cyrus-imapd 2.2.1 latest cvs. When I try to connect from localhost : telnet localhost 110 and the give user and password all it's OK but if I try the same using the hostname I receive the error : -ERR [AUTH] Invalid login I setup defaultdomain in imapd.conf correctly, but was it's strange is the message that I found in the log : plaintext [EMAIL PROTECTED] SASL(-13): user not found: checkpass failed but x2000.it it's not my domain ! and it's not configured in SASL. I configure sasl with auxprop. Any idea ??? Thanks vittorio -- Vittorio manfredini This message was sent using IMP, the Internet Messaging Program.
Re: 2.2.1-beta, Redhat 8; lmtpd continuously stuck on select( 0, ...)
On Tue, Sep 30, 2003 at 12:15:45PM -0700, Joe Rhett wrote: > Okay, I've had no drama at all getting recent versions of 2.2 to work like > a champ on Solaris, but Redhat appears to be a beast of a different color. It's red. ;) > I'm happy to debug this, but I need to know what to look for. Tell me what > you need to know. Which MTA do you use ? Postfix under RedHat is chroot'ed by default; you need to configure Postfix to connect to /etc/???, such as : mailbox_transport = lmtp:unix:/etc/lmtpproxy and create the socket under the chroot jail as /var/spool/postfix/etc/lmttproxy. -- Etienne GoyerLinux Québec Technologies Inc. http://www.LinuxQuebec.com [EMAIL PROTECTED]
System I/O error
Hi guys. I know that questions like this might be asked thousands of times but I am stuck. I have deleted a user mailbox that had troubles, and I can´t eliminate this from the database: user.username.INBOX^Sent: System I/O error No such file or directory user.username.INBOX^Trash: System I/O error No such file or directory user.username.Trash.INBOX^Drafts: System I/O error No such file or directory I also have tried with reconstruct, even when the user account was alive, and creating the mentioned directories. Regards
Re: System I/O error
On Tue, 30 Sep 2003, Marcelino Vallejo wrote: > Hi guys. > > I know that questions like this might be asked thousands of times but I > am stuck. > I have deleted a user mailbox that had troubles, and I can´t eliminate > this from the database: Don't do that. > user.username.INBOX^Sent: System I/O error No such file or directory > user.username.INBOX^Trash: System I/O error No such file or directory > user.username.Trash.INBOX^Drafts: System I/O error No such file or directory > > I also have tried with reconstruct, even when the user account was > alive, and creating the mentioned directories. You can stop the server, dump the mailbox list, remove the affected entries, and undump the mailbox list. You can also play games that try to "fake out" reconstruct, but that's probably not a great idea. Newer reconstructs do slightly better in this situation (by which I mean 'current cvs'). -Rob -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=- Rob Siemborski * Andrew Systems Group * Cyert Hall 207 * 412-268-7456 Research Systems Programmer * /usr/contributed Gatekeeper
Re: Sieve interface for spam filtering scripts?
> Squirrelmail has a sieve plugin. Maybe give that a try ;) I'll second that. I'm using Squirrelmail and the sieve plugin in production, and can vouch for it. Works very well, and users have no problem setting up spam filtering. I use sendmail/milter/spamassassin to tag all incoming mail - it's then up to each user to enable the filter or not for their account, as they so choose. The Sieve plugin also provides easy set up of out of office/vacation/canned autoresponse to some aliases and various other things. Mike.
[no subject]
Re: 2.2.1-beta, Redhat 8; lmtpd continuously stuck on select( 0, ...)
On Tue, Sep 30, 2003 at 04:20:04PM -0400, Etienne Goyer wrote: > On Tue, Sep 30, 2003 at 12:15:45PM -0700, Joe Rhett wrote: > > Okay, I've had no drama at all getting recent versions of 2.2 to work like > > a champ on Solaris, but Redhat appears to be a beast of a different color. > > It's red. ;) > > > I'm happy to debug this, but I need to know what to look for. Tell me what > > you need to know. > > Which MTA do you use ? Postfix under RedHat is chroot'ed by default; > you need to configure Postfix to connect to /etc/???, such as : > > mailbox_transport = lmtp:unix:/etc/lmtpproxy > > and create the socket under the chroot jail as /var/spool/postfix/etc/lmttproxy. I've not yet configured an MTA. We're focused on a system injecting messages into IMAP. I'm just using deliver by hand at this point in time. (and also very aware of the postfix chroot situation) Focus on the lmtpd -- what is the select failing on? Is that a lock failing, or the socket itself? -- Joe Rhett Chief Geek [EMAIL PROTECTED] Isite Services, Inc.
