[Gossip] Importing existing archives

[Kelly D. Grills]

Greetings,

Firstly, thanks to Jeff for maintaining this service,
and Michael for the handy bounce.pl

I've recently subscribed a list for archival
([EMAIL PROTECTED]), for which I have 3 yrs.
of archived messages to import (50MB or so).

I've been importing 100 or so messages twice daily
(morning and evening) for the past couple of days.

I'm wondering how many messages I can import at a time
without unduly straining the system, and if there is a
typical slow time which would be better to add these archives.

Cheers,

Kelly

-- 
Kelly D. Grills
[EMAIL PROTECTED]



msg00690/pgp0.pgp
Description: PGP signature

Re: [Gossip] Some Messages not archived to wedi-transactions

[Earl Hood]

On January 7, 2003 at 15:42, "William J. Kammerer" wrote:

> The listserver is managed by an unrelated company.  They would refuse to
> look into the problem, as I have already asked them why messages arrive
> so late at my mail server (i.e., two day delays sometimes) - and they
> say it is my problem (at my ISP)!  At least in the case of describing my
> problems, I can show them my headers and tell them when my mail server
> received the messages.

Some service.  You may want to considering hosting the list yourself
or find a better provider.

I think they are wrong about it being your ISP.  The sample header
your provided shows received header dates of 4 Jan 2003, but the
Date: field having a 2 Jan date.  Since the message is what the
listserv creates, the received headers of when the message was
sent by the author to the listserv are not present.

>From what I see of the header, I fail to see how the list service
provider can conclude it is your ISP's problem.  Have you polled
other list subscribers about times they received  the message?

> But I am fairly certain that I have received all messages posted to the
> listserve in question between 12-30 and today.  The messages I described
> awhile back on Gossip were received by me, but were not archived by Mail
> Archive. This is a common occurrence (on various of the WEDI listserve
> archives).  I discover it quite frequently when attempting to refer
> someone to a posting via URL - only to find the posting is missing from
> the archive.
> 
> I suppose it's possible that I receive all messages (even if some are
> delayed), while Mail Archive does not.

Well w/o decent cooperation from your list hosting provider, it
may never be known.  However, we can make reasonable speculations on
what it may be.

First, it appears the missing messages occured when there was large
delays in the listserv sending out messages.  If you have no other
cases when messages are "lost", then it provides more weight that it
is a listserve problem.

Second, no other reports of select missing messages for other
mail-archive.com archives have been reported for the time period in
question.  If mail-archive was somehow involved, then it would seems
other archives would have the same problem.  If no one else reports
a similiar problem to what you have, it again puts more weight that
it is a listserve problem.

If it really important to have the messages archived, have a
look at .  You could
resend the messages you got back to mail-archive.com as described
in the FAQ in order to get them to show up in the archive.

--ewh

P.S. BTW, the Lyris listserv practice of changing the message-id
violates RFC 2822.

___
Gossip mailing list
[EMAIL PROTECTED]
http://jab.org/cgi-bin/mailman/listinfo/gossip

Re: [Gossip] Some Messages not archived to wedi-transactions

[Jeff Breidenbach]

I'm sending the output of:

zgrep "wedi-transactions" /var/log/exim/mainlog*

to William via private email. William, analyze to your heart's
content, and if you find something interesting, useful, and specific,
let me know.  Otherwise, I'm starting to wind down in motivation to
track this one down; it sounds like the list server/service in
question is both broken and uncooperative, and I'm mainly motivated to
make sure all is well with mail-archive.

-Jeff

PS. I checked secondary MX; nothing relevant there.

___
Gossip mailing list
[EMAIL PROTECTED]
http://jab.org/cgi-bin/mailman/listinfo/gossip

[Gossip] Importing existing archives

[Jeff Breidenbach]

Wow, lot's of traffic on gossip recently.

>I'm wondering how many messages I can import at a time
>without unduly straining the system, and if there is a
>typical slow time which would be better to add these archives.

50MB is nothing in terms of bandwidth; but if you send all the
messages all at once you might strain Mail-Archive's max number of
connections for the Mail Transfer Agent. Put in a 3 second 
delay between messages (bounce.pl supports this, I think) and
you will be totally fine.

Weekends are lighter in terms of traffic, but again, we
aren't talking about a lot of mail here so it doesn't really
matter.

-Jeff

___
Gossip mailing list
[EMAIL PROTECTED]
http://jab.org/cgi-bin/mailman/listinfo/gossip