python script as an emergency mailbox cleaner

[Alex Martelli]

All my mailboxes have been filling up with files of about 130k to 150k, no
doubt copies of some immensely popular virus. So, I've no doubt lost lots
of real mail because of "mailbox full" conditions (the proliferating fake
bounce messages more or less ensure nobody knows their mail to me has
bounced, either).

As an emergency response I and Anna developed, over the last half hour, a
small Python script to be run from cron every few minutes and automatically
scrub any POP3 mailbox from files in the target size range. I'm saving them
to a local file for potential later perusal, but that's obviously easy to
comment out if needed. Here's the tiny script in question...:

import poplib
import time

print 'Start at', time.asctime()

host = 'pop.mail.yahoo .com'
port = 110
user = 'aleaxit'
pasw = 'secret'

logfilename = 'bigjunk'
minsize = 130000
maxsize = 180000
fromtag = 'From al*****@yahoo.c om %s\n'

ps = poplib.POP3(hos t, port)
ps.user(user)
ps.pass_(pasw)

messages = ps.list()
print '%d messages, %d bytes' % (len(messages[1]), messages[-1])

logfile = open(logfilenam e, 'a')

for sms in messages[1]:
sid, ssize = sms.split()
if minsize <= int(ssize) < maxsize:
message = ps.retr(sid)
print 'retrieving and deleting msg#%s, %d bytes, %d lines' % (
sid, message[-1], len(message[1]))
logfile.write(f romtag % time.asctime())
for line in message[1]:
logfile.write(l ine)
logfile.write(" \n")
logfile.write(' \n')
ps.dele(sid)

ps.quit()

print 'Done at', time.asctime()
print
Hope it can come in useful to somebody...!!!

Alex & Anna

[Phil Weldon]

It's a worm. Worm.Automat.AG H. This is going to be a bad one. The worm
installs, among other things, an SMPT engine, searches an infected system
for email address, and sends two types of e-mail: the first is HTML and is
a fake "security patch" supposedly from Microsoft. It looks very official,
but the attachment, 104 KBytes long, is infectious. Norton Antivirus
definitions only began to identify it with the 18SEP03 manual definition
update. The worm also posts to usenet newsgroups. The other type of e-mail
is a fake notification of undeliverable e-mail. This one is a real bear.
There seem to be hundreds variations in the body content and thousands of
variations in the header. The infectious package is also about 104 KBytes.
I'm getting nearly 100 of the two types per hour. Norton Antivirus does not
detect the worm in usnet posts read by Outlook Express Newsreader or Outlook
Newsreader. Only when you attempt to open the attachment or save the
attachment to disk will Norton identify it. Norton will NOT detect the
virus in the newsgroup posts folder NOR will it detect the newsgroup folder
in a full system scan. It will not remove the infected file from the
newsgroup folder, but it will prevent execution of the vermal payload.

Microsoft Outlook with the SP3 security update when used as your e-mail
reader protects against infection. Prior to 18SEP03 Norton did not.

The worm is also retrieving additional variations, so you can expect the
payload size to begin changing soon. The HTML message is easy to identify;
it is always the same (so far), and includes the phrase 'Run attached file'.
The bogus 'Undeliverable e-mail' variations have no commonality but the
payload attachment (that purports to be your bounced e-mail.) This will
likley change soon.

My guess is that the internet will not open on Monday.

Phil Weldon, pw*****@mindspr ing.com

"Alex Martelli" <al***@aleax.it > wrote in message
news:G6******** **************@ news2.tin.it...

All my mailboxes have been filling up with files of about 130k to 150k, no
doubt copies of some immensely popular virus. So, I've no doubt lost lots
of real mail because of "mailbox full" conditions (the proliferating fake
bounce messages more or less ensure nobody knows their mail to me has
bounced, either).

As an emergency response I and Anna developed, over the last half hour, a
small Python script to be run from cron every few minutes and automatically scrub any POP3 mailbox from files in the target size range. I'm saving them to a local file for potential later perusal, but that's obviously easy to
comment out if needed. Here's the tiny script in question...:

import poplib
import time

print 'Start at', time.asctime()

host = 'pop.mail.yahoo .com'
port = 110
user = 'aleaxit'
pasw = 'secret'

logfilename = 'bigjunk'
minsize = 130000
maxsize = 180000
fromtag = 'From al*****@yahoo.c om %s\n'

ps = poplib.POP3(hos t, port)
ps.user(user)
ps.pass_(pasw)

messages = ps.list()
print '%d messages, %d bytes' % (len(messages[1]), messages[-1])

logfile = open(logfilenam e, 'a')

for sms in messages[1]:
sid, ssize = sms.split()
if minsize <= int(ssize) < maxsize:
message = ps.retr(sid)
print 'retrieving and deleting msg#%s, %d bytes, %d lines' % (
sid, message[-1], len(message[1]))
logfile.write(f romtag % time.asctime())
for line in message[1]:
logfile.write(l ine)
logfile.write(" \n")
logfile.write(' \n')
ps.dele(sid)

ps.quit()

print 'Done at', time.asctime()
print
Hope it can come in useful to somebody...!!!

Alex & Anna

[John Roth]

"Phil Weldon" <pw*****@mindsp ring.com> wrote in message
news:ZC******** ***********@new sread1.news.atl .earthlink.net. ..

It's a worm. Worm.Automat.AG H. This is going to be a bad one. The worm
installs, among other things, an SMPT engine, searches an infected system
for email address, and sends two types of e-mail: the first is HTML and is a fake "security patch" supposedly from Microsoft. It looks very official, but the attachment, 104 KBytes long, is infectious. Norton Antivirus
definitions only began to identify it with the 18SEP03 manual definition
update. The worm also posts to usenet newsgroups. The other type of e-mail is a fake notification of undeliverable e-mail. This one is a real bear.
There seem to be hundreds variations in the body content and thousands of
variations in the header. The infectious package is also about 104 KBytes. I'm getting nearly 100 of the two types per hour. Norton Antivirus does not detect the worm in usnet posts read by Outlook Express Newsreader or Outlook Newsreader. Only when you attempt to open the attachment or save the
attachment to disk will Norton identify it. Norton will NOT detect the
virus in the newsgroup posts folder NOR will it detect the newsgroup folder in a full system scan. It will not remove the infected file from the
newsgroup folder, but it will prevent execution of the vermal payload.

Microsoft Outlook with the SP3 security update when used as your e-mail
reader protects against infection. Prior to 18SEP03 Norton did not.

The worm is also retrieving additional variations, so you can expect the
payload size to begin changing soon. The HTML message is easy to identify; it is always the same (so far), and includes the phrase 'Run attached file'. The bogus 'Undeliverable e-mail' variations have no commonality but the
payload attachment (that purports to be your bounced e-mail.) This will
likley change soon.

My guess is that the internet will not open on Monday.

So far, I have seen no copies of the worm on usenet. This may be
the result of my paying $$$ to a good usenet provider (Supernews.)
Unfortunately, my e-mail provider got the stupid idea that "delete"
meant "save a complete copy for 14 days just in case you want
to see it." Most of the stuff is going into two mailboxes that I need
to clean out manually every two or three hours (they're not my inbox,
so the POP3 script won't do it.)

It looks like two worms that just happened to hit at one time,
doesn't it?

John Roth

[Ng Pheng Siong]

According to Phil Weldon <pw*****@mindsp ring.com>:

The other type of e-mail
is a fake notification of undeliverable e-mail. This one is a real bear.
There seem to be hundreds variations in the body content and thousands of
variations in the header.
So far I've caught all of these using this procmail recipe:

:0 B
* ^<BR><BR><BR>(< BR>)*Undeliver
/dev/null

This scans the body for a string matching the regex in the second line. "*"
is a delimiter, not part of the regex.

The first several hundred I got had 3 <BR>'s, then it started coming with
4.

Similarly, the fake MS update first said "September 2003 Cumulative Patch",
then after several hundred I started to see "July 2003". I just saw one
"January 2000". The thing feels like it is mutating in response to filters!
My guess is that the internet will not open on Monday.

Civilisation is under attack.
--
Ng Pheng Siong <ng**@netmemeti c.com>

http://firewall.rulemaker.net -+- Manage Your Firewall Rulebase Changes
http://sandbox.rulemaker.net/ngps -+- Open Source Python Crypto & SSL

[Phil Weldon]

No, it is only one worm with multiple methods of attack.

#1. The fake 'security update' announcement purporting to be from Microsoft
(this e-mail is in HTML) and that includes an infected attachment. If you
don't have protection, opening this e-mail runs the attachment even if you
don't run it. So far the body of this vector doesn't vary, though the
header information does.

#2. The bogus 'Undeliverable e-mail' message in which everything seems to
vary except, so far, the infected attachment that purports to be your
bounced e-mail.

#3. The worm scans PtoP file-sharing data to spread further.

#4. The worm hijacks servers to act as a source from which to download
packages to vary the infectious e-mail.

#5. The worm can post to usenet. Here's the header of a post that appeared
this morning on alt.comp.periph s.mainboard.abi t

Path:
newsspool1.news .atl.earthlink. net!stamper.new s.atl.earthlink .net!elnk-atl-nf
1!newsfeed.eart hlink.net!newsh osting.com!news-xfer2.atl.newsh osting.com!prox
ad.net!proxad.n et!news-hub.cableinet.n et!blueyonder!i nternal-news-hub.cablei
net.net!news-binary.blueyond er.co.uk.POSTED !53ab2750!not-for-mail
FROM: "Clive Skingle" <mu************ *****@ykmke.com >
NEWSGROUPS:
alt.comp.lang.p hp,alt.comp.mai l.postfix,alt.c omp.mail.qmail, alt.comp.malays i
a,alt.comp.peri phs.cdr,alt.com p.periphs.mainb oard.abit,alt.c omp.periphs.mai n
board.asus,alt. comp.periphs.ma inboard.gigabyt e,alt.comp.peri phs.videocards. a
ti
SUBJECT: Watch this critical update from the M$
Mime-Version: 1.0
Content-Type: multipart/mixed; boundary="hilgh fawbnhbqydk"
Lines: 2182
Message-ID: <3R************ @news-binary.blueyond er.co.uk>
Date: Sat, 20 Sep 2003 11:27:59 GMT
NNTP-Posting-Host: 82.32.208.238
X-Complaints-To: ab***@blueyonde r.co.uk
X-Trace: news-binary.blueyond er.co.uk 1064057279 82.32.208.238 (Sat, 20 Sep
2003 11:27:59 GMT)
NNTP-Posting-Date: Sat, 20 Sep 2003 11:27:59 GMT
Organization: blueyonder (post doesn't reflect views of blueyonder)
Xref: news.earthlink. net alt.comp.lang.p hp:12068 alt.comp.mail.q mail:7299
alt.comp.malays ia:17767 alt.comp.periph s.cdr:403271
alt.comp.periph s.mainboard.abi t:567500
alt.comp.periph s.mainboard.asu s:661135
alt.comp.periph s.mainboard.gig abyte:41619
alt.comp.periph s.videocards.at i:145487
X-Received-Date: Sat, 20 Sep 2003 04:28:01 PDT
(newsspool1.new s.atl.earthlink .net)

Phil Weldon, pw*****@mindspr ing.com
"John Roth" <ne********@jhr othjr.com> wrote in message
news:vm******** ****@news.super news.com...

"Phil Weldon" <pw*****@mindsp ring.com> wrote in message
news:ZC******** ***********@new sread1.news.atl .earthlink.net. ..

It's a worm. Worm.Automat.AG H. This is going to be a bad one. The worm installs, among other things, an SMPT engine, searches an infected system for email address, and sends two types of e-mail: the first is HTML and

is

a fake "security patch" supposedly from Microsoft. It looks very

official,

but the attachment, 104 KBytes long, is infectious. Norton Antivirus
definitions only began to identify it with the 18SEP03 manual definition
update. The worm also posts to usenet newsgroups. The other type of

e-mail

is a fake notification of undeliverable e-mail. This one is a real bear. There seem to be hundreds variations in the body content and thousands of variations in the header. The infectious package is also about 104

KBytes.

I'm getting nearly 100 of the two types per hour. Norton Antivirus does

not

detect the worm in usnet posts read by Outlook Express Newsreader or

Outlook

Newsreader. Only when you attempt to open the attachment or save the
attachment to disk will Norton identify it. Norton will NOT detect the
virus in the newsgroup posts folder NOR will it detect the newsgroup

folder

in a full system scan. It will not remove the infected file from the
newsgroup folder, but it will prevent execution of the vermal payload.

Microsoft Outlook with the SP3 security update when used as your e-mail
reader protects against infection. Prior to 18SEP03 Norton did not.

The worm is also retrieving additional variations, so you can expect the
payload size to begin changing soon. The HTML message is easy to

identify;

it is always the same (so far), and includes the phrase 'Run attached

file'.

The bogus 'Undeliverable e-mail' variations have no commonality but the
payload attachment (that purports to be your bounced e-mail.) This will
likley change soon.

My guess is that the internet will not open on Monday.

So far, I have seen no copies of the worm on usenet. This may be
the result of my paying $$$ to a good usenet provider (Supernews.)
Unfortunately, my e-mail provider got the stupid idea that "delete"
meant "save a complete copy for 14 days just in case you want
to see it." Most of the stuff is going into two mailboxes that I need
to clean out manually every two or three hours (they're not my inbox,
so the POP3 script won't do it.)

It looks like two worms that just happened to hit at one time,
doesn't it?

John Roth

[Dennis Lee Bieber]

John Roth fed this fish to the penguins on Saturday 20 September 2003
08:11 am:

So far, I have seen no copies of the worm on usenet. This may be
the result of my paying $$$ to a good usenet provider (Supernews.)
Unfortunately, my e-mail provider got the stupid idea that "delete"
meant "save a complete copy for 14 days just in case you want
to see it." Most of the stuff is going into two mailboxes that I need
to clean out manually every two or three hours (they're not my inbox,
so the POP3 script won't do it.)
Sounds like the "suspect spam" folder I had active on Earthlink... I
was getting "mail box full" emails faster than I could empty that
folder (since it is only accessible via HTTP, and I'm on a dial-up).
I've essentially had to leave my home system running 24 hours a day
with email checks every 8 minutes (the dial-up logs off if idle 10
minutes).

One would think with the rather common format of the subject/from
lines (at least for the M$ Patch variations) the ISP could identify
them as known "spam" (which doesn't count against the 10MB mailbox
limit).

I'd sent an email to their support address... only to receive a form
letter saying they don't accept emails that weren't initiated via their
web site form... And the response to /that/ was never viewed by a
person -- some program scanned it, saw the word "spam" and sent another
form letter specifying they need the full headers of the message
(singular) I was complaining about. Almost makes me want to rig a
filter to send ALL of these to their spam evaluation address -- but if
downloading at ~44K is bad, think of the uplink at ~31K...

-- =============== =============== =============== =============== == <
wl*****@ix.netc om.com | Wulfraed Dennis Lee Bieber KD6MOG <
wu******@dm.net | Bestiaria Support Staff <
=============== =============== =============== =============== == <
Bestiaria Home Page: http://www.beastie.dm.net/ <
Home Page: http://www.dm.net/~wulfraed/ <

[James Kew]

"Phil Weldon" <pw*****@mindsp ring.com> wrote in message
news:ZC******** ***********@new sread1.news.atl .earthlink.net. ..

My guess is that the internet will not open on Monday.

Yeah, well, death of the Internet's been predicted many times before and
hasn't happened yet.

F-Secure's writeup is pretty good at describing the various attacks and
texts the worm uses:
http://www.f-secure.com/v-descs/swen.shtml

FWIW, for me Bayesian filtering is doing a pretty good job on both the fake
security advisories and the fake bounce messages. (Somewhat ashamedly, I'll
admit to using POPFile (Perl) rather than the SpamBayes (Python) -- as a
POP3 proxy solution it seemed slightly slicker at the time...)

James

[netvegetable]

On Sat, 20 Sep 2003 14:37:45 +0000, Phil Weldon wrote:

It's a worm. Worm.Automat.AG H. This is going to be a bad one. The worm
installs, among other things, an SMPT engine, searches an infected system
for email address, and sends two types of e-mail: the first is HTML and
is a fake "security patch" supposedly from Microsoft. It looks very
official, but the attachment, 104 KBytes long, is infectious. Norton
Antivirus definitions only began to identify it with the 18SEP03 manual
definition update. The worm also posts to usenet newsgroups. The other
type of e-mail is a fake notification of undeliverable e-mail. This one
is a real bear. There seem to be hundreds variations in the body content
and thousands of variations in the header. The infectious package is also
about 104 KBytes. I'm getting nearly 100 of the two types per hour.
Norton Antivirus does not detect the worm in usnet posts read by Outlook
Express Newsreader or Outlook Newsreader. Only when you attempt to open
the attachment or save the attachment to disk will Norton identify it.
Norton will NOT detect the virus in the newsgroup posts folder NOR will it
detect the newsgroup folder in a full system scan. It will not remove the
infected file from the newsgroup folder, but it will prevent execution of
the vermal payload.

Microsoft Outlook with the SP3 security update when used as your e-mail
reader protects against infection. Prior to 18SEP03 Norton did not.

The worm is also retrieving additional variations, so you can expect the
payload size to begin changing soon. The HTML message is easy to
identify; it is always the same (so far), and includes the phrase 'Run
attached file'. The bogus 'Undeliverable e-mail' variations have no
commonality but the payload attachment (that purports to be your bounced
e-mail.) This will likley change soon.

My guess is that the internet will not open on Monday.

The worm uses newsgroup info from Outlook Express as well.

What's to stop a worm from retrieving header file info, and using the NNTP
posting header to actually hack people's computers?

--
to email me remove underscore _
death to spammers

[Phil Weldon]

Inboxer for Outlook is a plugin written with Python that will analyze
collections of what you consider legitimate e-mail and and what you consider
illegitimate e-mail. I downloaded it and ran it against a collection of
1500 messages generated by the Worm.Automat.AH B and 265 the latest
legitimate e-mails I've received. After the analysis, Inboxer has detected
about 250 Worm.Automat.AH B generated messages with no false negatives and no
false positives (granted there were only three new legitimate e-mails.

Phil Weldon

"Alex Martelli" <al***@aleax.it > wrote in message
news:G6******** **************@ news2.tin.it...

All my mailboxes have been filling up with files of about 130k to 150k, no
doubt copies of some immensely popular virus. So, I've no doubt lost lots
of real mail because of "mailbox full" conditions (the proliferating fake
bounce messages more or less ensure nobody knows their mail to me has
bounced, either).

As an emergency response I and Anna developed, over the last half hour, a
small Python script to be run from cron every few minutes and automatically scrub any POP3 mailbox from files in the target size range. I'm saving them to a local file for potential later perusal, but that's obviously easy to
comment out if needed. Here's the tiny script in question...:

import poplib
import time

print 'Start at', time.asctime()

host = 'pop.mail.yahoo .com'
port = 110
user = 'aleaxit'
pasw = 'secret'

logfilename = 'bigjunk'
minsize = 130000
maxsize = 180000
fromtag = 'From al*****@yahoo.c om %s\n'

ps = poplib.POP3(hos t, port)
ps.user(user)
ps.pass_(pasw)

messages = ps.list()
print '%d messages, %d bytes' % (len(messages[1]), messages[-1])

logfile = open(logfilenam e, 'a')

for sms in messages[1]:
sid, ssize = sms.split()
if minsize <= int(ssize) < maxsize:
message = ps.retr(sid)
print 'retrieving and deleting msg#%s, %d bytes, %d lines' % (
sid, message[-1], len(message[1]))
logfile.write(f romtag % time.asctime())
for line in message[1]:
logfile.write(l ine)
logfile.write(" \n")
logfile.write(' \n')
ps.dele(sid)

ps.quit()

print 'Done at', time.asctime()
print
Hope it can come in useful to somebody...!!!

Alex & Anna

[Karlheinz klingbeil]

Alex Martelli wrote:

All my mailboxes have been filling up with files of about 130k to 150k, no
doubt copies of some immensely popular virus. So, I've no doubt lost lots
of real mail because of "mailbox full" conditions (the proliferating fake
bounce messages more or less ensure nobody knows their mail to me has
bounced, either).

As an emergency response I and Anna developed, over the last half hour, a
small Python script to be run from cron every few minutes and
automatically
scrub any POP3 mailbox from files in the target size range. I'm saving
them to a local file for potential later perusal, but that's obviously

I have made a quick and dirty pop-cleaner, mor configurable with size, regex
to deny and regular pattern match to explicitly allow mails
look at http://www.lunqual.de/popclean.zip (only 3kb)

--
Greetz.... lunqual
http://www.lunqual.de