Spam Spam Spam
Spam Spam Spam Spam! It's making me nuts. I currently get somewhere around 100 spams a day on my e-mail and it finally prompted me to install a filter but damit, what's the point?

First off I use Microsoft Outlook for my e-mail. No, I have never gotten a virus. I like having my schedule and e-mail in the same program. Many programs have that now but they didn't when I started using Outlook in 1995. Outlook does have it's problems though, mostly having to do with editing messages and addresses, it's editor sucks and so does it's auto address completion. Although Microsoft is supposedly going to fix all that in the next version I thought about switching but probably the single most important feature for me is Outlook's AutoPreview lists.

Basically Outlook will show you the first 3 lines worth of each unread message like this.


I love that feature, it makes it easy to see what I want to respond to without having to select each e-mail and it makes it easy to spot the spam and delete it. In fact, I hate the preview-pane that is on many e-mail programs. I means I can't see as much of my mail list as I would like and it means I might actually have to see some of the HTML based spam ads as they appear in it so I turn that off.

I've tried downloading a few other e-mail clients, a bunch of people were raving about the Mozilla group's e-mail client but it didn't have AutoPreview mode so it was a no go for me.

But, even so, lately there's been too much spam. I'd say it's doubled in the last 2 months. So, I finally broke down and looked for some e-mail spam filters. Many of them are POP/IMAP proxies. They are a program you install on your machine, you configure them to get your e-mail and then you re-configure your normal e-mail program to get your e-mail from them. That way there's this middle program between your e-mail provider and your e-mail program and it filters out the spam. The problem is, who wants to run yet another program? Now when you read your e-mail you have to also go over to that other program and check that it didn't mess up and mark stuff as spam that it shouldn't have AND you have to tell it which messages are spam that it didn't figure out.

I found one that is for Outlook users in particular as it's a plugin for Outlook. It's called Motino and it just adds 2 simple buttons to Outlook.


You just select any spam in your Inbox and press "Junk Mail". Motino then watches as new e-mail comes in and anything it thinks is junk mail it moves to a folder called "Motino Quarantine". You can go over to that folder and select any messages that aren't spam and pick "Good Mail". After you've done for a couple of days it gets pretty accurate. In fact in my last 200 e-mails it had no false positives. It's great, it's super simple!

There's a psychologic benefit in that before it felt like my Inbox was full of spam. Like it was being abused. Now, my Inbox has no spam, it's all been moved to the quarantine folder and I get to go search for diamonds in the shit when I go to the quarantine and see if there is any good mail.

But, that's just the problem, there's a chance with any of these filtering softwares for it to get a false positive. What if that false positive is a job offer or important e-mail about an account, or e-mail from friend or business person about a meeting/appointment that needs to be re-scheduled, etc. Since I can't trust it I've got to go look at the Quarantine folder and double check. If I was using other software it'd be even worse since I'd have to go into that other software to find the mislabled e-mails.

So, what have I really saved? It hasn't really dealt with the spam at all. I still have to manually sort through it all.

And that's not the end of it, finally, like I predicted before, blogs are getting spammed and in particular, my family's blogs have recently gotten spammed.

There are similar solutions for that but they have the same problem, you have to trust the filter. The only good part is most people are unlikely to get any comments declared spam that would effect their life so they can maybe just not even look at the spam to see there are any false positives. Except of course you never know, maybe you are blogging about a problem you are having and someone posts the solution but for some reason the filter thought it was spam.

Spammers, just like other crooks, are going to ruin it for the rest of us. If everyone was nice we could all just, for the most part, live in piece. We wouldn't need police or locks or car alarms or lo-jacks. But the few crooks ruin it for the rest of us and we need all that stuff. The same is happening on the net. One way or another we will have to deal with this since spam is making e-mail and the net unusable and that will mean things like having net police, spam filters, blacklists and a zillion other problematic and annoying things



By the way, if you know of any other e-mail software with the AutoPreview (3 lines per message) lists please tell me so I can take a look.

Comments:

Motino vs. SpamBayes [ e ]

Hey Gregg -

Have you also tried the SpamBayes plug-in?

I don't know which one was around first, but it seems that it is very similar to Motino...Any thoughts as to whether one has advantages over the other?  Do they both use the Bayesian method?

I have been having pretty decent luck with SpamBayes, but as you said, the time savings are lessened by having to check for false positives.

Still, when you're talking about 100 or more spams a day, I still feel like these types of filters do save a fair amount of aggravation.  Once the filters get to a certain level of accuracy, it really does take far less time to sift through the filtered crap and find the "gems" than it would to manually delete every incoming spam message.

Actually, this brings up an interesting point: Isn't it amazing how the human brain can sift through a big list of messages and spot all spams almost instantaneously?  No matter what tricks spammers try, it's always really obvious to human eyes when a message is spam.  I suppose no one will truly solve the spam problem until artificial intelligence is perfected!

posted by BionicRoachOctober 21, 2003 at 0:59

ORDB [ e ]

Does your mailserver blackhole open mail relays? If it doesn't, get one that does.

http://ordb.org

posted by dmaOctober 21, 2003 at 3:05

SpamBayes? [ e ]

I had not heard of SpamBayes.  I checked out the link and could not find docs on the OutlookPlugin.  I'm not really in the mood to try another right now so I can't really compare.

It mentioned one interesting feature which is it will sort e-mail into spam, ham and unsure.  Spam means it's like 90% it's spam.  Ham means it's good e-mail and unsure is somewhere in between.  So, **IF** you trusted it you might be able to let it just delete spam and you'd only have to deal with the unsure folder.

So far, after a few days with Motino it seems to be working around 98-99% accurate.  It seems like just within the last week my spam has jumped to 150 a day!!!  Ugh!

posted by greggmanOctober 21, 2003 at 11:14

[ e ]

The way I see it, anti spam software can be broken down into three main categories:

1. Server side filters, where the filter is installed on the mailserver and prevents any spam from even getting into a user's mailbox. These filters are often not completely effective because of the fear of false negatives, but they are effective in decreasing the amount of spam to a manageable level. Useless from an end user perspective unless the end user owns his own mailserver.

2. Client side filters, these filters sit on a user's PC and filters spam into a quarantine or spam folder. To me these are probably the most effective in terms of filtering spam away from the inbox as with a little bit of training, a high degree of accuracy can be achieved. Unfortunately, these programs do nothing to stop the spam from reaching the user. To me, it feels too much like a bandaid. Users will still be downloading the spam, they just won't see it.

3. Client side, mailserver filtering, the third type are filters that access the email like an email client, it filters and deletes the spam at the mailserver saving the user from downloading the spam. Some even have the capability to bounce a spam in hopes that the user's email address will be taken off a spam list if the spammer views it as invalid. This feature is controversial as its possible that you are bouncing the spam to an innocent mailserver that has been spoofed, therefore possibly choking it with emails. It is also a hassle to in effect run two email clients, the anti spam program and the real email client.

I think Motino comes under No.2, it clears up your inbox which is a good thing but unfortunately, that is only half the problem.

At the moment I am undecided on which method is the best. Hassle free, I would choose No.2, but to be really effective, maybe No.3.

posted by shardOctober 21, 2003 at 23:24

You can live without the preview [ e ]

1. Turn off preview! Viruses can activate themselves via that feature.

2. Are you using a "catch-all" on your domain? If so, turn it off and stick to specific email addresses and accounts. Why? Because spammers often spam generic terms like feedback@domain.com or "webmaster", etc. That's spam that should be bouncing with a "account doesnt exist", but damn catch-alls just send it all through.

3. Then set up a new email account, and over a month or two move over to it. Advise friends, colleagues of the change. Then set up an auto-responder on the old one to advise others of the change too. And then be very vigilant about using your address on the web.

I use a Hotmail account for anything and everytihng on the web, while my domain addresses are strictly for friends and business (NEVER used in a forum post for example).

4. Also I never use "mailto" anymore. Instead I use javascript that concatenates my email address when people click the link. That way HTML crawlers can't find it.

posted by anonemouseOctober 23, 2003 at 0:21

Preview vs AutoPreview [ e ]

Thank you for the suggestions.

Viruses could activate themsevles on the Preview Pane (which I am not using), they cannot activate themselves via AutoPreview Lists (which I will not turn off, that is the most useful feature there is)

All of the other things I do though to one degree or another.  For example, since I have my own domain, whenever I sign up for something on the web I make a new e-mail address for it. That way I can tell if someone company has sold or given away my e-mail address.  But, so far, that hasn't happened.  All the spam is arriving at my main account.

posted by greggmanOctober 23, 2003 at 23:56

A couple of other interesting approaches [ e ]

SpamGourmet provides a way to create "self-destructing" temporary email addresses for when you're unsure about giving them out.

Or spam.la, for when you are absolutely sure a given party is going to spam you, but you have no choice but to give them an email address.  (for instance, when you want to download a trial of some software, but in order to get the download link, you have to provide an email address)  All you do is make up an email @spam.la, such as "biteme@spam.la" and then go here to see what was sent.  Kind of neat.

As far as docs on the SpamBayes plug-in, did you check out the FAQ?  I think that's pretty much all the documentation that is available.  I sort of doubt that there would be much of a performance difference from Motino as they sound like they're using similar algorithms.  Unless the spam/maybe spam distinction seems valuable to you, it's probably not worth switching as there would still be the issue of having to "trust" the results.

I, too, usually get spam in the 100's per day, and SpamBayes seems to be getting better and better with each release.  Once I passed the 3-4 day period to train the spam database, I have never once noticed any false positives on anything that got a 90% or higher "spam" rating, but this could probably vary from person to person, depending on what type of spam you're getting.  I find that the porn/penis enlargement type spam NEVER gets through the filters, but a lot of general marketing/debt relief type of crap still does, presumably because it looks a little more like something legitimate...

posted by BionicRoachOctober 26, 2003 at 18:45

スパム対策 その一 [ e ]

 Spam Mail Killer

posted by DoszilaOctober 27, 2003 at 6:51

スパム対策 その2 [ e ]

Norton AntiSpam 2004」

posted by DoszilaOctober 27, 2003 at 7:42

スパム [ e ]

以前、私もスパムの攻撃に遭った。ホームページにメールアドレスを載せていた。

あの時は困り、いろいろ手を打った。最終的に、ホームページのメールアドレスの横に、「スパム、DM おことわり」と書いておいた。だけど

スパムの攻撃数は相変わらず変わらなかったなぁ~(笑) 結局、メールアドレスを変更して、スパムとの戦いは終わった。

posted by DoszilaOctober 28, 2003 at 8:31

スパム対策 その4 [ e ]

ある日 突然、スパム、DM、が届いたら、次の事を考えるべきだ。

いったい誰が、スパム業者に自分のメールアドレスを登録したのだろうか?????

1 掲示板でメールアドレスを書いたことから、

2 ホームページにメールアドレスを載せたことから、

3 メールアドレス収集ロボットから

4 知人がスパム業者に載せたことから、

5 アンケートに答えた時、メールアドレスを書いたことから、

まず、どこから自分のメールアドレスの情報が漏れたのかを考えるべきだ。そして今回の場合は、たぶん2番目だろうーと思います。一度、メールアドレスがスパム業者のリストに登録されてしまうと、永遠に迷惑メールは来ると思われます。スパム業者に登録されたメールアドレスを消すことは、不可能と思います。つまり 「スパム対策 その3」の方法か、もしくは、「メールアドレスの変更」になると思います。

スパム対策 その5に続く。。。。。。。。

posted by DoszilaOctober 29, 2003 at 6:48

Spam Bayes [ e ]

I've been using SpamBayes since May.

http://www.danchan.com/weblo
g/daypop/65396

The Windows add-in is here.

http://spambayes.sourceforge
.net/windows.html

I rarely see any spam in my Inbox. But, I do get valid messages outside my Inbox. I think all of the miscategorized messages have been in my "Possible Spam" folder so I had a chance to recategorize them correctly. What scares me is how many valid emails were miscategorized in my Spam folder, never to be seen again? I'm not about to wade through 10s of thousands (!) of messages.

posted by danchanNovember 6, 2003 at 22:56

so far... [ e ]

I haven't had many false positives with Motino.  Maybe 5 since I started using it except for the first 2 days or so when I had to mark the first few as good or bad.  I get 1 or 2 false negatives each day it seems out of 150 spams.

So far I still wade through the Quarentine folder everyday.  The only real advantage from not having it is now 99% of the spam is all together in one list so it's faster to skim it for false positives than it was when I went through it all by hand mixed in with the good stuff.

posted by greggmanNovember 7, 2003 at 8:08