Spam attacks!

by ceebs
Tue Jul 14th, 2009 at 09:01:17 AM EST

As many of you either know or have guessed, the editorial team have been a bit busy lately fighting off an attack of spammers.

On Friday, 3 July, afew, Sassafras and I noticed a couple of new accounts that seemed a little dubious.  On further examination we discovered that the individual user accounts, recently created, contained links to sites selling a variety of services.  Realising that it wasn't just an isolated case, we started looking at all of the new user accounts.

It appeared that, starting on 1 July, we had suddenly started generating new accounts, about 200 by the time we discovered it.  As an initial step, several of us acted to shut down these accounts.  This was not an easy process, you had to check the accounts, see if they looked like a real account, record any spam information for later reference (so if someone came back and asked why their account had been shut down, we could tell them ), keep track of any potentially real accounts that have been created during this period, disable the spammer accounts entirely so that bio pages can't be edited either.  (Migeru, DoDo and Sassafras had a lot of trouble figuring out how to do the last one, and were excellent in hanging together the fine points of what we were doing in cleaning out these accounts.)


By the time we reached this stage, we had in excess of five hundred accounts to monitor, with more appearing all the time.  Some of them were backed up with fake looking blogs, so if at first sight they weren't instantly obviously junk, then they were thrown over into a pile for further investigation (for which Sassafras went way beyond the call of duty).  From looking at the accounts created, it appears that the attack was coming from the machines of a large number of individuals in a network of spammers or a network of machines infected with a form of Trojan bot software: individual machines have been acting as proxies for the attack on us.  This prevents a simple defence of blocking individual attackers' IP addresses, as the next account created could be coming from anywhere.  From scanning the list, a vast majority of the spam account originating machines are based in the US, although there were a selection coming from the Philippines (and a particularly nasty one from Wolverhampton, trying to sell us websites and web hosting as estate agents and accountants).

The attack was more serious than we thought at first after the first round of clearing, we realised that some of the initial accounts we had cleared, had been posting comments in diaries - possibly automated, but in some cases clearly not.  This suggested activity beyond simply getting spam into user info, and it also suggested we were not up against a spambot alone.  Our next step was to comb through comment threads and eliminate comments from identified spammers, whether the comment contained spam or not (spam could be added to comments later via the signature).

A couple of people's comments might have been wiped with the underlying spam account comments, and if you have seen your cogent criticism of the world's finance system vanish along with them, we apologise profusely, but dealing with these idiots is a necessity.  (As far as we are aware, nothing important was destroyed alongside the garbage, if you feel we are incorrect in that, please get in touch.)  If we hadn't dealt with the problem, we would have started to see the diary list filling with stories like the multi-part epic that graced the pages in midweek.  (That came from an account that we had missed, it had been created just before the main burst, and was missing most of the signs to look like a definite spammer.)  In all, five diaries and between ten and twenty comments were given the chop.

The worry during this attack was that the spammer(s), maintaining their automated account creation 24/24, could create a large enough user base to recommend a set of rapidly-unleashed spam diaries into the rec list, and piggyback on ET's reputation and usually good Google referencing to bump their spam suddenly higher in the search engine rankings.  There was also a concern that, if the attempt worked here, other community blogs might then be targeted.  As far as we know, that hasn't happened.  We have contacted a number of similar sites that might be subject to similar attack methods just in case, they are watching out for this to occur too.  (Please don't name sites you think we might have missed in the diary, it would be best not to give anyone ideas, if you have an idea of someone you think might have missed then feel free to email me, but don't post it on the board.)

:: :: :: :: ::

Having run through the initial storm of accounts, the editorial team first spent several days, in shifts (a 24/24 watch) monitoring new accounts as they were created, and splatting them as soon as they popped up, an admins version of whack-a-mole.  As with all admin activities, we didn't manage it without a lot of tears before bedtime, the odd misunderstanding, and much head-scratching, plus several discoveries of what the scoop software is doing deep in its steamy bowels.  ARGeezer should be thanked in particular for his work on the nightshift, when all the Europeans were tucked up in bed.

Once we had things more or less under control, someone (yes, someone) was able to make a couple of changes, and from there get this particular attack approach finally stopped.  We have introduced a piece of programming to hopefully prevent scripted account creation. Since this, we have not seen any new accounts created from the same type of source, and have managed to reduce the amount we are watching the new user account creation.  Some of us might even get back to feeling guilty at the lack of diaries we have been writing recently, having had a perfectly justifiable excuse for ten days, but no longer, not that it's stopped some editors, who were hard at work dealing with the problem, worrying that they should be writing diaries too.

So what situation are we in now?  Well we have around 800 accounts marked down as spam or have failed at some point in their creation process.  These have all been dealt with.  However, if you are a reader who has created a new account in the last ten days that you seem to have been excluded from by mistake, please get in touch, and we will investigate, it is possible that we have chopped off an account or two by mistake, we don't think we have, but it is always possible.  (After all you could be a person who genuinely wishes to take part in the discussion here with a sideline in penis enlargement medicine.)  Apart from this, from the same time period, there are sixteen new accounts that we think are more than likely OK, but are still sufficiently suspicious to still be under review.  About half of these are yet to return their registration email and will more than likely naturally decay away within the next few days.

So what next?  Well the editorial staff will carry on looking, trying to make sure that things run smoothly.  There will be at least one more diary dealing with what was found looking at the sites being advertised by these false accounts.  For that though, you will all have to wait for afew to strip his wetsuit off and have a shower after his trip into the sewer.

Login
. Make a new account
. Reset password

Display:
This is not spam!

If you're not part of the solution, you're part of the precipitate.
by ceebs (ceebs (at) eurotrib (dot) com) on Tue Jul 14th, 2009 at 08:08:10 AM EST
Bloop! Gulp!

<coming up for air>

by afew (afew(a in a circle)eurotrib_dot_com) on Tue Jul 14th, 2009 at 08:30:38 AM EST
by afew (afew(a in a circle)eurotrib_dot_com) on Tue Jul 14th, 2009 at 12:54:36 PM EST
[ Parent ]
Holy crap!

The peak-to-trough part of the business cycle is an outlier. Carnot would have died laughing.
by Migeru (migeru at eurotrib dot com) on Tue Jul 14th, 2009 at 01:01:57 PM EST
[ Parent ]
I was very selective...
by afew (afew(a in a circle)eurotrib_dot_com) on Tue Jul 14th, 2009 at 02:44:57 PM EST
[ Parent ]
Kudos are in order for all the work involved. Vielen vielen Dank!

I had no idea it was so widespread.  I'm glad that i and my laptop can sleep easier knowing that ET's nuclear Navy is patrolling the spam-filled web waters.

Skennah Kowa

by Crazy Horse on Tue Jul 14th, 2009 at 08:31:05 AM EST
Thank you for your hard work and diligence. Remind me in Paris and the beers are on me (and yes, Sassafras, I know you can't drink - ice cream ?)

keep to the Fen Causeway
by Helen (lareinagal at yahoo dot co dot uk) on Tue Jul 14th, 2009 at 09:01:36 AM EST
Thanks for the heads up.

Is there anything we, the regulars, can do to help?
Neighborhood watch or something?

Europeans think a hundred miles is a long way. Americans think a hundred years is a long time.

by Bernard on Tue Jul 14th, 2009 at 09:06:43 AM EST
Thank you, all.

Diversity is the key to economic and political evolution.
by Cat on Tue Jul 14th, 2009 at 09:06:45 AM EST
Sorry to hear you had to deal with all this trouble.  Maybe its not really about the penis enlargement, but more about knocking ET off the search radar, and, as you say, harming its reputation for some reason.

I say that because you mentioned a combination of human interventions along with the apparent botwerks.  Hmmmm. . . why would anyone want to harm the reputation of ET, and discourage people from reading what may be found here?

by jjellin on Tue Jul 14th, 2009 at 09:17:44 AM EST
Hmm, let me count the ways.

Headlines : We're unkind to religionists, unsympathetic to Israel, disdainful of right wing politics and not just contemptuous of the economic status quo, but far more dangerously, can put together a set of coherent alternatives that might be both populist and popular.

We're small. We're european. We're left-liberal, pro-european. We are seen as overly-intellectual, weak and irrelevant. However, our demise would be a useful warning to others

That enough ?

keep to the Fen Causeway

by Helen (lareinagal at yahoo dot co dot uk) on Tue Jul 14th, 2009 at 09:26:30 AM EST
[ Parent ]
No need to go full conspiracy mode from what I understand: the goal was to ride on ET's reputation to climb up the search engines ranking to maximize exposure, potential sales and profit. Just good ol' SEO.

Greed before malice (a variation of: cockup before conspiracy).

Europeans think a hundred miles is a long way. Americans think a hundred years is a long time.

by Bernard on Tue Jul 14th, 2009 at 09:28:32 AM EST
[ Parent ]
This seems unlikely. ET doesn't get that many hits overall in the great Googly scheme of things. And the click-through rate for spam would be tiny, making it hardly worth the effort.

So I'm not sure why we'd be targetted for massive SEO-ism.

Of course stupid SEO-ers might assume the site gets more hits than it really does. Even so - there must be easier and more lucrative blogs to try to hijack.

by ThatBritGuy (thatbritguy (at) googlemail.com) on Tue Jul 14th, 2009 at 09:45:31 AM EST
[ Parent ]
I've seen a hell of a lot more obscure places targeted just as hard. SEOers are strange.
by Colman (colman at eurotrib.com) on Tue Jul 14th, 2009 at 09:51:12 AM EST
[ Parent ]
This seems unlikely. ET doesn't get that many hits overall in the great Googly scheme of things.

But, it is spam-free, and ET links often turned up high at least in my searches.

*Traitor*, n.
A benighted individual who perceives an illusory distinction between serving his nation and abetting the criminals who govern it.

by DoDo on Tue Jul 14th, 2009 at 10:34:34 AM EST
[ Parent ]
I've noticed that too in searches

You can't be me, I'm taken
by Sven Triloqvist on Tue Jul 14th, 2009 at 10:41:59 AM EST
[ Parent ]
That could be because you're searching for ET-ish things.

As I understand it, SEO-ers get more of a return from mass-market searches for mass-market items like grills and domestic doodads.

The audience for economic deconstruction and heavy rail is likely quite a bit smaller than the audience for fat-free cooking items.

by ThatBritGuy (thatbritguy (at) googlemail.com) on Tue Jul 14th, 2009 at 11:12:00 AM EST
[ Parent ]
What I meant to suggest is that Google ranking now also contains some measure of quality/spam-infectedness. In addition, for the spammers, the backlinks deposited on ET may be one of many.

*Traitor*, n.
A benighted individual who perceives an illusory distinction between serving his nation and abetting the criminals who govern it.
by DoDo on Tue Jul 14th, 2009 at 11:38:16 AM EST
[ Parent ]
Well of course - I'm often checking out background in the hope of making some contribution here that does not reveal all of my inadequacies ;-)

You can't be me, I'm taken
by Sven Triloqvist on Tue Jul 14th, 2009 at 01:29:24 PM EST
[ Parent ]
ET gets linked by a lot of blogs and other sites. Not enough! But still, quite a bit. Hence the relatively good search engine profile.

Plus, by a glimpse at the sitemeter, we get a lot of traffic from the google image search, maybe even more as through the normal google search. We post a lot of pictures, and google is as kind to index us even when we do it stealing other people's bandwith.

by nanne (zwaerdenmaecker@gmail.com) on Tue Jul 14th, 2009 at 03:37:05 PM EST
[ Parent ]
DoDo:
ET links often turned up high at least in my searches
A dangerous sign of groupthink?

The peak-to-trough part of the business cycle is an outlier. Carnot would have died laughing.
by Migeru (migeru at eurotrib dot com) on Tue Jul 14th, 2009 at 11:24:54 AM EST
[ Parent ]
More of specialised subjects.

*Traitor*, n.
A benighted individual who perceives an illusory distinction between serving his nation and abetting the criminals who govern it.
by DoDo on Tue Jul 14th, 2009 at 11:45:46 AM EST
[ Parent ]
(Still, note that the ET hit came ahead of company hits.)

*Traitor*, n.
A benighted individual who perceives an illusory distinction between serving his nation and abetting the criminals who govern it.
by DoDo on Tue Jul 14th, 2009 at 11:46:42 AM EST
[ Parent ]
Everybody is targeted by spammers. If they get through, it means that your software has the loophole they're exploiting, not that they're after you personally.

And it's not hard to autocreate seemingly genuine content either - as long as you have a little bit of control over the environment (such as in a diary of your own, with several sock puppets for first comments), you can automate the whole thing and it will take time and effort to catch. I remember a couple of spammers we had a while back which did precisely that. They got caught because they smelled like astroturfers, but the ET has an unusually developed nose for astroturfers, so it's entirely possible that they would have gone below the radar on other sites.

It's not improbable that the creeps in this round built their exploit with Kos or some other higher-traffic Scoop site in mind, but when you've got the software, it is comparatively easy to simply let it run around on the internet.

- Jake

"Terraforming your own planet to make it uninhabitable hardly counts as epic win." - ThatBritGuy

by JakeS (JangoSierra 'at' gmail 'dot' com) on Tue Jul 14th, 2009 at 04:11:53 PM EST
[ Parent ]
That's about it. Remember: spammers are paid by backlinks; and, by my impression, it's the same clientele as for direct marketing stuff like Amway.

*Traitor*, n.
A benighted individual who perceives an illusory distinction between serving his nation and abetting the criminals who govern it.
by DoDo on Tue Jul 14th, 2009 at 10:36:14 AM EST
[ Parent ]
It's very unlikely anyone is targeting ET specifically. More likely it's an automated attack looking for sites running Scoop. This is always a risk with off-the-shelf software. (And even completely custom software is still hit by random untargeted spam, though this is usually easier to defend against.)
by bobince ([and](at)doxdesk(dot)[com]) on Tue Jul 14th, 2009 at 03:52:21 PM EST
[ Parent ]
Great work by everybody.

Sadly, this won't be the last time, so all regulars should be aware and do what we can to inform if there is anything suspicious. It is best done, as ceebs says, by an email to the Team or to info.

I trust Colman is also doing his bit with GA, there's some useful back-up info in visitor tracking. I'd be happy to help with that, since I'm tracking other sites.

You can't be me, I'm taken

by Sven Triloqvist on Tue Jul 14th, 2009 at 09:24:45 AM EST
I was aghast to learn of this - and thankfully ignorant of how to deal with it. So I am MOST appreciative of ALL the time and energy that went into this. Makes me paranoid too...

"Once in awhile we get shown the light, in the strangest of places, if we look at it right" - Hunter/Garcia
by whataboutbob on Tue Jul 14th, 2009 at 11:47:04 AM EST
I discovered the problem too late to be any help, but, as I followed the last steps and what had been done before, I can tell I was amazed at the incredible volume of time, energy and ingenuity involved from the editorial team in order to tackle very efficiently a serious threat to ET.

Kudos to you all

"Ce qui vient au monde pour ne rien troubler ne mérite ni égards ni patience." René Char

by Melanchthon on Tue Jul 14th, 2009 at 12:01:02 PM EST
I suppose it's all a sort of back handed compliment that ET is getting noticed by all sorts of dubious SEO and internet marketing specialists.  The fact that a lot of human interventions were required to mount the attack means it wasn't just some semi-random "lets fire the machine gun in various directions and see what comes back" kind of automated attack.  Posting comments and diaries takes time even if it is boilerplate text

If we get attacked again I can always roll off a dozen outraged Lisbon diaries to keep the diary stream rolling whilst the FP team are engaged in subterranean warfare.  My massive readership (thanks Dodo, Afew, Jake, Drew, Mig, Colman) will no doubt not thank me but at least it gives the appearance of intellectual activity continuing...

notes from no w here

by Frank Schnittger (mail Frankschnittger at hot dotty communists) on Tue Jul 14th, 2009 at 12:05:54 PM EST
"My massive readership (thanks Dodo, Afew, Jake, Drew, Mig, Colman) will no doubt not thank me but at least it gives the appearance of intellectual activity continuing... "

As global village idiot of ET Lurkers Anonymous, i want to remind you that most of us don't understand Irish, but we read your efforts deciduously, anyway.

Skennah Kowa

by Crazy Horse on Tue Jul 14th, 2009 at 12:32:25 PM EST
[ Parent ]
you shedding your hair or is that the opposite of assiduously? :-)

notes from no w here
by Frank Schnittger (mail Frankschnittger at hot dotty communists) on Tue Jul 14th, 2009 at 12:41:07 PM EST
[ Parent ]
By now you all recognize that i'm a pretty level-headed chap, certainly not prone to conspiracy thinking. Barely even prone to thinking.

But has anyone noticed that the spam attack has taken place during the long absence of our peerless leader?  

Skennah Kowa

by Crazy Horse on Tue Jul 14th, 2009 at 12:36:30 PM EST
Yeah, DL's probably behind it, keeping us on our toes.
by afew (afew(a in a circle)eurotrib_dot_com) on Tue Jul 14th, 2009 at 12:56:39 PM EST
[ Parent ]
Really, really impressive...

really

A pleasure

I therefore claim to show, not how men think in myths, but how myths operate in men's minds without their being aware of the fact. Levi-Strauss, Claude

by kcurie on Tue Jul 14th, 2009 at 05:33:17 PM EST


Display:
Go to: [ European Tribune Homepage : Top of page : Top of comments ]