Ideas and stories around Linux-HA (heartbeat) and Linux general.

17.4.08

Did the spammer give up?

Today I want to analyze the statistics of my mail server because there are interesting new developments since middle March 2008. A little bit off topic Linux-HA. But this blog should not be exclusively about heartbeat.

In mid March 2008 the hit rate to some blacklist providers (spamhaus and others) dropped by 50%. There was a story on German heise news portal on March 31st about that topic. In the statistics of our mailserver we also can see the drop in rejected mail from two different blacklists:

Fig 1: Hit rates of our mailserver for two different blacklists. Please note that the scale is logarithmic.

My blacklist hits from Spamhaus did rise in from 100/h in Nov/Dec 2007 to 300/h in Jan/Feb 2008. But suddenly in mid March it dropped back to the level of November. Did the spammer really give up? Was that the first victory? Or is this just the preparation for a better attack?

If you analyze the statistics of our mailserver further and take a closer look the the mails that passed the blacklisting you find the rate of mails being stopped by Spamassassin did rise the same amount blacklisting did loose. The next figure shows the percents of mail being stopped by blacklisting, greylisting, spamassassin and finally all mails accepted.


The percentage of the accepted mails basically remains constant from mid December between 5% and 10% mainly depending on the day of the week. The fraction of the mails rejected by blacklisting dropped from 70% for both blacklists in January to 50% now. In the same time the fraction rejected from spamassassin rose from 10% to 20% while greylisting rates remain constant.

Given all that data I would conclude that the spammers did not gave up, but enhanced their capabilities and reacting faster to blacklisting. They recognize where it is in effect and stop wasting resources there. They even more concentrate on these domains / servers / secondary servers, where blacklisting is not included. From these observations two conclusions can be drawn:

1) Spammers are clever and constantly working on their tools.

2) Blacklisting seems to work against spammers. It seems that this is really a good option in the fight to regain control over the inboxes.

16.4.08

Reload vs. Restart a Resource

On the mailinglist there was a nice discussion today: "Is it possible to reload a resource instead to restarting it every time?"

If you change the attribute of a resource heartbeat normally restarts the resource. You can also invoke this manually stopping and starting the resource again. But sometimes it is desirable only to reload the resource i.e. to tell the daemon to reread the latest configuration file. Restarting might take some time and reloading is much faster. So is it possible to reload the resource from heartbeat?

Yes! The basics are already included in the Dummy RA. If you want to add this feature to your RA follow this hint:
1) Add an attribute to the resource agent:


<parameter name="reload_trigger" unique="0">
<longdesc lang="en">
Random parameter that, when changed, causes a reload instead of a restart
</longdesc>
<shortdesc lang="en">Reload trigger</shortdesc>
<content type="string" default="" />
</parameter>



Beware: The parameter has to have the attribute unique="0"!

2) Add a reload action to the RA:

<name="reload" timeout="90"/>

Now restart the node. Andrew wrote on the list, that this is necessary to clear the cache of the meta_attributes.

Now every time you change the value this attribute the resource is reloaded instead of a complete restart of the resource. Nice?

15.4.08

Starting the blog

Hi,

after a talk from SUN about Web2.0 I decided to start my own blog. This blog will discuss topics around the Linux OS but especially about building clusters with Linux-HA version 2. This blog shout act a kind of fast supplement to the book "Clusterbau mit Linux-HA Version 2" I wrote for O'Reilly. Sorry, but at the moment this book is only available in German. If enough people ask O'Reilly perhaps they decide to translate it some day.

I hope you will find interesting articles in this blog which inspire you to do your own experiments with clusters, offer your services high available play with Linux at all. Please feel free to post comments.

Michael.