Thursday 27 November 2008

Contactlist online

Today, we've reactivated the contact list. For new contacts the new infrastructure is already running.

At the moment, we're migrating the old contacts to the new infrastructure. This will take some hours.

Wednesday 26 November 2008

XMPP Failure

One of our XMPP services failed and needed to be restarted. A part of the virtual world was unavailable for about 4 minutes.

Wednesday 19 November 2008

Moving Users Between Clusters

We're moving some users between the clusters again to balance the load between them. Users will detect a normal short reconnect when they have moved.

Thursday 13 November 2008

Moving Users Between Clusters

Currently we're moving some users between the XMPP clusters to balance the load between them. Users will detect a normal short reconnect when they have moved.

Wednesday 12 November 2008

Chat Server Lag

A room server has very high lag. We are investigating.

Update: only the connection between XMPP cluster 1 and one chat server lags.

Update: during the investigation the room server crashed due to strange memory conditions. After the restart everything is back to normal.

Scheduled XMPP downtime

We will have a scheduled XMPP maintenance window today from 16:15am to 16:20am UTC to add performance updates.

Tuesday 11 November 2008

XMPP failure in Cluster 1, restarted

XMPP cluster 1 failed. Restarted multiple times to reestablish all connections.

XMPP failure in Cluster 1, restarted

The XMPP service in the Cluster 1 failed. Restarted, all affected users will automatically reconnect.

Saturday 8 November 2008

XMPP restart of Cluster 1

We experienced memory shortage XMPP cluster 1 and restarted it to free some leaked memory.

Friday 7 November 2008

New XMPP Cluster

A second XMPP cluster has been installed. New users will be registered on the new cluster. This will reduce load on the first cluster.

Thursday 6 November 2008

Preparation for XMPP Cluster Changes

We are preparing for XMPP cluster config changes in the next 24 hours. We hope that the preparation does not affect the operation. We expect a XMPP reboot as worst case, but we hope to avoid it.

Tuesday 4 November 2008

XMPP restart

XMPP servers have been restarted for maintenance.

Monday 3 November 2008

XMPP maintenance restart, new database service

The XMPP servers got their own database service. A restart is neccessary to enable the new configuration.

Sunday 2 November 2008

XMPP Maintenance restart

Due to a high load the XMPP cluster will be restarted as a safety measure at 8:30pm UTC.

XMPP Maintenance restart

Due to a high load a small part of the virtual world failed and the rest of the world has been restarted as a safety measure.

Saturday 1 November 2008

XMPP Failure and maintenance restart

Because of high load on the XMPP cluster a small part of the virtual world was unavailable. To avoid side effects some other parts has been restarted as a safety measure.