Contactlist online

Today, we've reactivated the contact list. For new contacts the new infrastructure is already running.

At the moment, we're migrating the old contacts to the new infrastructure. This will take some hours.

XMPP Failure

One of our XMPP services failed and needed to be restarted. A part of the virtual world was unavailable for about 4 minutes.

Moving Users Between Clusters

We're moving some users between the clusters again to balance the load between them. Users will detect a normal short reconnect when they have moved.

Moving Users Between Clusters

Currently we're moving some users between the XMPP clusters to balance the load between them. Users will detect a normal short reconnect when they have moved.

Chat Server Lag

A room server has very high lag. We are investigating.

Update: only the connection between XMPP cluster 1 and one chat server lags.

Update: during the investigation the room server crashed due to strange memory conditions. After the restart everything is back to normal.

Scheduled XMPP downtime

We will have a scheduled XMPP maintenance window today from 16:15am to 16:20am UTC to add performance updates.

XMPP failure in Cluster 1, restarted

XMPP cluster 1 failed. Restarted multiple times to reestablish all connections.

XMPP failure in Cluster 1, restarted

The XMPP service in the Cluster 1 failed. Restarted, all affected users will automatically reconnect.

XMPP restart of Cluster 1

We experienced memory shortage XMPP cluster 1 and restarted it to free some leaked memory.

New XMPP Cluster

A second XMPP cluster has been installed. New users will be registered on the new cluster. This will reduce load on the first cluster.

Preparation for XMPP Cluster Changes

We are preparing for XMPP cluster config changes in the next 24 hours. We hope that the preparation does not affect the operation. We expect a XMPP reboot as worst case, but we hope to avoid it.

XMPP restart

XMPP servers have been restarted for maintenance.

XMPP maintenance restart, new database service

The XMPP servers got their own database service. A restart is neccessary to enable the new configuration.

XMPP Maintenance restart

Due to a high load the XMPP cluster will be restarted as a safety measure at 8:30pm UTC.

XMPP Maintenance restart

Due to a high load a small part of the virtual world failed and the rest of the world has been restarted as a safety measure.

XMPP Failure and maintenance restart

Because of high load on the XMPP cluster a small part of the virtual world was unavailable. To avoid side effects some other parts has been restarted as a safety measure.