Monday 29 September 2008

Parameter change in XMPP-Servers

We changed a parameter in our XMPP-Servers.
Main operation continues, clients automatically reconnect to other cluster hosts.

Saturday 27 September 2008

XMPP Server Failure

A part of the XMPP cluster failed.

Main operation continues, clients automatically reconnect to other cluster hosts.

Monday 22 September 2008

Scheduled XMPP downtime [Update]

We will have a scheduled XMPP maintenance window tonight from 22:00am to 22:05am UTC to add performance updates.

Update: The XMPP service is up and running again.

Friday 19 September 2008

Buddylist updates off

Buddylist updates remain deactivated.

Comment: there seems to be an instability of the XMPP cluster under the condition of a combined high load of Web and XMPP. This is a special case, but we prefer to keep buddy list updates disabled until the condition is fixed, rather than risking general XMPP operation.

Thursday 18 September 2008

Load Problems

We are experiencing high load. This results in very slow Web access and even XMPP cluster failure.

Stopping some sub systems, e.g. buddylist updates, topcloud.

Comment: most developers are working on optimizations. We are getting new all time highs every day and we are trying to keep up with the growth. This is an ongoing process.

Tuesday 16 September 2008

XMPP Server Failure

A part of the XMPP cluster failed.

Main operation continues, clients automatically reconnect to other cluster hosts.

Operation completely restored after 3 minutes.

Sunday 14 September 2008

Topcloud briefly activated

Topclound has been activated for 1 h to check for high traffic sites in order to add more random rooms (see the LMS Operation Log for more). It is now again disabled until the re-write is completed.

Tuesday 9 September 2008

TopCloud Offline

Topcloud updates have been disabled because the processing might affect chat operation.

Comment: Topcloud processing will be changed. It is expected to resume early next week.

Sunday 7 September 2008

Chat Server Failure

location.virtual-presence.org failed. Most of the layered virtual world is offline.

Update: Server restart at 17:15

Comment: chat operation will partially be moved to other chat servers to reduce the load on location.virtual-presence.org

XMPP Server Failure

A part of the XMPP cluster failed.

main operation continues, clients automatically reconnect to other cluster hosts. But followup errors affect client notifications, i.e. nickname changes and messages are not propagated to clients.

Update: Operation completely restored at 14:15