--------------------------------------------------------------------------------------------------------------- EGI BROADCAST TOOL : https://operations-portal.egi.eu/broadcast

--------------------------------------------------------------------------------------------------------------- Publication from : john casson John.Casson@stfc.ac.uk Targets : VO managers/vlemed vlemed-vo-managers@biggrid.nl ----------------------------------------------------------------------------------------------------------------

Dear all,

GOCDB is back online.

The GOCDB system experienced an unexpected downtime between 03.05.12 and 04.05.12. During this time parts of the system were inaccessible to end users and programmatic tools. The details of this downtime are below:

* A network outage caused by a configuration problem on a router at STFC’s RAL site caused complete inaccessibility between 15:42 and 16:58 UTC on 03.05.12 - At around 21:40 UTC on 03.05.12 we experienced an issue with the storage attached to the virtual machine hypervisor that hosts the GOCDB VM instances - This issue resulted in the read/write portal instance (gocdb4.esc.rl.ac.uk) being completely inaccessible - The read only web portal (goc.egi.eu) was unaffected, as was the programmatic interface provided by the read only portal * The storage issue caused the filesystems of both hosts to be mounted as read only. The cause of the problem was not initially clear but once diagnosed and the fault cleared we rebooted both hosts to re-mount the filesystems in read/write mode and both hosts were back in production at 10:45 UTC on 04.05.12.

Kindest Regards

GOCDB Team

---------------------------------------------------------------------------------------------------------------- link to this broadcast : https://operations-portal.egi.eu/broadcast/archive/id/656 ----------------------------------------------------------------------------------------------------------------