We have identified performance issues with one of the cluster nodes and are now re-routing traffic to other nodes within the cluster. If you are on a page that seams to be stuck loading, please close it and open SarSYS to continue working.
Services returned to normal operation.
Performance and response times have started to return to normal. We will continue to monitor the cluster over the next few hours.
Wednesday 3rd February 2021
No incidents reported
Tuesday 2nd February 2021
No incidents reported
Monday 1st February 2021
Database ClusterIncreased error rate - Host down
Connectivity issues with a database cluster node.
RESOLVED: Up-stream provider has not marked the issue as resolved there end but we have started to see traffic return to the downed cluster node since 3:50pm. All services should be back to normal and response times back to normal levels.
UPDATE; There is a up-stream issue with AWS that is causing connectivity issues in the London EU-WEST-2 region. AWS are working on a fix now but have not provided us with an ETA.
We will continue to monitor the situation and will provide updates once we know more.
Expected next updated by: 4pm GMT
We have located the fault with one of the servers in the cluster. We are in contact with our provider to get this host replaced as soon as possible.
At this time services dependent on this cluster is not impacted and will continue to operate with a slight increase in latency.