Sydney Network[AU-SYDNEY] Intermittent network loss
We're aware of the cause of the intermittent network loss, and have placed a fix in place to prevent it. We are observing the issue now.
Services have been solid since last update. Replacement network switch has since been installed and allnof the network ports patched. Our Sydney Globalswitch core ring is restored.
A failing network switch failed in a way that caused intermittent topology changes to our sydney network ring.
We have removed the device now entirely and are testing customer services
Sunday 18th July 2021
Frankfurt Network[GERMANY] Network Issues
Network Outage has been detected at our Germany FRA8 site, we are investigating if this is power related or network related
We believe an upstream network provider experienced some kind of network outage, possibly related to a large ddos attack
Saturday 12th June 2021
Sydney GlobalSwitch Servers[SYDNEY] vmh83 offline
vmh83 offline due to motherboard failure. A tech is heading to the datacenter to replace it.
Service was restored and all services operating as normal again.
ETA 20 minutes
Friday 28th May 2021
MNDC1 Network[MN] MNDC Network issues
Outage at this location, investigating if network or power outage as it appear to affect more than just us
Appears an upstream within the datacenter had a network outage affecting several services.
Everything is now back online, albeit with a low level of packetloss internationally. We will monitor it closely.
Sunday 21st February 2021
Perth Network[AUPERTH] Network loss / probable power outage
We have seen a loss of the Perth datacenter POP via diverse paths, we are expecting a likely power outage. Will update once we have further information
Services are all back up as one power feed has been restored.
We are running on a single power feed at this time.
Confirmed as a double feed power outage.
One power feed has been restored and we are working to get customer VMs online shortly
Monday 28th December 2020
Thailand Network[TH] Network Routing Offline
Network is unreachable both domestically and internationally. We are working with an upstream carrier to determine the cause
Services appear restored and related to connectivity between datacenters in Thailand. We are still awaiting a full report as to what happened.
Monday 7th December 2020
[USA] NewYork Datacenter powerloss
Power has returned but there's some network issues that we are still investigating
Upstream network is now restored and routes are flowing via normal methods again.
Power was lost again, but has been restored permanently this time.
We are still working with the network upstream to get access. In the meantime traffic is being diverted via australia or UK over private links
Upstream BGP services are offline causing blackholing of our outbound traffic due to RPF policies in place at the upstream. We've redirected traffic via private link back to Australia just to give access to services albeit with higher latency.
We've raised the issue with the upstream and hope to have it resolves soon.
Thursday 29th October 2020
Sydney Network[SYDNEY] Emergency Switch Replacement [au-nsw-gbl1-l6-rm2-r1-sw2]
An internal fan has failed on top-of-rack switch [au-nsw-gbl1-l6-rm2-r1-sw2] causing some overheat warnings for the past 90 minutes. No noticeable network issues are occurring however we will perform an emergency replacement of the whole switch at 2am AEST to avoid potential issues tomorrow during peak periods.
Customers connected to this device should expect approximately 30 seconds of downtime on the secondary LAN port for their equipment (this may show up as primary depending on your equipment). We believe all customers in this rack are configured in a bonded configuration, so we expect this process should be transparent without significant outages for anybody affected.
Switch has been entirely swapped out. all services should be running as normal.
Network Switch to be replaced at 02:00 AEST
Saturday 17th October 2020
MNDC1 Network[MONGOLIA] ndc1 network outage
We are investigating a network outage at the Mongolia ndc1 site
Network appears to be back again. We will continue to watch it.
Saturday 26th September 2020
MNDC1 Network[MONGOLIA] mndc1 network loss
Network loss to MNDC1 in Mongolia.
Network appears to be restored.
Incident looks to be affecting all other services at this DC. We will continue watching for updates.