AIBAFS Board Outage

Please report any glitches
Post Reply
User avatar
Pete
Site Admin
Posts: 5708
Joined: Sat Mar 01, 2014 1:15 am
Location: Atlanta GA USA

AIBAFS Board Outage

Post by Pete » Thu Jun 14, 2018 4:07 pm

In case anybody is wondering about the outage last evening, this is what was going on:




[RESOLVED] a2ls24.a2hosting.com mysql service interrupti
16 hours ago

a2ls24.a2hosting.com is currently experiencing a MySQL service interruption. Users hosted on this server will experience service degradation as a result. Our System Operations team is investigating the root cause of this interruption. We will provide updates as more details are made available.

Update 00:35: The MySQL service is back online. We are continuing to monitor the MySQL service
13th June 2018
MI3 Data Center :: Service Interruption
a day ago

A rack in our Michigan Data Center is currently experiencing a service interruption. Users hosted on servers in this rack will experience service degradation as a result. Our System Operations team is investigating the root cause of this interruption. We will provide updates as more details are made available.

Update 18:30 EDT: Power to several racks in our Michigan Data Center has been lost. Our staff is working diligently to resolve these issues. Thank you for enduring this with us. We know that downtime is unpleasant for you, our customers. It is unpleasant for us as well. We appreciate your sticking with us through the difficulty.

Update 19:05 EDT: Thank you for your continued patience during this difficult time. We are working very hard to resolve this outage as quickly as possible. Please be assured that your website and services being up is our number one priority.

Update 19:18: EDT: The outage has affected both connectivity and DNS. We have transferred to backup network connectivity, and DNS is being worked on as well.

Update 19:40 EDT: DNS and critical systems are back online. There are still individual servers down at our Michigan Data Center. Our Engineering team and our Data Center team are working hard to resolve this as quickly as possible. We are not able to provide an ETA but will update this post as often as we can.

Update 20:20 EDT: Engineering and Data Center techs are working together to restore service as quickly as is possible. We appreciate your sticking with us!

Update 20:30 EDT: We are glad to report that power has been restored, and systems are gradually coming online. Some servers will require manual recovery, and may take longer to be fully online. Please be assured that this situation is our number one priority with people in every department working to restore services as quickly as is possible.

Update 21:45 EDT: The majority of systems are online, but there are still many offline. We are working diligently to restore service. Thank you for your continued patience.

Update 22:00 EDT: Engineering is still working to restore services that have not already come online.

Update 22:40 EDT: Progress is being made. Please be assured that if your service is still down, it means that hands-on intervention is required and we are most definitely working to restore it.

Update 23:55 EDT: The vast majority of systems are back online, with one shared server (A2SS39) still being offline. We are working actively to restore it to working service.

Update 00:15 EDT: A2SS39 is now online. We are continuing to restore all services and monitoring services already online.
[RESOLVED]sg1-sr1.supercp.com :: Service Interruption
a day ago

sg1-sr1.supercp.com is currently experiencing a service interruption. Users hosted on this server will experience service degradation as a result. Our System Operations team is investigating the root cause of this interruption. We will provide updates as more details are made available.

Update 10:00 AM EST :: Our Engineers have implemented a fix and services are now online. We will continue to monitor the server for stability.



.......and on like that it goes
0 x
"If you can keep your head when all about you are losing theirs and blaming it on you"............Rudyard Kipling

Post Reply