Incident Description:
Starting on Friday, May 24th, 2013 at 08:00PM EDT, we will be conducting maintenance on our data center power systems. This is the second of the two maintenance periods.
The purpose of this maintenance is to replace the batteries in each of our uninterruptible power supplies (UPS) and is conducted every five years. During the maintenance, a portion of our UPS’ will be put into bypass mode and their compliment of 80 batteries will be replaced. During this time, all servers powered by the applicable UPS’ will be running directly on generator power to prevent downtime in the unexpected case of a commercial power failure.
The maintenance is scheduled to be completed within 8 hours.
Incident Updates
- 2013/05/24 8:15 PM EDT - Maintenance has begun. ETA is currently 6-8 hours and no interruption of services is expected.
Resolution Description
The maintenance has completed successfully and all servers are back off of the UPS.
Incident Description:
IIS502 is currently being migrated to new hardware.
Incident Updates
- 5/25/2013 12:14 PM EDT - 76.8 GB of 451 GB have been migrated currently.
Resolution Description
N/A
Incident Description:
We are experiencing irregular traffic on this shared IP. Our system administrators have initiated an IP filter. We will recheck incoming traffic when the filter expires.
Incident Updates
- 2013/05/24 12:51 AM EST - The IP Filter has been initiated for 4 hours.
- 2013/05/24 5:01 AM EST - The IP Filter has been initiated for 12 hours.
- 2013/05/24 10:41 PM EST - The IP Filter has been initiated for 12 hours.
Resolution Description
N/A
Incident Description:
We are experiencing irregular traffic on this shared IP. Our system administrators have initiated an IP filter. We will recheck incoming traffic when the filter expires.
Incident Updates
- 2013/05/23 11:43 PM EST - The IP Filter has been initiated for 4 hours.
Resolution Description
N/A
Incident Description:
The mail queues, on the smart host servers, have backed up and are currently being worked on to continue the flow of mail normally.
Incident Updates
N/A
Resolution Description
The SMH queues have been cleared and mail should be functioning correctly now.
Incident Description:
We are experiencing irregular traffic on this shared IP. Our system administrators have initiated an IP filter. We will recheck incoming traffic when the filter expires.
Incident Updates
- 2013/05/19 03:59 AM EDT - The IP filter has been initiated for 4 hours
Resolution Description
The current filter has expired and traffic seems to be back to normal.
Incident Description:
We are experiencing irregular traffic on this shared IP. Our system administrators have initiated an IP filter. We will recheck incoming traffic when the filter expires.
Incident Updates
- 2013/05/18 11:04 PM EDT - The IP filter has been initiated for 4 hours
- 2013/05/19 03:59 AM EDT - The IP filter has been initiated for 12 hours
- 2013/05/24 12:35 AM EDT - The IP filter has been initiated for 12 hours
Resolution Description
N/A
Incident Description:
Mail511 has gone down due to a forced file systems check (FSCK).
Incident Updates
5/18/2013 1:28 AM EST - The FSCK is currently at 84% completed. The ETA is currently 1 hour.
Resolution Description
Server is back online.
Incident Description:
Starting on Friday, May 17th, 2013 at 08:00PM EDT, we will be conducting maintenance on our data center power systems. This will be the first of two maintenance periods, with the second one starting on May 24th at the same time.
The purpose of this maintenance is to replace the batteries in each of our uninterruptible power supplies (UPS) and is conducted every five years. During the maintenance, a portion of our UPS’ will be put into bypass mode and their compliment of 80 batteries will be replaced. During this time, all servers powered by the applicable UPS’ will be running directly on generator power to prevent downtime in the unexpected case of a commercial power failure.
The maintenance is scheduled to be completed within 8 hours.
There is no expected downtime or customer impact for either of these maintenance windows.
Incident Updates
- 5/17/2013 8:47 PM EST - The data center maintenance has started and another update will be posted when available.
Resolution Description
The maintenance has completed successfully and all servers are back off of the UPS.
Incident Description:
We will be performing system maintenance on Thursday, May 16th at 7:00AM EDT. Maintenance is expected to last two hours. During this maintenance period, we will be rerouting power to our servers and Storage Area Networks (SAN) to verify that the servers and SAN are properly connected to both of our backup power supplies.
There is no expected downtime or impact to customers during this maintenance window.
Incident Updates
- 2013/05/16 7:26 AM EDT - Maintenance has begun. ETR is still 2 hours and no interruption of services is expected.
- 2013/05/16 8:28 AM EDT - Maintenance has been completed
Resolution Description
Maintenance has been completed.
