Current Time: 15:26:04 EST
 

VPS Scheduled Maintenance

Posted In: Maintenance — Sep 29th, 2016 at 3:32 pm EDT by HE: Victoria Witten
VPS services are affected

Incident Description:

Our system administrators will be performing maintenance on our VPS storage servers to update firmware.  This maintenance will be done on the 6th of October from 3AM to 3:30 AM EDT.  The VPS servers will remain up and operational during maintenance

Which Customers are Impacted?

All clients on VPS servers.

How are Customers Impacted?

None.  Servers will remain up and operational during maintenance.

How often will we be updated?

When completed.

Time to Resolution (ETA)

30 minutes.

Incident Updates

n/a

Resolution Description

n/a

web312 Webshell and FTP – down – Resolved

Posted In: Outage — Sep 29th, 2016 at 12:34 pm EDT by HE: Victoria Witten
Shared services are affected

Incident Description:

Webshell and FTP services on web312 are inaccessible due to a Distributed Denial of Service attack.   The ip address being targeted has been filtered.

Which Customers are Impacted?

All clients on web312.

How are Customers Impacted?

The file management tool Webshell and FTP services will be unavailable.

How often will we be updated?

When information is available.

Time to Resolution (ETA)

Filter will be checked hourly.

Incident Updates

  • 2016/09/30 12:30 AM EST  IP Filter has been reinitiated for 11 Hours
  • 2016/09/30 01:20 AM EST - IP Filter was removed and traffic has normalized.

Resolution Description

IP Filter was removed and traffic has normalized.

web415 – Maintenance – Resolved

Posted In: Uncategorized — Sep 28th, 2016 at 7:35 am EDT by HE: John Richards
Shared services are affected

Incident Description:

web415 file system had fallen into read-only and cannot be restarted because of RAID being in an inoperable state. Our team will switch web415 over from a standard server to the virtual environment.  This change should provide greater stability and redundancy for customers on the server.During this time the web server will be offline due to read-only state.

Which Customers are Impacted?

All customers on web415

How are Customers Impacted?

Websites and services are offline due to read-only state

How often will we be updated?

n/a

Time to Resolution (ETA)

10 hours

Incident Updates

n/a

Resolution Description

All servers are up and running as normal.

Web505 – Maintenance – Complete

Posted In: Maintenance — Sep 26th, 2016 at 6:19 pm EDT by HE: Greg Cook
Shared services are affected

Incident Description:

On Wednesday, September 28th, at midnight (Tuesday night and Wednesday morning) we will switch Web505 over from a standard server to the virtual environment.  This change should provide greater stability and redundancy for customers on the server.
Data has already been copied over to the new environment and during maintenance the server will be temporarily offline as a final data copy is made.  The server is estimated to be offline up to 20 minutes.

Which Customers are Impacted?

All customers on Web505

How are Customers Impacted?

Websites and services will be unavailable

How often will we be updated?

20 minutes

Time to Resolution (ETA)

20 minutes

Incident Updates

  • 2016/09/27 12:00 AM ET - Maintenance has started

Resolution Description

Web505 has been switched to new virtual environment. All services have been restored.

web1426 shared IP 50.118.32.3 – Filtered – Resolved

Posted In: Outage — Sep 26th, 2016 at 3:36 am EDT by HE: Michael M.
Shared services are affected

Incident Description:

Our system administrators detected a Distributed Denial of Service attack (DDoS), launched against the shared IP address of web1426–50.118.32.3.

A DDoS is is an attempt to make a computer resource unavailable to its intended users. The way the attack is carried out varies as much as who is attacked and why. One common method of attack involves saturating the target (victim) machine with external communications requests. This creates so many false connections to the server, real attempts to connect cannot be completed. Because so many domains share an IP, it is not possible to determine which site the attack is directed at. In many cases, a temporary block is sufficient until the DOS attack passes, however, if the attack continues, the shared IP could remain blocked for an extended period of time.
In order to mitigate the attack and keep the server online, system administrators have temporarily filtered all connections to that IP address. This allows us to keep websites that are hosted on the dedicated IP addresses of web1426 online. Once the attack is over, we will remove the IP filter.

Web907 – FSCK(File System Check) – Resolved

Posted In: Outage — Sep 25th, 2016 at 3:52 pm EDT by HE: Greg Cook
Shared services are affected

Incident Description:

Web907 file system had fallen in to read only. The server is being restarted and is now doing a mandatory file system check (FSCK). During this time the web server will be unavailable, meaning that websites hosted on the server will not be working.

Which Customers are Impacted?

All customers on Web907

How are Customers Impacted?

All websites/FTP/control panel will not be reachable.

How often will we be updated?

As available

Time to Resolution (ETA)

2 hours from now

Incident Updates

  • 2016/25/09 11:00 EST : FSCK has reached 61%
  • 2016/25/09 11:21 EST : FSCK has reached 70%
  • 2016/26/09 1:38 am EST : FSCK is still in progress, and currently the phase 1B running which is scanning the disk for multiply-claimed blocks.
  • 2016/26/09 2:00 am ESTCurrent status of fsck: Pass 1C: Scanning directories for inodes with multiply-claimed blocks
  • 2016/26/09 3:00 am EST: The same stage of FSCK is still running and SA has increased the ETA to +2 hours from now
  • 2016/26/09 3:42 am EST: current phase is: Pass 1D: Reconciling multiply-claimed blocks
  • 2016/26/09 4:00 am EST -  Process is complete!

Resolution Description

n/a

Multiple Linux Servers Down – Resolved

Posted In: Outage — Sep 25th, 2016 at 12:33 pm EDT by HE: Victoria Witten
Shared services are affected

Incident Description:

Our System Administrators detected an issue with sites hosted on multiple Linux servers. The connection between the servers and their storage was briefly lost and, to protect the data, servers automatically went into a read-only state. These servers must now be systematically rebooted to return to normal service. No data loss is expected.

The following servers are back online:

mail1203, mail1312, mail1314, mail13120, mail1405, mail1408, mail1410, mail1418, mysql1305, mysql401, mysql514, mysql515, web1201, web1202, web1203, web1204, web1205, web1206, web1207, web1208, web1209, web1210, web1211, web1212, web1213, web1214, web1215, web1216, web1217, web1218, web1219, web1220, web1221, web1222, web1223, web1224, web1225, web1226, web1227, web1228, web1229, web1230, web1231, web1232, web1233, web1234, web1235, web1236, web1237, web1239, web1240, web1301, web1302, web1303, web1304, web1305, web1306, web1307, web1308, web1309, web1310, web1311, web1312, web1313, web1314, web1315, web1316, web1317, web1318, web1319, web1320, web1321, web1322, web1323, web1324, web1325, web1326, web1327, web1328, web1329, eb1330, web1331, web1332, web1333, web1334, web1335, web1336, web1337, web1238, web1239, web1401, web1402, web1403, web1404, web1405, web1406, web1407, web1408, web1409, web1410, eb1411, web1412, web1413, web1414, web1415, web1416, web1417, web1418, web1419, web1420, web1421, web1422, web1423, web1424, web1425, web1426, web1427, web1428, web1428, web1430, web1431, web1432, web1433, web1434, web1435, web1436, web1437, web1438, web1439, web1440, web305, web311, web312, web320, web512, web521

The following servers are currently in reboot:

 

The following servers are currently running FSCK (File System Consistency Check):

 

The following servers are in Read Only mode:

Which Customers are Impacted?

All customers on mentioned servers

How are Customers Impacted?

Website, email and database services may appear unavailable.

How often will we be updated?

As information is available.

Time to Resolution (ETA)

Will be provided as it becomes available

Incident Updates

Please see 'Incident Description' for updates.

Resolution Description

All servers are up and running as normal.

iis1300 – Webshell Down- Resolved

Posted In: Uncategorized — Sep 20th, 2016 at 6:34 am EDT by IX: Jason H.

Incident Description:

Our administrators are investigating an internal issue with Webshell on this server. During this time, Webshell will not be accessible but all other services will be up.

Which Customers are Impacted?

All customers on iis1300 using Webshell.

How are Customers Impacted?

Webshell will be unavailable.

How often will we be updated?

30 minutes

Time to Resolution (ETA)

30 minutes

Incident Updates

N/A

Resolution Description

Configuration files for system php ave been corrected and all services resumed.

Live Chat – Maintenance – Resolved

Posted In: Maintenance — Sep 19th, 2016 at 8:44 am EDT by HE: Victoria Witten
Chat support is affected

Incident Description:

Live chat will be unavailable while our upstream provider for chat services performs maintenance.  We expect this to take 30 minutes and will be performed from 8:45  AM EDT through 9:15 AM EDT.

Which Customers are Impacted?

Customers using our online chat support.

How are Customers Impacted?

Online chat support will not be available.

How often will we be updated?

As available.

Time to Resolution (ETA)

30 minutes.

Incident Updates

  • Our upstream provide has informed us that maintenance has been extended until 10AM EDT.
  • Maintenance has been completed.

Resolution Description

n/a

Live Chat Down – Resolved

Posted In: Uncategorized — Sep 19th, 2016 at 6:23 am EDT by IX: Jason H.
Chat support is affected

Incident Description:

Our live chat provider is currently experiencing some difficulties. We will be updating this page as information becomes available.

Which Customers are Impacted?

All customer who use live chat.

How are Customers Impacted?

Chat will be unavailable

How often will we be updated?

An update period is currently pending.

Time to Resolution (ETA)

An ETA is not currently available.

Incident Updates

n/a

Resolution Description

The issue has been resolved.

 
© 2011 Host Excellence.