Network Outage for KVM and OpenVZ in Utah (Resolved)
  • Priority - Critical
  • Hello,

    We are currently experiencing an outage in Utah affecting the SolusVM master and KVM slaves in Utah.

    While this does not affect LA and Dallas, the master being unavailable prohibits the ability to manage the VM by doing operating system reinstalls, etc.

    We are working to restore service as soon as possible.

  • Date - 03/01/2024 14:18
  • Last Updated - 03/01/2024 18:50
Outage in Dallas (Resolved)
  • Priority - High
  • Affecting System - Dallas Site
  • We are experiencing an outage in Dallas that is affecting some VPS and Dedicated Server customers.

    An investigation is in progress and we hope to resolve this as soon as possible.

    Thank you for your patience at this time.

    Regards,

    HostTheBest

  • Date - 11/18/2023 09:04 - 12/04/2023 22:09
  • Last Updated - 12/04/2023 22:09
Emergency maintenance on odgen2 UTAH VPS (Resolved)
  • Priority - High
  • Affecting System - KVM VPS Node
  • Dear Customer,

    We must perform emergency maintenance on odgen2 host node in UTAH. This server is one of our older machines that provides KVM VPS services in UTAH.

    We expect this maintenance to last 1hr and the time will be used to replace a memory modules and perform basic health checks.

    We will update you either by ticket or close this network issue once the work has been completed.

    Thank you for your patience.

    Regards,

    HostTheBest

  • Date - 09/21/2023 20:14 - 11/18/2023 09:06
  • Last Updated - 09/21/2023 20:19
Outage in Utah (Resolved)
  • Priority - Critical
  • Hello,

    We are currently experiencing an issue affecting a position of our network that provides VPS services in Utah. At present, all UTAH based VPS services are offline and this issue is affecting our SolusVM master node.

    All services in Los Angeles, Dallas, NYC that are VPS servers or dedicated servers in these regions remain online and are not impacted by this isolated problem.

    We hope to resolve this issue as soon as possible.

    Once rectified, we will incorporate changes to resolve this issue.

    Thank you for your patience.

     

    Regards,

    HostTheBest Management

  • Date - 08/24/2023 16:42 - 11/18/2023 09:06
  • Last Updated - 09/02/2023 16:35
Disk maintenance on (Resolved)
  • Priority - High
  • Affecting Server - SolusVM
  • Hello,

    We want to investigate an issue with the odgen-utah2 server which provides VPS servers. This is one of our many nodes. Therre are 2 x NVMe disks that are reporting problems that we want to investigate in greater detail and it was advised to take the server offline confirm the disk health of the VG and then bring it back online. As a result this issue is being posted here to alert our customers of the maintenance that will be happening shortly.

  • Date - 06/28/2022 16:41 - 06/01/2023 23:12
  • Last Updated - 06/28/2022 16:48
KVM Node 10 (Resolved)
  • Priority - High
  • Affecting Server - SolusVM
  • We are investigating a network issue affecting KVM VPS VM's for some customers.

  • Date - 04/04/2019 08:08 - 03/31/2022 16:29
  • Last Updated - 04/04/2019 08:09
NYC - Circuit Upgrade (Resolved)
  • Priority - High
  • Affecting System - Core Network
  • Dear HostTheBest Customer,

    We will be upgrading our connectivity to Cogent to a LAG pair of 2 x 20G ( 4 x 10G pairs). During this time there may be some slowness to the network or reduced connectivity while the settings are configured on the Cogent side and on our core networking gear.

    We have selected an off hour period where our traffic is the lowest to perform this update. This is being done in an effort to increase the quality of services provided to you our customer(s).

    Thank you for your continued business.

    If there are any questions please contact support [at] hostthebest.com.

    Regards,

    Network Engineering

    HostTheBest

  • Date - 12/15/2018 03:00 - 12/23/2018 00:47
  • Last Updated - 12/14/2018 21:39
NYC POP1 - Urgent Maintenance (Resolved)
  • Priority - Critical
  • Affecting System - CORE SW
  • Hello HostTheBest Customers,

    You are receiving this message because you are an active HostTheBest client with ACTIVE services in our NYC POP 1 facility.

    Yesterday we experienced high latency and service impacting load on our core switching environment due to the on-boarding of a customer with high p/p/s usage with close to 100 servers. This caused random impact to some and no impact to others. However, we anticipated a need to upgrade from our current architecture onto our Cisco Nexus devices for our upcoming 10G line and also for increased connectivity as we plan for 100G connectivity coming into the network via Cogent. We would also be increasing the total capacity to each TOR (top of rack) switch by 2x - fiber pairs.

    Considering the impact yesterday, we would like implement the upgrade onto the Cisco catalyst devices and move certain vlans onto that architecture immediately. Receipt of this email means that we have identified your services to be moved either because you are a colocation customer or because of the unique services you have with us. We expect this experience to be seamless with brief loss of connectivity while each server is disconnected from the existing switches and reconnected to their new port assignments which have been pre-configured / allocated. To minimize the impact to you during this time of growth, we need to complete this maintenance out of schedule as soon as possible within the next 24hrs.

    It is expected that this entire process will not last longer than a few minutes if that long but we must factor in time for any issues that may arise.  Tactically, this will be a few seconds for each port disconnected and reconnected to the network. The existing switching hardware which provides connectivity today will be stored and available in case this work needs to be rolled back however we do not anticipate that this to be required as this change has been tested .

     

    It is understood that this is not a typical maintenance notification window but this step is required to minimize risk and impact to you when usage spikes occur during the upcoming peak period(s).

    If you have any questions, please contact support [at] hostthebest.com.

    Thank you for your patience and for being a HostTheBest customer.

    Regards,

    HostTheBest - NYC

  • Date - 12/02/2018 13:00 - 12/07/2018 06:13
  • Last Updated - 12/02/2018 18:46
Replacing TOR switches with Cisco Catalyst 49 (Resolved)
  • Priority - High
  • Affecting Other - TOR switches in NYC POP1
  • To ALL Customers:

    To assist with our upgrade to multiple 100G network capacity and access throughout the network, we will be upgrading all switches to Cisco Catalyst 4948E-S that support connectivity to our leased dedicated server customers. This move will provide us with 40G capacity to each TOR switch once we introduce the Cisco Nexus 5k and 9k devices into the network.

    During this specific upgrade, customers will experience a loss of connectivity as the servers are unplugged from the network and reconnected to the network via the new TOR switches. While this is a matter of seconds for each switch, we want to inform you of the details of the change and its reasoning. All planning and creation of vlans will be created beforehand to ensure a seamless cutover where possible.

    While the maintenance is planned for two hours, it is not expected to last the full duration of time and at the most customers may experience a few seconds of loss of connectivity as the servers are reconnected.

    This maintenance is part of a multi-step process to upgrade the network to facilitate the deployment of our new 10G server product line and 20 - 100G ports for colocation customers in our NYC location while minimizing impact to our customers and their business.

    Should you have any questions about this or anything else, please contact support [at] hostthebest.com

  • Date - 12/01/2018 00:00 - 12/14/2018 21:40
  • Last Updated - 11/27/2018 22:35
High load on core router (Resolved)
  • Priority - High
  • Affecting Other - Core
  • High load on core router. Some customers may experience higher ping and response times or slowness of connectivity until resolved.

  • Date - 11/18/2018 22:11 - 11/19/2018 23:00
  • Last Updated - 11/27/2018 22:22
ASR9K Code Upgrade Planned Network Maintenanc (Resolved)
  • Priority - High
  • Affecting Other - NYC POP1
  • ASR9K Code Upgrade Planned Network Maintenance

    Dear HostTheBest Customer,

    As a valued customer, HostTheBest is committed to keeping you informed about any changes in the status of your service with us. This email is to alert you regarding maintenance we will be performing on our network: 

    Start time: 2:00 AM (local time) 10/02/2018
    End time: 04:00 AM (local time) 10/02/2018
    Work order number: NC837-21
    Order ID(s) impacted: 1-300025691
    Expected Outage/Downtime: 45-60 minutes

    HostTheBest customers receiving service in our 25 Broadway, New York, NY location (NYC POP 1) will be affected by this maintenance. This maintenance is being carried out by our primary upstream provider Cogent Communications. During the outage window, we will take the opportunity to replace a PDU providing power to Cabinet 2 and connect to a new power circuit. However, the core purpose of the outage is for Cogent to apply and activate software module upgrades on code running on the edge routers per the manufacturer's recommendations.

    During this maintenance window, you may experience up to two brief interruptions in service while we complete the maintenance activities. However, due to the complexity of the work, your downtime may be longer. Customers may also see some re-convergence during the maintenance window or may experience latency and packet loss intermittently throughout the window. We plan to introduce an additional carrier to provide redundancy during maintenance windows such as these and will keep you updated on that progress.

    We encourage all our customers to please check our network status page. Our website, email and livechat will be functional during the outage window.

    Our network operations engineers closely monitor the work and will do everything possible to minimize any inconvenience to you. If you have any problems with your connection after this time, please open a support ticket.

    We appreciate your patience during this work and welcome any feedback. Please send all questions and concerns to mailto:[email protected] or open a support request in the client portal.


    Thank you for being a valued HostTheBest customer.


    Sincerely,

    Customer Support
    HostTheBest
    [email protected]

  • Date - 10/02/2018 02:00 - 10/02/2018 14:41
  • Last Updated - 10/26/2018 14:41
Planned maintenance on blade chassis 1 (Resolved)
  • Priority - Medium
  • Date - 08/27/2018 00:00 - 09/25/2018 05:06
  • Last Updated - 08/26/2018 04:53