Event Type: Object Storage Infrastructure Maintenance
Start Time: 2024-09-19 13:20:00 UTC
End Time: 2024-09-19 16:20:00 UTC
Our Cloud Storage team will be performing upgrades to our Amsterdam Object Storage infrastructure starting at YYYY-MM-DD HH:MM UTC. During this maintenance window, creating, attaching, resizing, and deletion of Object Storage subscriptions may be temporarily unavailable.
Previously deployed Object Storage subscriptions in Amsterdam will remain online.
Event Type: Object Storage Infrastructure Maintenance
Start Time: 2024-09-18 17:00:00 UTC
End Time: 2024-09-18 21:00:00 UTC
Our Cloud Storage team will be performing upgrades to our Singapore Object Storage infrastructure starting at YYYY-MM-DD HH:MM UTC. During this maintenance window, creating, attaching, resizing, and deletion of Object Storage subscriptions may be temporarily unavailable.
Previously deployed Object Storage subscriptions in Singapore will remain online.
Event Type: Object Storage Infrastructure Maintenance
Start Time: 2024-09-18 13:00:00 UTC
End Time: 2024-09-18 15:00:00 UTC
Our Cloud Storage team will be performing upgrades to our Delhi NCR Object Storage infrastructure starting at YYYY-MM-DD HH:MM UTC. During this maintenance window, creating, attaching, resizing, and deletion of Object Storage subscriptions may be temporarily unavailable.
Previously deployed Object Storage subscriptions in Delhi remain online.
Event Type: Object Storage Infrastructure Maintenance
Start Time: 2024-09-16 14:15:00 UTC
End Time: 2024-09-16 18:15:00 UTC
Our Cloud Storage team will be performing upgrades to our Bangalore Object Storage infrastructure starting at 2024-09-16 14:00:00 UTC. During this maintenance window, creating, attaching, resizing, and deletion of Object Storage subscriptions may be temporarily unavailable.
Previously deployed Object Storage subscriptions in Bangalore will remain online.
Event Type: Network Upgrade
We are performing system changes in the Miami location during the following scheduled maintenance window.
Start Time: 2024-09-18 04:00:00 UTC
End Time: 2024-09-18 08:00:00 UTC
We schedule higher impact maintenance events during off-peak times to reduce impact to customer infrastructure. Our engineers make every effort to minimize system impact, however, network reachability to Miami instances may be affected for some, or all, of the scheduled maintenance window as we perform this work. While it’s important to be aware of start and end times of the maintenance window, due to our redundant network architecture, our engineers expect that you may see little to no impact at all while the work is performed.
Event Type: Network Upgrade
We are performing system changes in the Chicago location during the following scheduled maintenance window.
Start Time: 2024-09-11 05:00:00 UTC
End Time: 2024-09-11 09:00:00 UTC
We schedule higher impact maintenance events during off-peak times to reduce impact to customer infrastructure. Our engineers make every effort to minimize system impact, however, network reachability to Chicago instances may be affected for some, or all, of the scheduled maintenance window as we perform this work. While it’s important to be aware of start and end times of the maintenance window, due to our redundant network architecture, our engineers expect that you may see little to no impact at all while the work is performed.
Event Type: Network Upgrade
We are performing system changes in the Tokyo location during the following scheduled maintenance window.
Start Time: 2024-09-11 16:00:00 UTC
End Time: 2024-09-11 21:00:00 UTC
We schedule higher impact maintenance events during off-peak times to reduce impact to customer infrastructure. Our engineers make every effort to minimize system impact, however, network reachability to Tokyo instances may be affected for some, or all, of the scheduled maintenance window as we perform this work. While it’s important to be aware of start and end times of the maintenance window, due to our redundant network architecture, our engineers expect that you may see little to no impact at all while the work is performed.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
Our remote hands team is looking into a hardware issue on the the host node on which your VPS resides.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
At 16:30 UTC on Tuesday, 2024-04-30, we will be performing a reboot of the systems providing VNC / remote console access in our Asia, Pacific Island, and Australia Data Centers. During the reboot there will be a brief time where Bare Metal provisioning and VNC are unavailable. We expect minimal to no customer impact.
At 15:00 UTC on Tuesday, 2024-04-30, we will be performing a reboot of the systems providing VNC / remote console access in PNJ. During the reboot there will be a brief time where Bare Metal provisioning and VNC are unavailable. We expect minimal to no customer impact.
At 16:00 UTC on Tuesday, 2024-04-30, we will be performing a reboot of the systems providing VNC / remote console access in the Europe, Middle East, and Africa regions. During the reboot there will be a brief time where Bare Metal provisioning and VNC are unavailable. We expect minimal to no customer impact.
At 15:30 UTC on Tuesday, 2024-04-30, we will be performing a reboot of the systems providing VNC / remote console access in the Americas. During the reboot there will be a brief time where Bare Metal provisioning and VNC are unavailable. We expect minimal to no customer impact.
Event Type: NVMe Block Storage Infrastructure Maintenance
Start Time: 2024-02-19 23:00:00 Asia/Tokyo
End Time: 2024-02-20 11:00:00 Asia/Tokyo
Our Cloud Storage team will be performing upgrades to our Tokyo NVMe Block Storage infrastructure starting at 2024-02-19 23:00:00 Asia/Tokyo (14:00:00 UTC). During this maintenance window, creating, attaching, resizing, and deletion of NVMe Block Storage volumes may be temporarily unavailable.
Previously deployed NVMe Block Storage volumes in Tokyo will remain online without interruption and will not be impacted by this event.
The New Jersey object storage cluster is currently fully down. A comprehensive investigation of this incident is now underway. We will work on this dilligently and report further updates as they become available.
Note that the other object storage locations are unaffected by this event.
Thank you for your patience and understanding.
Event Type: Service Degraded Performance and Availability
Our Cloud Storage team is investigating a partial outage situation with our Object Storage infrastructure. The following services may be impacted by this event:
- Object Storage Subscription management
- Adding or removing buckets
- S3 client issues
We are working quickly to restore service to its optimal state.
Our control panel at my.vultr.com is currently inaccessible to some customers. Our engineering team is aware of this issue and is working diligently to resolve this as quickly as possible.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
Event Type: Network Upgrade
We are performing system changes in the Dallas location during the following scheduled maintenance window.
Start Time: 2023-12-07 06:00:00 UTC
End Time: 2023-12-07 10:00:00 UTC
We schedule higher impact maintenance events during off-peak times to reduce impact to customer infrastructure. Our engineers make every effort to minimize system impact, however, network reachability to Dallas instances may be affected for some, or all, of the scheduled maintenance window as we perform this work. While it’s important to be aware of start and end times of the maintenance window, due to our redundant network architecture, our engineers expect that you may see little to no impact at all while the work is performed.
Event Type: Network Upgrade
We are performing system changes in the Los Angeles location during the following scheduled maintenance window.
Start Time: 2023-11-14 08:00:00 UTC
End Time: 2023-11-14 12:00:00 UTC
We schedule higher impact maintenance events during off-peak times to maintain our ideal hosting environment. Our engineers make every effort to minimize system impact; however, Los Angeles instances may be unreachable for some, or all, of the scheduled maintenance window as we perform network, firmware, or host upgrades.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
The Constant Company, creator of Vultr, is aware of and following the situation in Israel. At this time we do not expect any disruption of service in our Tel Aviv location. We will continue to closely monitor services as the situation evolves, and we will advise our customers of any changes which have the potential to impact service delivery.
We believe this is a crucial time to remind our customers about the importance of the 3-2-1 Backup Strategy for safeguarding all critical data. Please see the case study here for more information: https://www.vultr.com/docs/case-study-use-a-321-backup-strategy-at-vultr/
Please note that Vultr Snapshots and Backups are stored in the same location as the instance they are made from, however when you deploy a new instance from them in a different location, they will be automatically transferred and stored in the new location as well.
Event Type: Network Upgrade
We are performing system changes in the Seoul location during the following scheduled maintenance window.
Start Time: 2023-10-18 19:00:00 UTC
End Time: 2023-10-18 21:00:00 UTC
We schedule higher impact maintenance events during off-peak times to maintain our ideal hosting environment. Our engineers make every effort to minimize system impact; however, Seoul instances may be unreachable for some, or all, of the scheduled maintenance window as we perform network, firmware, or host upgrades.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
We are currently experiencing a partial outage in our New Jersey location. Our System Administrators are actively working with our onsite technicians to restore service as quickly as possible.
Event Type: Block Storage Infrastructure Maintenance
Start Time: 2023-09-20 10:30am EST
End Time: 2023-09-22 17:00 EST
Our Cloud Storage team will be performing maintenance on our Seattle Block Storage infrastructure starting at 2023-09-20 14:30:00 UTC.
We will be moving more Block Storage data to our new cluster in Seattle but you should not expect any interruption to your services. Please let us know you have any trouble with your block storage volumes during or after this maintenance.
Thank you
We are currently experiencing a partial outage in our Madrid location. Our network engineers are actively working with our upstream providers to restore connectivity as quickly as possible.
Event Type: Network Upgrade
We are performing system changes in the Delhi NCR location during the following scheduled maintenance window.
Start Time: 2023-09-12 19:00:00 UTC
End Time: 2023-09-12 23:00:00 UTC
We schedule higher impact maintenance events during off-peak times to maintain our ideal hosting environment. Our engineers make every effort to minimize system impact; however, Delhi NCR instances may be unreachable for some, or all, of the scheduled maintenance window as we perform network, firmware, or host upgrades.
Event Type: Network Upgrade
We are performing system changes in the Chicago location during the following scheduled maintenance window.
Start Time: 2023-09-12 05:00:00 UTC
End Time: 2023-09-12 07:00:00 UTC
We schedule higher impact maintenance events during off-peak times to maintain our ideal hosting environment. Our engineers make every effort to minimize system impact; however, Chicago instances may be unreachable for some, or all, of the scheduled maintenance window as we perform network, firmware, or host upgrades.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
Event Type: Network Upgrade
We are performing system changes in the Dallas location during the following scheduled maintenance window.
Start Time: 2023-09-12 22:00:00 UTC
End Time: 2023-09-13 02:00:00 UTC
We schedule higher impact maintenance events during off-peak times to reduce impact to customer infrastructure. Our engineers make every effort to minimize system impact, however, network reachability to Dallas instances may be affected for some, or all, of the scheduled maintenance window as we perform this work. While it’s important to be aware of start and end times of the maintenance window, due to our redundant network architecture, our engineers expect that you may see little to no impact at all while the work is performed.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
We are providing an update on restoration progress regarding the extended outage to the Object Storage platform (VOBS) in the New Jersey (EWR) location.
At this time, cluster recovery is continuing to track towards a healthy state while running background recovery operations. The most pressing and service impacting challenge, however, is that we have identified a small portion of objects that could have partial corruption. Our efforts are focused on all attempts to repair the corrupted objects as well improvements to the storage interfaces which hang when encountering corruption.
While the potential scope of impact of this problem is limited to only 0.00024% of objects stored in the cluster, the issue presents challenges for recovery and general cluster I/O. We are working with the most seasoned experts in the world to restore full operation as safely and quickly as possible. Pending the level of success for repairing corrupted blocks, we will work to map the issue to specific objects and provide notification directly to affected users that can be identified.
Please be reminded that the other Object Storage locations are available to you and fully up to date with our modern hardware and software specifications.
[ New Jersey Object Storage Update ]
Affected Product : New Jersey Object Storage
There are an increased number of reports regarding performance and timeouts. These issues are currently being addressed to bring object storage to a more optimal state.
[ New Jersey Object Storage Maintenance Update ]
Affected Product : New Jersey Object Storage
Maintenance Date : Monday, July 24
Further maintenance and upgrades will be conducted for the New Jersey Object Storage product starting on Monday, July 24. Customers may observe some performance disruption and client access timeouts for New Jersey object storage subscriptions during this work.
Thank you for your patience and understanding.
Event Type: Service Degraded Performance and Availability
Our Cloud Storage team is investigating a partial outage situation with our Object Storage infrastructure. The following services may be impacted by this event:
- Object Storage Subscription management
- Adding or removing buckets
- S3 client issues
We are working quickly to restore service to its optimal state.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
Hello,
We are providing an update on restoration progress regarding the extended outage to the Object Storage platform (VOBS) in the New Jersey (EWR) location.
At this time, we are continuing to work to bring VOBS EWR back to normal health. Some or all of your data may be accessible at this time, either constantly or intermittently. Rebalancing continues as anticipated and we expect to reach a state where acceptable read performance is available soon. As part of this, we are continuing to retrofit new, more performant hardware in VOBS EWR. Once we have achieved an acceptable level of read availability, we will work to restore write access, and lastly performance to normal levels. Please note that we are making every effort to safely expedite this process and minimize the additional impact time.
Thank you for your patience as we work through this outage.
We will continue to provide regular updates until normal performance is restored.
Hello,
Please review the following information regarding the remediation of an extended outage to the Object Storage platform (VOBS) in the New Jersey (EWR) location. The outage occurred as a result of surging demand before our planned incremental hardware retrofit (to match our NVMe based clusters in other locations) could be completed and the cluster was not able to consistently perform routine balancing operations.
Our team’s restoration priorities are preventing data loss, followed by data availability, restoring write access, and finally performance. While user access is limited, the cluster is actively rebalancing and is expected to reach an acceptable read state soon. In the meantime, you should find that objects can be read with intermittent success, retries may produce the best results.
VOBS in other locations (SJC1, AMS1, BLR1 & DEL1) already have high performance NVMe storage in place and we recommend creating a new VOBS subscription there for your workloads while the extended maintenance efforts in EWR are completed. While we expect your access to VOBS EWR to be restored soon, the platform will be under higher load than normal during the hardware replacement process over the next few weeks.
We will provide regular updates until normal read/write access is restored.
Event Type: Service Degraded Performance and Availability
Our Cloud Storage team is investigating a partial outage situation with our Object Storage infrastructure. The following services may be impacted by this event:
- Object Storage Subscription management
- Adding or removing buckets
- S3 client issues
We are working quickly to restore service to its optimal state.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
Event Type: Service Degraded Performance and Availability
Our Cloud Storage team is investigating a partial outage situation with our Object Storage infrastructure. The following services may be impacted by this event:
- Object Storage Subscription management
- Adding or removing buckets
- S3 client issues
We are working quickly to restore service to its optimal state.
An outage or maintenance window is affecting a subset of users in this region. Detailed outage information is available in the customer portal if this event is impacting your resources.
