All systems operational
Refreshed
Components
Asia East Servers
Operational
Uptime 100.000 % May 10, 2023
Uptime 100.000 % May 11, 2023
Uptime 100.000 % May 12, 2023
Uptime 100.000 % May 13, 2023
Uptime 100.000 % May 14, 2023
Uptime 100.000 % May 15, 2023
Uptime 100.000 % May 16, 2023
Uptime 100.000 % May 17, 2023
Uptime 100.000 % May 18, 2023
Uptime 100.000 % May 19, 2023
Uptime 100.000 % May 20, 2023
Uptime 100.000 % May 21, 2023
Uptime 100.000 % May 22, 2023
Uptime 100.000 % May 23, 2023
Uptime 100.000 % May 24, 2023
Uptime 100.000 % May 25, 2023
Uptime 100.000 % May 26, 2023
Uptime 100.000 % May 27, 2023
Uptime 100.000 % May 28, 2023
Uptime 100.000 % May 29, 2023
Uptime 100.000 % May 30, 2023
Uptime 100.000 % May 31, 2023
Uptime 100.000 % Jun 01, 2023
Uptime 100.000 % Jun 02, 2023
Uptime 100.000 % Jun 03, 2023
Uptime 100.000 % Jun 04, 2023
Uptime 100.000 % Jun 05, 2023
Uptime 100.000 % Jun 06, 2023
Uptime 100.000 % Jun 07, 2023
Uptime 100.000 %
Uptime over the past 30 days 100.000 % uptime
Asia Southeast Servers
Operational
Uptime 100.000 % May 10, 2023
Uptime 100.000 % May 11, 2023
Uptime 100.000 % May 12, 2023
Uptime 100.000 % May 13, 2023
Uptime 100.000 % May 14, 2023
Uptime 100.000 % May 15, 2023
Uptime 100.000 % May 16, 2023
Uptime 99.227 % May 17, 2023
Uptime 100.000 % May 18, 2023
Uptime 100.000 % May 19, 2023
Uptime 100.000 % May 20, 2023
Uptime 100.000 % May 21, 2023
Uptime 100.000 % May 22, 2023
Uptime 100.000 % May 23, 2023
Uptime 99.236 % May 24, 2023
Uptime 100.000 % May 25, 2023
Uptime 100.000 % May 26, 2023
Uptime 100.000 % May 27, 2023
Uptime 100.000 % May 28, 2023
Uptime 100.000 % May 29, 2023
Uptime 100.000 % May 30, 2023
Uptime 100.000 % May 31, 2023
Uptime 100.000 % Jun 01, 2023
Uptime 100.000 % Jun 02, 2023
Uptime 100.000 % Jun 03, 2023
Uptime 100.000 % Jun 04, 2023
Uptime 100.000 % Jun 05, 2023
Uptime 100.000 % Jun 06, 2023
Uptime 98.788 % Jun 07, 2023
Uptime 100.000 %
Uptime over the past 30 days 99.906 % uptime
Incidents
Short downtimes
Resolved | May 26, 2023 | 17:28 GMT+08:00
Very high usage during the below times which made the service unavailable for some users:
Apr 25, 2023, 14:39:41 - 14:52:08
May 3, 2023, 10:22:01 - 10:33:12
May 23, 2023, 08:05:20 - 08:07:44
We have identified an excessive quantity of data synchronised by some accounts, and we are optimising the data storage to scale better.
Some errors occurred in the engine used by the system to resize images in pdf exports, causing some short interruptions:
May 5, 2023, 08:05:01 - 08:35:47
May 16, 2023, 10:28:34 - 10:39:42
May 23, 2023, 07:58:03 - 08:01:14
We are investigating and monitoring these unexpected errors in order to fix them and recover from them.
Some security updates were installed during the night, leading to brief downtimes:
May 23, 2023, 03:26:30 - 03:29:39
May 23, 2023, 06:21:46 - 06:24:02
Major outage in Asia from Azure
Resolved | Feb 08, 2023 | 04:40 GMT+08:00
Novade services are down in some parts of Asia due to a major outage of Microsoft Azure's servers.
We are actively looking into the issue and will update you as soon as we have more information.
Update from Azure:
Issue Datacenter Cooling Event - Southeast Asia
Issue Summary: Starting around 20:19 UTC on 7 February 2023, a utility power surge in the Southeast Asia region tripped all of the chiller units for one datacenter offline. While working to restore the chiller units, temperatures in the datacenter increased so we have proactively powered down four storage scale units to avoid potential damage to the hardware.
https://status.azure.com/en-us/status
While Azure's outage is still ongoing, we managed to resume services with new servers on Wednesday 8/02 at 4pm SG time
Heavy usage
Resolved | Jan 03, 2023 | 08:00 GMT+08:00
Very high usage during the below times which made the service unavailable for some users.
Dec 6, 2022, 08:18:52-08:33:46 09:00:04-09:17:17
Dec 7, 2022, 08:38:58-08:45:17 08:50:07-09:03:58
Dec 8, 2022, 06:08:29-06:18:19
Dec 13, 2022, 08:29:43-08:34:15 08:56:35-09:01:27
Dec 21, 2022, 18:56:26-19:01:19
Dec 22, 2022, 16:40:13-16:51:45
Dec 24, 2022, 07:14:46-07:32:30
Dec 28, 2022, 14:29:50-14:43:20
Jan 3, 2023, 09:05:01-09:11:20 09:48:25-09:56:44
Jan 4, 2023, 09:43:49-09:48:50
We have identified a series of concurring events and we optimised the code and the setup to scale better.
EMEA Servers
Operational
Uptime 100.000 % May 10, 2023
Uptime 100.000 % May 11, 2023
Uptime 100.000 % May 12, 2023
Uptime 100.000 % May 13, 2023
Uptime 100.000 % May 14, 2023
Uptime 100.000 % May 15, 2023
Uptime 100.000 % May 16, 2023
Uptime 100.000 % May 17, 2023
Uptime 100.000 % May 18, 2023
Uptime 100.000 % May 19, 2023
Uptime 100.000 % May 20, 2023
Uptime 100.000 % May 21, 2023
Uptime 100.000 % May 22, 2023
Uptime 100.000 % May 23, 2023
Uptime 100.000 % May 24, 2023
Uptime 100.000 % May 25, 2023
Uptime 100.000 % May 26, 2023
Uptime 100.000 % May 27, 2023
Uptime 100.000 % May 28, 2023
Uptime 100.000 % May 29, 2023
Uptime 100.000 % May 30, 2023
Uptime 100.000 % May 31, 2023
Uptime 100.000 % Jun 01, 2023
Uptime 100.000 % Jun 02, 2023
Uptime 100.000 % Jun 03, 2023
Uptime 100.000 % Jun 04, 2023
Uptime 100.000 % Jun 05, 2023
Uptime 100.000 % Jun 06, 2023
Uptime 100.000 % Jun 07, 2023
Uptime 100.000 %
Uptime over the past 30 days 100.000 % uptime
Incident history
Short downtimes
Resolved | May 26, 2023 | 17:28 GMT+08:00
Very high usage during the below times which made the service unavailable for some users:
Apr 25, 2023, 14:39:41 - 14:52:08
May 3, 2023, 10:22:01 - 10:33:12
May 23, 2023, 08:05:20 - 08:07:44
We have identified an excessive quantity of data synchronised by some accounts, and we are optimising the data storage to scale better.
Some errors occurred in the engine used by the system to resize images in pdf exports, causing some short interruptions:
May 5, 2023, 08:05:01 - 08:35:47
May 16, 2023, 10:28:34 - 10:39:42
May 23, 2023, 07:58:03 - 08:01:14
We are investigating and monitoring these unexpected errors in order to fix them and recover from them.
Some security updates were installed during the night, leading to brief downtimes:
May 23, 2023, 03:26:30 - 03:29:39
May 23, 2023, 06:21:46 - 06:24:02
Affected components
- Asia Southeast Servers
Major outage in Asia from Azure
Resolved | Feb 08, 2023 | 04:40 GMT+08:00
Novade services are down in some parts of Asia due to a major outage of Microsoft Azure's servers.
We are actively looking into the issue and will update you as soon as we have more information.
Update from Azure:
Issue Datacenter Cooling Event - Southeast Asia
Issue Summary: Starting around 20:19 UTC on 7 February 2023, a utility power surge in the Southeast Asia region tripped all of the chiller units for one datacenter offline. While working to restore the chiller units, temperatures in the datacenter increased so we have proactively powered down four storage scale units to avoid potential damage to the hardware.
https://status.azure.com/en-us/status
While Azure's outage is still ongoing, we managed to resume services with new servers on Wednesday 8/02 at 4pm SG time
Affected components
- Asia Southeast Servers
Heavy usage
Resolved | Jan 03, 2023 | 08:00 GMT+08:00
Very high usage during the below times which made the service unavailable for some users.
Dec 6, 2022, 08:18:52-08:33:46 09:00:04-09:17:17
Dec 7, 2022, 08:38:58-08:45:17 08:50:07-09:03:58
Dec 8, 2022, 06:08:29-06:18:19
Dec 13, 2022, 08:29:43-08:34:15 08:56:35-09:01:27
Dec 21, 2022, 18:56:26-19:01:19
Dec 22, 2022, 16:40:13-16:51:45
Dec 24, 2022, 07:14:46-07:32:30
Dec 28, 2022, 14:29:50-14:43:20
Jan 3, 2023, 09:05:01-09:11:20 09:48:25-09:56:44
Jan 4, 2023, 09:43:49-09:48:50
We have identified a series of concurring events and we optimised the code and the setup to scale better.
Affected components
- Asia Southeast Servers