This post has been republished via RSS; it originally appeared at: New blog articles in Microsoft Tech Community.
Final Update: Saturday, 28 September 2019 22:23 UTC
We've confirmed that all systems are back to normal with no customer impact as of 09/28, 22:00 UTC.Our logs show the incident started on 09/24, 20:00 UTC and that during the 4 days and 2 hours that it took to resolve the issue customers experienced issues with charts not being loaded for dynamic alerts based on metrics.
- Root Cause: The failure was identified to be caused as part of recent deployment to our service.
- Incident Timeline: 4 Days & 2 Hours - 09/24, 20:00 UTC through 09/28, 22:00 UTC
-Jayadev
Update: Saturday, 28 September 2019 20:22 UTC
We continue to deploy the fix to the affected regions. Customers in regions that have not updated will continue to experience issues with charts not being loaded for dynamic alerts based on metrics until the deployment is completed to those regions. The problem was found to have started at 09/24 20:00 UTC.
We continue to deploy the fix to the affected regions. Customers in regions that have not updated will continue to experience issues with charts not being loaded for dynamic alerts based on metrics until the deployment is completed to those regions. The problem was found to have started at 09/24 20:00 UTC.
- Next Update: Before 09/29 02:30 UTC
Update: Saturday, 28 September 2019 14:32 UTC
We continue to deploy the fix to the affected regions. Customers in regions that have not updated will continue to experience issues with charts not being loaded for dynamic alerts based on metrics until the deployment is completed to those regions. The problem was found to have started at 09/24 20:00 UTC.
We continue to deploy the fix to the affected regions. Customers in regions that have not updated will continue to experience issues with charts not being loaded for dynamic alerts based on metrics until the deployment is completed to those regions. The problem was found to have started at 09/24 20:00 UTC.
- Work Around: None.
- Next Update: Before 09/28 21:00 UTC
Update: Saturday, 28 September 2019 02:42 UTC
We continue to deploy the fix to the affected regions.Customers in regions that have not been updated will continue to experience issues with charts not being loaded for dynamic alerts based on metrics until the deployment is completed to those regions.The problem was found to have started at 09/24 20:00 UTC.
We continue to deploy the fix to the affected regions.Customers in regions that have not been updated will continue to experience issues with charts not being loaded for dynamic alerts based on metrics until the deployment is completed to those regions.The problem was found to have started at 09/24 20:00 UTC.
- Next Update: Before 09/28 09:00 UTC
Update: Friday, 27 September 2019 20:10 UTC
We continue to deploy the fix to the affected regions.Customers in regions that have not been updated will continue to experience issues with charts not being loaded for dynamic alerts based on metrics until the deployment is completed to those regions.The problem was found to have started at 09/24 20:00 UTC.
We continue to deploy the fix to the affected regions.Customers in regions that have not been updated will continue to experience issues with charts not being loaded for dynamic alerts based on metrics until the deployment is completed to those regions.The problem was found to have started at 09/24 20:00 UTC.
- Next Update: Before 09/28 02:30 UTC
Update: Thursday, 26 September 2019 23:42 UTC
Root cause has been identified as a code-related issue.To address this issue a hotfix has been tested and validated in the pre-production environment.Currently the build is being deployed to all the regions and we expect the deployment to be completed in approximately 24 hours.Customers will continue to experience issues with charts not being loaded for dynamic alerts based on metrics until the deployment is completed to all regions. The problem was found to have started at 09/24 20:00 UTC.
- Next Update: Before 09/27 18:00 UTC
Initial Update: Thursday, 26 September 2019 19:26 UTC
We are aware of issues within Azure Monitor Services and are actively investigating. Customers may experience issues with charts not being loaded for dynamic alerts based on metrics and the start time for the issue has been revised to be from 09/24 20:00 UTC.
-Jayadev
We are aware of issues within Azure Monitor Services and are actively investigating. Customers may experience issues with charts not being loaded for dynamic alerts based on metrics and the start time for the issue has been revised to be from 09/24 20:00 UTC.
- Next Update: Before 09/26 23:30 UTC
-Jayadev
Initial Update: Thursday, 26 September 2019 18:02 UTC
We are aware of the issues within Azure Monitor Services and are actively investigating.Customers may experience issues with charts not being loaded for dynamic alerts based on metrics.
-Jayadev
We are aware of the issues within Azure Monitor Services and are actively investigating.Customers may experience issues with charts not being loaded for dynamic alerts based on metrics.
- Next Update: Before 09/26 22:30 UTC
-Jayadev