Hardware was successfully replaced and all services restored since 2024-03-14 17:00 CET.
We're closing this incident. If you have additional questions related to this incident please reach out to our team at customerservice@soundofdata.nl or via phone at +31 10 4291411
Posted Mar 15, 2024 - 11:45 CET
Update
Following up with a bit more insights, due to a hardware failure in one of the switches, a failover occurred. This failover worked as intended but got so much additional traffic that caused the keep-alive check to fail a bit too soon causing additional impact.
In about 10 minutes the keep-alive was restored and all traffic was restored.
Total impact on calls: Extremely limited. Only new call setups took a bit longer than usual.
Currently engineers are underway to the DC to replace the faulty hardware which we expect to be completed by the end of the day.
We're keeping this incident open until the new hardware has been installed and full service is restored.
Posted Mar 14, 2024 - 13:51 CET
Monitoring
Mitigating efforts have been taken by our upstream partners. We're seeing everything coming back online and response times are returning to normal.
We're still in the process of verification of individual customer environments we expect all issues to be cleared.
Posted Mar 14, 2024 - 12:25 CET
Investigating
We are investigating reports related to DNS timeouts, connectivity issues and general failures related to issues in one Datacenter. Impact assessment is currently underway and possible mitigation efforts are investigated.
Next update in 30 minutes.
Posted Mar 14, 2024 - 12:13 CET
This incident affected: ITSP | Services (Voice Services).