All Systems Operational
YourCloudTelco Calling Platform (Network) Operational
Arena Operational
YourCloudTelco Management CAP Operational
YourCloudPBX ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Past Incidents
Jun 17, 2019

No incidents reported today.

Jun 16, 2019

No incidents reported.

Jun 15, 2019
Resolved - As part of our DOS protection strategy, we use a digital mapping service provider MaxMind for IP location data addressing. Yesterday MaxMind deprecated an IP address immediately lowering our DOS responsiveness.

On Thursday afternoon when it first appeared my instinct was an upstream issue as the complaint appeared to be clipping and call quality against which our transit and upstreams monitoring showed a tonne of capacity with sub-millisecond connectivity between the networks.

When ‘we' realised it was occurring within the network, we initially believed it was an issue with our RTP port range. By Friday 12:00 pm we’d isolated it down to DOS, and a short while later isolating to the MaxMind change.

While we have now implemented a few additional checks and alarms the cause was a simple change in IP with our geolocation provider.

In answer to why it took 24 hrs, the problem was intermittent and dependant on coinciding with a DOS. While we saw the issue at a high level, we still needed to capture and ultimately Wireshark an actual call. Simply enabling verbosity against TBs of data would have taken months to analyse. In the end, Gunjan captured an actual call which we were able to point to the DOS prevention and then eventually to the MaxMind change of IP.

Starting in July we are phasing into production systems that will add significantly more scale to the way we register and maintain subscribers presence. In respect of the way we handle DOS while we have introduced granularity in the way we classify and treat offending IPs, that simply shifts into our session border.

Once again if you’ve made it to here, I thank you for reading. I’m happy to chat face to face it you require deeper detail.

Mike Johnstone
Jun 15, 10:54 AEST
Monitoring - A fix has been implemented and we are monitoring the results.
Jun 14, 12:08 AEST
Investigating - We are currently investigating call quality issues, we will update once we know more.
Jun 13, 15:02 AEST
Jun 12, 2019

No incidents reported.

Jun 11, 2019

No incidents reported.

Jun 10, 2019

No incidents reported.

Jun 9, 2019

No incidents reported.

Jun 8, 2019

No incidents reported.

Jun 7, 2019

No incidents reported.

Jun 6, 2019

No incidents reported.

Jun 5, 2019

No incidents reported.

Jun 4, 2019
Resolved - This incident has been resolved.
Jun 4, 17:21 AEST
Monitoring - Vocus is reporting multiple services down in Victoria. Services have come back up.
Investigation for the root cause is ongoing.
We will keep you posted, on their updates or they can be found http://status.vocus.com.au/view-incident.aspx?IncidentID=484
Jun 3, 15:48 AEST
Resolved - This has been resolved we can see numbers registered and calls up.
Our team is still investigating what happened.
Jun 4, 12:14 AEST
Monitoring - We have just had a DOS attack on the network, the customer that caused this has just been blocked and we are investigating the cause.
Registration would have dropped, but all servers are not back up.
Jun 4, 11:37 AEST