DataCity - Major Fiber Cut – Incident details

Major Fiber Cut

Resolved
Operational
Started 3 months agoLasted about 13 hours

Affected

Waterloo Internet Service

Degraded performance from 10:13 AM to 10:48 PM

Waterloo Datacenter

Degraded performance from 10:13 AM to 10:48 PM

Kitchener Internet

Degraded performance from 10:13 AM to 10:48 PM

Kitchener Datacenter

Major outage from 10:13 AM to 10:48 PM

Toronto Internet

Operational from 10:13 AM to 10:48 PM

Support SMS

Operational from 10:13 AM to 10:48 PM

Updates
  • Resolved
    Resolved

    Rogers fibre crew has advised that teams have spliced most of the fibre cables on the north end. On the South end the 288 count is completed preparations and expected to start splicing shortly. Additionally there is a middle section of the cable which is also being prepped and expected to start splicing shortly. Circuits should begin to recover once splicing on the centre portion and south end begins. 
    Currently there are no changes to the ETR. 

     

    Technician ETA: on-site

    Estimated Time To Restore: August 20th at 12:00 PM ET

    Next update: 9:00 PM ET or sooner should a major change in status occur

  • Update
    Update

    Splicing have begun on the north end of the cable, however services are not expected to recover until splicing on the south end beings.
    Preparations are underway on both ends of the cable. Additionally crews are changing over to an evening crew to relieve the existing crew and handing off. Teams expect to start seeing some circuits recover around 6PM - 7PM.

    Technician ETA: on-site

    Estimated Time To Restore: Gradual recovery starting around 6PM with a full Restoration on Aug 20th at 12:00 PM 

    Next update: 6:30 PM ET or sooner should a major change in status occur

  • Update
    Update

    Rogers fibre crew have completed assessments and all damaged and cut fibre cables have been accounted for. In total roughly 500 metres of replacement fibre optic cable needs to be replaced and 5 new FOSCs installed for the restoration. Teams have begun preparations for splicing on one end of the cable and about to start on the other end. Teams are also preparing for a crew change over as the current crew have been on-site since early this morning and are exhausted. An initial ETR for full restoration was provided for August 20th at 12:00 PM, however circuits are expected to recover sooner once splicing begins. An updated ETR will be provided as repairs and splicing progresses. 

     

    Technician ETA: on-site

    Estimated Time To Restore: August 20th at 12:00 PM

    Next update: 4:00 PM ET or sooner should a major change in status occur

  • Update
    Update

    Rogers fibre crew has started preparations on the North end of the cable where the first cut was identified. Teams are also concurrently delasing and removing some of the old cut pieces of cable to place the new one. 
    The amount of work for repairs is extensive, requiring about 500 metres of replacement cable as well as 4 new fibre optic splice closures (FOSCs) to be built and installed. No ETR is available at this time. 

     

    Technician ETA: on-site

    Estimated Time To Restore: N/A 

    Next update: 1:30 PM ET or sooner should a major change in status occur

  • Update
    Update

    Rogers fibre team is waiting for the aerial crew to arrive onsite. They need to do a deeper dive to see how far the damage extends. Teams continue to work to access the damage and are preparing an action plan.

     

    Technician ETA: Onroute

    Estimated Time To Restore: N/A

    Next update: 11:00 AM ET or sooner should a major change occur.

     

  • Identified
    Identified

    We are tracking a major fiber cut due to vandalism Around 2:50 AM EST. Both Zayo and Rogers are cut. Here is the latest note from the Rogers Fiber tech who is at the scene. The Rogers fibre technician arrived on-site at the fault location near Hanlon rd and Stone Rd in Guelph. Teams found 5 fibre cables cut due to vandalism. The fibre crew is currently assessing the damages and working on a repair plan. 

    Technician ETA: on-siteEstimated Time To Restore: N/A Next update: 8:30 AM ET or sooner should a major change in status occur