Impacted services: Network, Ede
[Initial: 14:56] We are currently experiencing networking issues in Ede. We are looking into this.
Update 15:04:
While adding a management-switch to the network, and rerouting cables to that networking-switch, parts of the network in Ede became unresponive. The changes have been reverted and the situation is now stable. We will look into to why this activity caused this issue.
Update 15:10:
The issue started at 14:50:15 and was resolved at 14:56:21. Everything seems stable now. We will keep you updated about the root-cause of this issue.
Update 16:18:
Root cause: Spanning tree shut down a core-link.
Tuxis is in the proces of replacing the previous (Huawei, ethernet/vlan-based) switches with new VXLAN-Edgecore/OcNos switches. Part of this project is replacing the management-switches, which allow us to manage the core-switches out of band. Todays work was part of this project, we were placing a new out-of-band management switch and we were connecting the new switches and IPMI interfaces to said management switch.
During this project, we have a single link between 'the old' switching infra and 'the new' switching infra. This port was shut down automatically because the switch saw a so-called BPDU-packet. Therefor, machines on the two switching-setups were unable to reach each-other.
We will locate the device that is originating the spanning-tree packets ánd we will update the config of the switchport that was shutdown, so that it will not do that again.
We apologise for the inconvenience this caused.
