Several customers escalated quality problems
on the 3rd and 5th of October in the morning.
At this time we got errors message on
Th1/Th2 routers having problem to follow
% FM-4-TCAM_ENTRY: Hardware TCAM entry capacity exceeded
So some traffic was handled in software for some
Interface routed traffic will be software switched in ingress direction
October the 5th at 11am, we found the origin of the
Problem: Some dedicated servers have been subject to attacks
and we secure them on the border routers.
While the attacks of the 3 and 5 were more
than tens of Gbps from several hundreds of thousands of
IPs and the router only managed to match many IP to
limit the incoming bandwidth to our network.
We removed the protections for the relief of routers.
This will require us to change the protection policy
in case of attack: instead of limiting the bandwidth to
these servers, we will block servers and null router
the traffic to the attacked IP.