All systems are operational

About This Site

This is the technical status page of combahton GmbH which represents past incidents and planned maintenances.

Maintenance
Firmware Update - core4.ffm3.de

We're going to upgrade the firmware of core4.ffm3.de, which appears to be affected by a bug in Juniper JunOS causing SIGSEGV for the routing processing daemon. No customer impact is expected, as this router just serves as as border distribution core. We will shutdown bgp sessions on this equipment beforehand, customers might see changes in latency during the maintenance window.

Rollout of improved BGP Blackhole / Flowspec Detection

We're currently testing newly implemented bgp blackhole and flowspec event handler across multiple locations. Customers might see ddos incidents with mode "blackhole_dynamic" or "flowspec_dynamic". These dont have any effect and are done with low thresholds for the time being. Once we have validated the functionality over multiple weeks, we will put the new modes into effect with higher thresholds. Functionality is going to be further enhanced to offer truly intelligent reaction on very large volume attacks.

POP Relocation - Interxion FRA3 -> FRA16

We're going to move our points of presence (network pop) from Interxion FRA3 to FRA16. This step is necessary to increase power capacity by multiple kW for further growth, especially for power intensive devices like DDoS-Filters and Juniper MX Routers. Unfortuantely at the old location, we're not longer able to upgrade any further. The migration will be done router by router, customer by customer and crossconnect by crossconnect. We will carry it out as seamless as possible using temporary crossconnects between the new and the old datacenter.

Existing crossconnects will be migrated by Interxion on the switchover date. Affected customers will be informed two weeks in advance. We dont expect downtime greater than 1h per customer. Our servers at Interxion will be migrated with zero downtime, as we have enough capacity across the routers to benefit from our redundant network design.

Past Incidents

Saturday 7th May 2022

No incidents reported

Friday 6th May 2022

No incidents reported

Thursday 5th May 2022

FFM3 ⇄ EGH1 - Interconnection failure

We have identified a failure of the interconnection/transport line between FFM3 (Interxion) and EGH1 (Skylink).

We have noticed a short impact on a small amount of prefixes due to the abrupt loss of connectivity to Frankfurt.

Redundancy worked as expected, connectivity was automatically restored.

Wednesday 4th May 2022

No incidents reported

Tuesday 3rd May 2022

No incidents reported

Monday 2nd May 2022

No incidents reported

Sunday 1st May 2022

Corporate Websites APIv3 JWT Login - Performance Impact

We have identified performance impact for JWT Logins on APIv3. The cause has been isolated and performance is back to normal. Previously this might have caused to show HTTP 401 errors to customers, whenever the refresh token was too slowly distributed across backend servers. We will implement further measures.