All Systems Operational
Uptime over the past 90 days. View historical uptime.
Network Infrastructure Operational
90 days ago
99.99 % uptime
Today
Upstream BGP Sessions Operational
90 days ago
100.0 % uptime
Today
Cloud Storage Network Operational
90 days ago
100.0 % uptime
Today
DDoS-Protection Operational
90 days ago
100.0 % uptime
Today
Core Network Operational
90 days ago
99.97 % uptime
Today
Interconnection Operational
90 days ago
100.0 % uptime
Today
Public REST API Operational
90 days ago
100.0 % uptime
Today
Request Handler Operational
90 days ago
100.0 % uptime
Today
Scheduling Services Operational
90 days ago
100.0 % uptime
Today
Public Services Operational
90 days ago
100.0 % uptime
Today
Nameservers Operational
90 days ago
100.0 % uptime
Today
DNS Caches Operational
90 days ago
100.0 % uptime
Today
Corporate Websites Operational
90 days ago
100.0 % uptime
Today
my.aurologic.com Operational
90 days ago
100.0 % uptime
Today
mirror.aurologic.com ? Operational
90 days ago
100.0 % uptime
Today
Cloud Infrastructure Operational
90 days ago
100.0 % uptime
Today
FFM1 - Langen, Germany Operational
90 days ago
100.0 % uptime
Today
Dedicated Servers Operational
90 days ago
100.0 % uptime
Today
FFM1 - Langen, Germany Operational
90 days ago
100.0 % uptime
Today
FFM2 - Frankfurt, Germany Operational
90 days ago
100.0 % uptime
Today
FFM3 - Frankfurt, Germany Operational
90 days ago
100.0 % uptime
Today
EGH1 - Eygelshoven, Netherlands Operational
90 days ago
100.0 % uptime
Today
HEL1 - Helsinki, Finland Operational
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Scheduled Maintenance
Hardware Deployment - storage-core0[1,2] Aug 14, 2024 10:00-18:00 UTC
We're going to deploy storage core switches 01 and 02 at the FFM1 site. This is a new 100Gbps switch stack, exclusively meant for Cloud Server NVMe storage deployment, enabling us to migrate deprecated combahton.net GlusterFS based storages over the course of the next months onto CEPH. The new architecture consists of a ECMP based architecture using leaf/spine principle for compute and storage cabinets. No impact to be expected.
Posted on Aug 06, 2024 - 03:36 UTC
DCI Upgrade - FFM2 FFM3 Sep 22, 2024 22:00-23:00 UTC
Update - After clarification with the datacenter operator at Interwerk, we'll adding 2x 100G further. Total capacity after the upgrade will be 4x 100G (400Gbps) distributed across two darkfibers with 2x 100G each.
Aug 08, 2024 - 11:23 UTC
Scheduled - We're going to upgrade the DCI (Datacenter Interconnection) of the FFM2 (Interwerk) Points of Presence by new Arista Equipment as well as 2x 100Gbps towards different routers at Digitalrealty (Interxion) FRA16. We'll get in touch with the customers individually to allow for a smooth transition.
Aug 01, 2024 - 00:39 UTC
Hardware Upgrade - core01.ffm3.de Sep 26, 2024 22:00 - Sep 27, 2024 02:00 UTC
We're going to upgrade the hardware of router core01.ffm3.de onto Arista 100G Chassis. Customers with connection onto that equipment may be migrated upfront as agreed individually. We'll get in touch with affected customers by email.
Posted on Aug 01, 2024 - 00:45 UTC
Hardware Deployment - core02.ffm1.de router Sep 30, 2024 22:00 - Oct 1, 2024 02:00 UTC
We're taking the core02.ffm1.de router live, which will connect onto the FFM3/FFM5 DWDM equipment, as well as being locally interconnected with router core01.ffm1.de by 1,6Tbps.

Once the upgrade is completed, customers can request a router-diverse connection onto the new equipment, i.e. in order to increase redundancy.
Posted on Aug 06, 2024 - 03:26 UTC
Hardware Deployment - core01.ffm3.de (Arista) Oct 7, 2024 13:28-14:28 UTC
We're going to deploy the replacement of Juniper QFX based core01.ffm3.de with Arista 100G Chassis. The reason for this change is the repeated issues we had encountered in the past with Juniper JunOS, notable alarming low software quality and possible completely missing quality assurance, making regular changes a adventure on it's own - or certain features just not work as advertised. Therefore we have decided to finally get rid gradually of Juniper Networks hard- and software.

Once the new hardware is deployed, we'll contact related customers one-by-one to plan switchover.
Posted on Aug 27, 2024 - 13:29 UTC
Past Incidents
Sep 7, 2024

No incidents reported today.

Sep 6, 2024

No incidents reported.

Sep 5, 2024

No incidents reported.

Sep 4, 2024
Disturbance - Services Kafka Cluster
Resolved - The issue has been resolved and we see related consumers picking up the new certificate.
Sep 4, 11:27 UTC
Identified - We're being aware about an issue with the services kafka cluster, causing adverse effects and delayed changes to the following API components due to a software bug after refreshing certain TLS certificates:

- DDoS-Protection Permanent Routing
- DDoS-Protection Incident Reporting
- DHCP Host/Subnet Handling
- Access Gateway Acquires
- CEPH RBD Cloud Storage block image handling

Rest assured, the issue is being handled with top priority.
Sep 4, 11:09 UTC
Sep 3, 2024

No incidents reported.

Sep 2, 2024

No incidents reported.

Sep 1, 2024
Migration - core1.ffm1.de (Juniper QFX) router
Update - We have decided to post-pone physical reconnection of certain cabinets/switches/servers, as this would be outside of the announced maintenance window, given that we have about 30 links over various cabinets and mtp casettes to migrate. Instead, we'll move these as of mid September 2024. The said links will continue to operate over the Juniper QFX equipment as is until the second maintenance window has been finished.

A new maintenance window for the layer-1 migration of uplinks will be sent out shortly. That said, maintenance is finished and we'll stay available for the next hour. In case you're observing any issues, please let us know by ticket. Afterwards, you can still let us know by free-of-charge emergency ticket.
Sep 1, 00:00 UTC
Completed - The scheduled maintenance has been completed.
Sep 1, 00:00 UTC
Update - Routing switchover completed, it appears all prefixes are normally working after 10 seconds downtime. In case you are observing any anomalities, please let us know by ticket.

Datacenter Operations will now start moving device links, which can indeed have a few minutes of downtime per individual link.
Aug 31, 23:23 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 31, 22:00 UTC
Scheduled - We're going to migrate the router core1.ffm1.de (Juniper QFX) onto router core01.ffm1.de Arista 100G Chassis. We'll get in touch with affected customers by email. The maintenance incurs a maximum downtime of 30 minutes while we're moving device links and networks.
Aug 29, 09:32 UTC
Aug 31, 2024
Decommission - Datacamp (CDN77) Upstream
Completed - The scheduled maintenance has been completed.
Aug 31, 23:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 31, 22:00 UTC
Scheduled - We're going to decommission the upstream connection with CDN77 in Frankfurt. This is mainly due to difficulties having an adverse effect on our network integrity as well as management overhead, as prefix changes usually taking a week.
Aug 7, 16:44 UTC
Aug 30, 2024

No incidents reported.

Aug 29, 2024

No incidents reported.

Aug 28, 2024

No incidents reported.

Aug 27, 2024

No incidents reported.

Aug 26, 2024
core04.ffm3.de - Segfault
Resolved - Router core04.ffm3.de had experienced an unexpected segfault, device is up again after a few minutes outage. We'll plan a JunOS upgrade shortly.
Aug 26, 17:42 UTC
Aug 25, 2024
Darkfiber Maintenance - FFM1, Tornado Datacenter - Digitalrealty (ex. Interxion) FRA16
Completed - Confirmed, traffic has been switched back and we see all our interfaces in Frankfurt operating below 75% utilization.
Aug 25, 13:04 UTC
Update - We see our interfaces between Digitalrealty FRA16 and Tornado Datacenter FRA01 in a working state since about a minute. Signal strength appears to have improved as well. Waiting for confirmation of the supplier, before we take them live, in order to avoid unwanted connectivity loss.
Aug 25, 12:25 UTC
Update - The supplier reports:

"Our fiber team is working on restoration, works are still ongoing, but many fibers are restored.

Please check status of your circuit, bounce your ports and reply to us if you still see issues on it."

We dont see our route to Digitalrealty yet online, DWDM equipment reports zero signal and according to OTDR still ending shortly after FRA16. We'll possibly shift some traffic around to keep other interconnection links within regular levels.
Aug 25, 11:37 UTC
Update - So far it looks good, the darkfiber route between Digitalrealty FRA16 and Equinix FR7 was a bit loaded, causing monitoring alarms on defined set points. Traffic got shifted precautionary to preserve spare bandwidth, capacity was still within the regular expected levels.

At Equinix, we had a bottleneck on router core01.ffm5.de ingress, causing 96% link utilization. This has been upgraded swiftly by another 200Gbps, resolving near 100% usage. Momentarily, we switched some traffic off RETN onto Gcore, while we did the upgrade.

Maintenance works are in progress at Weismuellerstrasse, Frankfurt East, nearby Digitalrealty FRA16. Talking to the fiber crew, they said it will take eventually longer - Monday is not impossible at the moment. There's quite some people working to replace the splice enclosure. We'll keep this ticket updated up on receiving updates from our darkfiber supplier.

TL;DR; busy morning, however better than expected and under active observation.
Aug 24, 11:21 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Aug 24, 06:00 UTC
Update - Precautionary, traffic has been routed off the darkfiber line between Digitalrealty FRA16 (FFM3) and Tornado Datacenter FRA01 (FFM1). Capacity between Digitalrealty FRA16 (FFM3) and Equinix FR7 (FFM5) is within normal levels and we do not expect our spare capacity on that darkfiber to be utilized. In case you're observing any unexpected issues, please let us know.
Aug 23, 23:17 UTC
Scheduled - On 24/08/2024 between 06:00 and 25/08/2024 18:00 UTC, the darkfiber supplier will perform scheduled maintenance on one dark fiber route between Tornado Datacenter (FFM1) and Digitalrealty (ex. Interxion) FRA16 due to "Replacement damaged splice enclosure in Frankfurt. The joint is currently embargoed and not in the best condition, to keep our high network standard and avoid any outages, we need to replace it.". Traffic will be shifted beforehand on other links, we do not faciliate any customer impact with the said works.

We are aware, this is a longer going outage of that fiber route. Following our redundancy measures and proper capacity planning in place, we do not faciliate impact to our customers. Traffic will continue over alternative routes, primarily Equinix FR7.
Jul 18, 09:44 UTC
Aug 24, 2024
← Incident History Powered by Atlassian Statuspage