[SOLVED] Fram is down

Update, 2022-12-07 12:45: The problem with the /cluster storage system has been identified and fixed, and the file system should work as normal again.

Update, 2022-12-07 09:30: Compute nodes and login nodes are up, and Fram is running jobs, but we are experiencing problems with the /cluster storage system. This shows up as occasional hangs (up to minutes) and/or Input/Output errors. It appears to affect all nodes (login or compute).

Update 2022-12-06 11:32: We have found the cause and restored most services. Still looking into some potential file system issues.

[2022-12-06 09:30] Fram is currently down. We are still investigating, but currently it looks like a gateway router has gone down. We will update this post as we know more.