There is currently a problem with accessing files below /cluster on Saga. As a consequence Saga does not function properly.
We are working on the issue. Sorry for the inconvenience.
Update 27 September @ 13:15
The issue has been resolved and you can use Saga and /cluster normally again. We are looking for an underling problem.
There is currently a problem with accessing files below /cluster on Saga. As a consequence Saga does not function properly.
We are working on the issue. Sorry for the inconvenience.
Update 26.09 @ 9:10:
The filesystem issue is resolved and Saga is functioning properly again.
We are currently experiencing issues with the filesystem on Betzy.
The problem affects mainly /cluster/work area.
We are trying to fix this as quickly as possible.
[UPDATE: 17:00] Problem with filesystem persists. Login nodes are now offline. We have contacted the vendor.
[UPDATE: 19:30] login nodes are back online.
We are going to conduct a file system check on Fram file system. This might lead to degraded performance while the scan is ongoing.
One of the Betzy file system disk controllers has an issue that need to be rectified. This will cause lower performance on file system for a couple of hours today starting at 13:00
Some users are experiencing slow filesystem issues on fram.
We are currently trying to resolve the issue, but it is a periodical problem that makes debugging difficult.
Sorry for the inconvenience this is causing.
Best Regards
Infra team
[UPDATE, 2022-05-13 08:00] The maintenance stop is over. There may still be some file system issues. Please report via regular support channels
[UPDATE, 2022-05-11 08:00] The maintenance stop has now started.
The will be a maintenance of the storage system on the Fram supercomputer. The cluster will be unavailable from the 11th of May at 08:00 until the 12th of May at 20:00.
We need to replace an IO module and HDD in Fram storage today.
This should not affect your work and the system will be running as usual during the procedure. If you get any file system issues during this service please send us a support request.
Best Regards
Infrastructure Team
We need to conduct some work on the filesystem controllers for NIRD – TOS. Unfortunately this results in a short unavailability (downtime) period.
All services connected to- and/or utilizing TOS (Tromsø) part of NIRD will be affected. Exported NFS services mounted on FRAM will unfortunately NOT be available either.
The maintenance is set for Thursday 07.04.22 from 09:00-11:00 AM
We are sorry for any inconveniences that may occur. Opslog is updated as soon as the system is back in production.
UPDATE 07-04-2022 – 11:25 … we are still working on the issue and starting to bring the file system up, we hope to back in production soon
UPDATE 07-04-2022 – 12:25 … we are struggling and fighting with the file system, doing our best, we are very sorry for the troubles the issue is causing you
UPDATE 07-04-2022 – 15:35 … the file system is back up and running
[Update, 2022-02-24 22:30]: The maintenance is over and Fram is in production again. Thank you for your patience!
[Update, 2022-02-24 20:30]: The maintenance is taking a little longer than planned. We plan to get back into production at 22:00.
[Update, 2022-02-23 12:00]: The maintenance stop has now begun.
Fram supercomputer will be unavailable due to maintenance on the cooling system from February 23rd 12:00 until 24th 20:00
If time allows it we will also upgrade whole or parts/components of the storage system, including file system clients (compute nodes)