Dear Betzy user: The filesystem is yet again almost full. This causes substantial performance degradation.
This is how you can help:
Please have a look on your own or your project files on Betzy and delete all files that are not strictly needed.
Dear Betzy user: The filesystem is yet again almost full. This causes substantial performance degradation.
This is how you can help:
Please have a look on your own or your project files on Betzy and delete all files that are not strictly needed.
Due to a completely full filesystem on Betzy, we have had to resort to changing the age limit on data in the work folder on Betzy. We are now deleting all data that is older than 17 days from the work folders. This problem will persist until we have the nev NIRD up in production. Hopefully we will not have to further move the limit, but be aware that data in the work folder is not backed up, and could potentially be deleted at any point. Important data should therefore be moved to either your home directory or a project folder.
Dear Betzy user. We will update firmware on some of the Betzy storage servers Wednesday (2022-12-14) morning between 08:00 and 10:00. Jobs should not be affected, but you might experience slow access to files a few minutes at a time.
We apologize for the inconvenience.
There is currently a problem with accessing files below /cluster on Saga. As a consequence Saga does not function properly.
We are working on the issue. Sorry for the inconvenience.
Update 27 September @ 13:15
The issue has been resolved and you can use Saga and /cluster normally again. We are looking for an underling problem.
There is currently a problem with accessing files below /cluster on Saga. As a consequence Saga does not function properly.
We are working on the issue. Sorry for the inconvenience.
Update 26.09 @ 9:10:
The filesystem issue is resolved and Saga is functioning properly again.
We are currently experiencing issues with the filesystem on Betzy.
The problem affects mainly /cluster/work area.
We are trying to fix this as quickly as possible.
[UPDATE: 17:00] Problem with filesystem persists. Login nodes are now offline. We have contacted the vendor.
[UPDATE: 19:30] login nodes are back online.
We are going to conduct a file system check on Fram file system. This might lead to degraded performance while the scan is ongoing.
One of the Betzy file system disk controllers has an issue that need to be rectified. This will cause lower performance on file system for a couple of hours today starting at 13:00
Some users are experiencing slow filesystem issues on fram.
We are currently trying to resolve the issue, but it is a periodical problem that makes debugging difficult.
Sorry for the inconvenience this is causing.
Best Regards
Infra team
[UPDATE, 2022-05-13 08:00] The maintenance stop is over. There may still be some file system issues. Please report via regular support channels
[UPDATE, 2022-05-11 08:00] The maintenance stop has now started.
The will be a maintenance of the storage system on the Fram supercomputer. The cluster will be unavailable from the 11th of May at 08:00 until the 12th of May at 20:00.