Dear NIRD users. We need to conduct some small maintenance along with DDN(vendor) on a small part of NIRD-TRD today at around 11:00.
According to the vendor this operation should not affect the availability of the system.
Update: After a meeting with the vendor we have to postpone this until next week.
We need to power cycle a small part of NIRD-TRD storage tomorrow 27.09.22
This will be done in production and according to DDN(hw manufactor) This should not affect your work. Regardless we want to tell you that we need to conduct some work on NIRD-TRD and if you experience any issues or problems please let us know.
Best Regards
Infrastructure team.
Unfortunately, the cooling issues persist. We are investigating and contacting service personnel to check the main cooling distribution units (CDU).
Sorry for the inconvenience this is causing.
Update from 21.06 13:30: Cooling issues resolved, FRAM is open for users.
-Infra Team
Some users are experiencing slow filesystem issues on fram.
We are currently trying to resolve the issue, but it is a periodical problem that makes debugging difficult.
Sorry for the inconvenience this is causing.
Best Regards
Infra team
Dear Fram users. Unfortunately, there has been a short power outage in Tromsø causing a shutdown of compute nodes on Fram. We are working on bringing them back to production as soon as possible.
Sorry for the inconvenience this has caused.
[2022-05-03 – 10:45] – Fram is back in production.
[2022-05-04 – 13:20] – As a result of the power outage we have some problems with FRAM file system. Slowness/lagging. We are currently working on fixing this and are sorry for the inconvenience this is causing.
[2022-05-06 – 13:25] Fram filesystem is still priodically slow for some users. We assure you that we are continuously working to resolve this issue, but it is hard to debug due to the inconcistancy of the problem.
Best regards
Infra team
We need to replace an IO module and HDD in Fram storage today.
This should not affect your work and the system will be running as usual during the procedure. If you get any file system issues during this service please send us a support request.
Best Regards
Infrastructure Team
We need to conduct some work on the filesystem controllers for NIRD – TOS. Unfortunately this results in a short unavailability (downtime) period.
All services connected to- and/or utilizing TOS (Tromsø) part of NIRD will be affected. Exported NFS services mounted on FRAM will unfortunately NOT be available either.
The maintenance is set for Thursday 07.04.22 from 09:00-11:00 AM
We are sorry for any inconveniences that may occur. Opslog is updated as soon as the system is back in production.
UPDATE 07-04-2022 – 11:25 … we are still working on the issue and starting to bring the file system up, we hope to back in production soon
UPDATE 07-04-2022 – 12:25 … we are struggling and fighting with the file system, doing our best, we are very sorry for the troubles the issue is causing you
UPDATE 07-04-2022 – 15:35 … the file system is back up and running
Dear NIRD users,
we will have to do some minor maintenance on the file system controllers in Tromsø today.
We don’t expect any major outage but a slight file system performance issue might occur.
Thanks for your understanding