Pawsey Scheduled Maintenance (October)
Completed
Garrawarla and Setonix have both passed reframe testing. Reservations have been removed and both systems have been returned to service.
Please note /scratch is very full, please be courteous of other researchers and remove any unused data.
Posted Oct 09, 2024 - 17:00 AWST
Verifying
HPE have handed Setonix back to Pawsey.
Garrawarla and Setonix Login nodes are being powered back on and verified.
Reframe will be run on both systems before returning to service.
Posted Oct 09, 2024 - 15:07 AWST
Update
Maintenance on Banksia is complete and has been returned to service.
Core services have been patched.
Tomorrow, the Setonix login, data mover and visualisation nodes as well as Garrawarla login nodes will be shutdown to allow the IOR test to be conducted. Once the IOR tests are complete, the Setonix login, data mover and visualisation nodes as well as Garrawarla login and GPU nodes will be returned to service.
Posted Oct 08, 2024 - 16:02 AWST
Update
Scheduled maintenance is still in progress. We will provide updates as necessary.
Posted Oct 08, 2024 - 15:19 AWST
Update
Scheduled maintenance is still in progress. We will provide updates as necessary.
Posted Oct 08, 2024 - 08:27 AWST
In progress
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Posted Oct 08, 2024 - 05:00 AWST
Update
Starting 8 AM (AWST) on the 9th of October 2024, the Setonix login, data mover and visualisation nodes as well as Garrawarla login nodes will be shutdown to allow the IOR test to be conducted. Once the IOR tests are complete, the Setonix login, data mover and visualisation nodes as well as Garrawarla login and GPU nodes will be returned to service.
This was originally scheduled for the 8th of October 2024 but has been pushed back one day to support the CARTA workshop. Garrawarla will be operational through the 8th of October 2024.
Posted Oct 07, 2024 - 10:04 AWST
Update
We will be undergoing scheduled maintenance during this time.
Posted Oct 07, 2024 - 10:03 AWST
Scheduled
To support the Radio Astronomy School, our regular first-Tuesday-of-the-month maintenance will occur on the second-Tuesday-of-the-month in October.
Commencing on the 8th of October 2024 at 5 AM (AWST), HPE will commence a number of benchmarks on Setonix including HPL on CPU and GPU partitions, IOR on the scratch filesystem and OSU micro benchmarks. Starting 8 AM (AWST) Setonix login, data mover and visualisation nodes as well as Garrawarla login nodes will be shutdown to allow the IOR test to be conducted. Once the IOR tests are complete, the Setonix login, data mover and visualisation nodes as well as Garrawarla login and GPU nodes will be returned to service.
Due to the nature of the HPL benchmark, HPE require exclusive access to the CPU and GPU partitions on Setonix for up to two days. As such, Pawsey will have to wait until Thursday, 10th September at 5 AM (AWST) for Setonix compute nodes to be handed back. Pawsey will attempt to return Setonix to full service as quickly as possible after this.
Maintenance will be carried out on all Pawsey systems on Tuesday the 8th of October to apply required patches and updates to improve the systems stability, security, and performance. This maintenance window will also be used to undertake other tasks which require down-time to achieve.
Planned work for this window includes:
• Upgrade of ScoutAM software and firmware of DDN hardware of Banksia
• Patching of core Pawsey services
Further updates will be provided on status.pawsey.org.au, and any questions should be directed to help@pawsey.org.au.
Posted Sep 27, 2024 - 09:31 AWST
This scheduled maintenance affected: ASKAP (ASKAP ingest nodes, ASKAP service nodes), Central Services (Authentication and Authorization, License Server, Application Portal, Origin), Garrawarla (Garrawarla workq partition, Garrawarla gpuq partition, Garrawarla asvoq partition, Garrawarla copyq partition, Garrawarla login node), Lustre filesystems (/scratch filesystem (new)), Setonix (Login nodes, Data-mover nodes, Slurm scheduler, Setonix work partition, Setonix debug partition, Setonix long partition, Setonix copy partition, Setonix askaprt partition, Setonix highmem partition, Setonix gpu partition, Setonix gpu high mem partition, Setonix gpu debug partition), Visualisation Services (Remote Vis, Vis scheduler, Setonix vis nodes, Nebula vis nodes, Reservation, CARTA - Stable, CARTA - Test, Pawsey Remote VR), and Storage Systems (Banksia).