Get webhook notifications whenever Pawsey Supercomputing Research Centre creates an incident, updates an incident, resolves an incident or changes a component status.
Update - Currently, Data Portal and pshell users may be experiencing unusually long wait times downloading files from banksia. This will sometimes end in errors (eg timeout or content not available) however the banksia scheduler will still eventually bring the files back online and you will be able to download when trying again a day or so after the initial attempt. We are currently investigating this with the vendor as a potential scheduler issue.
Jan 23, 2025 - 14:47 AWST
Update - We have resolved most of the instability between Mediaflux and the tape storage system. Some minor issues remain which we are continuing to monitor and work on.
Dec 18, 2024 - 13:39 AWST
Update - Work continues with two Vendors to get this resolved. We will be making and testing some recommended steps today to see if this can be completely resolved.
Dec 13, 2024 - 07:57 AWST
Update - A setting was adjusted on the Mediaflux server and this has improved success rate for obtaining files however some issues still remain which we are still investigating with the vendor.
Dec 12, 2024 - 08:02 AWST
Investigating - We are aware of an issue that may be affecting some users attempting file transfers with Mediaflux (data portal and pshell.) It is currently being investigated.
Dec 11, 2024 - 11:44 AWST
Resolved -
All OSTs in scratch are operational and we will continue to monitor the filesystem over the weekend.
The issue may have been caused by the flash pool becoming critically full.
Please remember that the scratch filesystem is a shared resource for the temporary storage of results of simulations and data processing.
Please be mindful of other researchers, and do not store unnecessary data.
Apr 17, 15:40 AWST
Monitoring -
The problematic OSTs have been checked and /scratch is fully operational.
Apr 17, 14:04 AWST
Update -
HPE have reported two of the OSTs have "journal errors" are are performing a check.
Apr 17, 11:14 AWST
Update -
Two OSSes have failed.
Apr 17, 11:00 AWST
Investigating -
There is performance degradation in relation to the "/scratch" filesystem * This is related to SSD storage OST pools being close to full capacity
Apr 17, 10:35 AWST
Completed -
This maintenance completed without issue. The system is available for use again.
Apr 11, 11:42 AWST
In progress -
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 11, 11:00 AWST
Update -
We will be undergoing scheduled maintenance during this time.
Apr 11, 08:06 AWST
Scheduled -
We need to take Banksia offline for an hour today to downgrade the Versity software version due to a new bug. This will affect the scheduler and archive and the S3 gateways.
Apr 11, 07:50 AWST
Completed -
The scheduled maintenance has been completed. If you encounter any problems please let us know by emailing help@pawsey.org.au
Apr 8, 15:30 AWST
Verifying -
Verification is currently underway for the maintenance items.
Apr 8, 13:57 AWST
In progress -
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Apr 7, 15:00 AWST
Update -
Maintenance will be carried out on Setonix starting at 3 PM, Monday April 7th 2025. This is to support HPE engineers who will be performing the Slingshot fabric manager upgrade, who are in a different time zone to Perth. Setonix is scheduled to be handed back to Pawsey early Tuesday morning (April 8th 2025)
Maintenance will be carried out on all other Pawsey systems on Tuesday the 8th April to apply required patches and updates to improve the systems stability, security, and performance. This maintenance window will also be used to undertake other tasks which require down-time to achieve.
Planned work for this window includes: * Banksia ScoutAM update * Installation of Julia in the new 2025.03 stack * Installation of new version of giant-squid in the new 2025.03 stack * Rocky upgrade for license sever * Rocky upgrade for MariaDB server * Patching visualisation services * Update of CARTA
We expect to be able to bring all services back by the end of the day. If you have any questions, please contact help@pawsey.org.au.
Apr 1, 15:19 AWST
Scheduled -
April Maintenance has been pushed back a week to support the staged upgrade of Setonix to the next "Extended Support Release". The first step is to upgrade the Slingshot fabric manager to the latest supported release which will provide HPE advanced monitoring capabilities and the ability to replace faulty Slingshot switches while the fabric is in production. The version of Slingshot Host Software running on Setonix nodes will not be upgraded at this stage, but will be upgraded as part of the Cray Operating System upgrade scheduled for later in the year.
As HPE engineers who will be performing the upgrade are in a different time zone to Perth, maintenance is currently scheduled to start at 5 PM, 7 April 2025. Pawsey is currently working with HPE to lock in timings and minimise the amount of downtime for Setonix.
To minimise impact to researchers, all other Pawsey maintenance will be conducted on Tuesday April 8th 2025. Further details will be provided next week.
If you have any questions, please reach out to help@pawsey.org.au.
Mar 25, 09:15 AWST