Pawsey Supercomputing Research Centre
Banksia – one of two tape copies unavailable for maintenance (at risk)
Update - We are still working with our Tape Library company to find the root fault of the current issue. We hope to have this concluded by tomorrow.
Jun 11, 2026 - 13:44 AWST
Update - We are still working with our Tape Library company to find the root fault of the current issue.
Jun 09, 2026 - 09:22 AWST
Investigating - The Banksia service is currently in a degraded, “at risk” state as it is operating with only one tape library instead of the standard two. As a result, the alternate copy of files on tape will be unavailable for staging or archiving until Library 1 is restored to service. The secondary copy is still available for all data so this should not impact the Banksia offline files service. If you experience any issues accessing data please let us know at help@pawsey.org.au
Jun 08, 2026 - 08:32 AWST
Setonix Operational
Login nodes Operational
Data-mover nodes Operational
Slurm scheduler Operational
Setonix work partition Operational
Setonix debug partition Operational
Setonix long partition Operational
Setonix copy partition Operational
Setonix askaprt partition Operational
Setonix highmem partition Operational
Setonix gpu partition Operational
Setonix gpu high mem partition Operational
Setonix gpu debug partition Operational
Lustre filesystems Operational
/scratch filesystem Operational
/software filesystem Operational
/askapbuffer filesystem Operational
/askapingest filesystem Operational
Storage Systems Operational
Acacia Ingest Operational
Acacia MWA Operational
Acacia Projects Operational
Banksia Operational
Data Portal Systems Operational
MWA ASVO Operational
ASKAP Operational
ASKAP ingest nodes Operational
ASKAP service nodes Operational
Central Services Operational
Authentication and Authorization Operational
Service Desk Operational
License Server Operational
Application Portal Operational
Origin Operational
/home filesystem Operational
/pawsey filesystem Operational
Central Slurm Database Operational
Documentation Operational
Visualisation Services Operational
Remote Vis Operational
Vis scheduler Operational
Setonix vis nodes Operational
Nebula vis nodes Operational
Visualisation Lab Operational
Reservation Operational
CARTA - Stable Operational
CARTA - Test Operational
Pawsey Remote VR Operational
The Australian Biocommons Operational
Fgenesh++ Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance

Scheduled Maintenance

AARNet Maintenance Jun 17, 2026 22:00 - Jun 18, 2026 06:00 AWST

AARNet have advised that they will be performing works that may impact Pawsey's primary internet connection. There may be one or more brief interruptions to access to Pawsey during this time as we switch to alternative paths. Internal connectivity between Pawsey resources will not be impacted. Jobs on our HPC systems will continue to be scheduled and launched but may experience intermittent issues communicating with off-site licence servers during this window.
Posted on Jun 09, 2026 - 09:40 AWST

Acacia Ingest Ceph upgrades Jul 14, 2026 09:00-11:00 AWST

We plan to upgrade the RADOS Gateway (RGW) component of the Acacia Ingest Ceph cluster to Squid 19.2. The service is expected to remain operational and available, but during this period it will be considered at risk. All affected research groups have been contacted and are aware of the work.

If you encounter any unexpected problems, please contact help@pawsey.org.au
Posted on Jun 11, 2026 - 15:43 AWST
System Metrics Month Week Day
Allocated Cores (Setonix)
Fetching
Allocated Nodes (Setonix work partition)
Fetching
Allocated nodes (Setonix askaprt partition) ?
Fetching
Jun 12, 2026

No incidents reported today.

Jun 11, 2026

Unresolved incident: Banksia – one of two tape copies unavailable for maintenance (at risk).

Jun 10, 2026

No incidents reported.

Jun 9, 2026
Acacia MWA Ceph upgrades
Completed - The upgrade was completed without any observed service interruption.
Jun 9, 11:36 AWST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 9, 09:00 AWST
Scheduled - We plan to upgrade the RADOS Gateway (RGW) component of the Acacia MWA Ceph cluster to Squid 19.2.3 in line with the recent upgrades of the rest of the cluster. During this period the S3 endpoint may become unavailable for a few minutes at a time. MWA have been contacted and are aware of the work.

If you encounter any unexpected problems, please contact help@pawsey.org.au
Jun 4, 09:56 AWST
Jun 8, 2026
Jun 7, 2026

No incidents reported.

Jun 6, 2026

No incidents reported.

Jun 5, 2026
Name resolution issues on Setonix
Resolved - This incident has been resolved.
Jun 5, 08:08 AWST
Monitoring - The reservation on the system has been lifted. We (Pawsey) will monitor the system overnight.
Jun 3, 18:40 AWST
Update - The onsite HPE team (together with the L3 guys) are happy that Setonix is now fully back up and stable. HPE will continue to monitor and check later this evening and tomorrow morning.
Jun 3, 17:31 AWST
Update - HPE is still working on getting the 6 x leader nodes and the /gluster filesystem synced and healthy.

HPE L3 are assisting local Engineers to resolve the problem.

Once resolved HPE will be rebooting all the compute/GPU nodes to production ready.
Jun 3, 15:31 AWST
Update - HPE have provided no further updates.
Jun 3, 15:13 AWST
Identified - HPE were able to get the leaders back up. HPE are going to reboot the leaders to make sure they have no extra problems
Jun 3, 14:17 AWST
Update - A critical issue has been raised with the vendor. We are waiting for a response.
Jun 3, 13:04 AWST
Investigating - Because of the work performed by HPE yesterday, there appears to be name resolution issue on Setonix.

Pawsey staff are attempting a work around.
Jun 3, 12:44 AWST
Jun 4, 2026

No incidents reported.

Jun 3, 2026
Jun 2, 2026
Pawsey Scheduled Maintenance (June)
Completed - Maintenance has been complete. All services have been returned to service.

Please note that for security and support reasons, Setonix will likely be upgraded to SUSE Linux Enterprise Server 15 SP7 next month. The scientific software stack and default Cray Programming Environment will remain the same, however the AMD GPU driver will need to be upgraded to support SLES 15 SP7.

If you have any questions or queries, please reach out to the Helpful Desk (help@pawsey.org.au)
Jun 2, 18:33 AWST
Update - Banksia, the tape libraries, Mediaflux services and ASKAP ingest have been returned the service. Acacia and Setonix scheduled maintenance is ongoing.
Jun 2, 16:09 AWST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 1, 17:00 AWST
Scheduled - Please read the following carefully. It has important information about maintenance commencing 1st June. This maintenance period will be longer than usual for Setonix and ASKAP Ingest.

HPE will be upgrading the software and firmware of the infrastructure that provides the scratch filesystem on Setonix. They have successfully performed this on the Lustre filesystem attached to the test and development system, as well as the old software filesystem. Unfortunately due to the size of the scratch filesystem, they will unable to perform the scratch filesystem upgrades in the usual eight hour maintenance window.

Additionally, Pawsey will be archiving all accounting data for Setonix and ASKAP ingest before 2025.

To facilitate the Scratch filesystem upgrade and the archiving of accounting data, maintenance for Setonix and ASKAP Ingest will commence at 5 PM on the 1st June 2026, which is a public holiday in Western Australia. This will allow HPE to perform the software upgrade Monday evening, and the firmware update the following day and for the archiving to run overnight.

At this stage Pawsey is expecting HPE to hand Setonix back to Pawsey early Wednesday morning (3rd June 2026).

Maintenance on all other Pawsey systems will be carried out on Tuesday the 2nd June to apply required patches and updates to improve the systems stability, security, and performance. This maintenance window will also be used to undertake other tasks which require down-time to achieve.

Planned work for this window includes:
• Network switches will have their firmware upgraded to a supported release which includes the switch used by core services. The will be potentially an interruption to ALL Pawsey services when this switch is upgraded between 8 AM and 10 AM.
• Setonix will have the final bug and security fixes applied from openSUSE Leap 15.6
• Pshell v1.2.1 will be installed on Setonix
• Gromacs 2026.1 GPU version will be installed on Setonix
• New version of Pawsey's Data Portal will be deployed
• Patching of visualisation services will be undertaken
• Mediaflux server will have the latest bug and security fixes from Rocky Linux
• Mediaflux will be upgraded
• Acacia MWA cluster upgrade to Ceph 19
• Adjustments to the Acacia Ingest control plane
• Acacia compliance runs
• Banksia's tape libraries will have a firmware update
• Banksia's fibre channel switches will have a firmware update
• Banksia's servers will have the latest bug and security fixes from Rocky Linux
• Patching of core Pawsey services will be undertaken

Please note that for security and support reasons, Setonix will likely be upgraded to SUSE Linux Enterprise Server 15 SP7 next month. The scientific software stack and default Cray Programming Environment will remain the same, however the AMD GPU driver will need to be upgraded to support SLES 15 SP7.

If you have any questions, please contact help@pawsey.org.au.
May 26, 09:41 AWST
Jun 1, 2026
May 31, 2026

No incidents reported.

May 30, 2026

No incidents reported.

May 29, 2026

No incidents reported.

← Incident History Powered by Atlassian Statuspage