Pawsey Supercomputing Research Centre Status

Monitoring - The reservation on the system has been lifted. We (Pawsey) will monitor the system overnight.
Jun 03, 2026 - 18:40 AWST

Update - The onsite HPE team (together with the L3 guys) are happy that Setonix is now fully back up and stable. HPE will continue to monitor and check later this evening and tomorrow morning.
Jun 03, 2026 - 17:31 AWST

Update - HPE is still working on getting the 6 x leader nodes and the /gluster filesystem synced and healthy.

HPE L3 are assisting local Engineers to resolve the problem.

Once resolved HPE will be rebooting all the compute/GPU nodes to production ready.

Thanks HPE.
Jun 03, 2026 - 15:31 AWST

Update - HPE have provided no further updates.
Jun 03, 2026 - 15:13 AWST

Identified - HPE were able to get the leaders back up. HPE are going to reboot the leaders to make sure they have no extra problems

ER's primary focus right now is assisting the site team to bring production back online, and will provide a post-mortem after this.
Jun 03, 2026 - 14:17 AWST

Update - A critical issue has been raised with the vendor. We are waiting for a response.
Jun 03, 2026 - 13:04 AWST

Investigating - Because of the work performed by HPE yesterday, there appears to be name resolution issue on Setonix.

Pawsey staff are attempting a work around.
Jun 03, 2026 - 12:44 AWST

Setonix Operational

Data-mover nodes Operational

Slurm scheduler Operational

Setonix work partition Operational

Setonix debug partition Operational

Setonix long partition Operational

Setonix copy partition Operational

Setonix askaprt partition Operational

Setonix highmem partition Operational

Setonix gpu partition Operational

Setonix gpu high mem partition Operational

Setonix gpu debug partition Operational

Lustre filesystems Operational

/scratch filesystem Operational

/software filesystem Operational

/askapbuffer filesystem Operational

/askapingest filesystem Operational

Storage Systems Operational

Acacia Ingest Operational

Acacia MWA Operational

Acacia Projects Operational

Banksia Operational

Data Portal Systems Operational

MWA ASVO Operational

ASKAP Operational

ASKAP ingest nodes Operational

ASKAP service nodes Operational

Central Services Operational

Authentication and Authorization Operational

Service Desk Operational

License Server Operational

Application Portal Operational

Origin Operational

/home filesystem Operational

/pawsey filesystem Operational

Central Slurm Database Operational

Documentation Operational

Visualisation Services Operational

Remote Vis Operational

Vis scheduler Operational

Setonix vis nodes Operational

Nebula vis nodes Operational

Visualisation Lab Operational

Reservation Operational

CARTA - Stable Operational

CARTA - Test Operational

Pawsey Remote VR Operational

The Australian Biocommons Operational

Fgenesh++ Operational

Operational

Degraded Performance

Partial Outage

Major Outage

Maintenance

System Metrics Month Week Day

Allocated Cores (Setonix)

Fetching

Allocated Nodes (Setonix work partition)

Fetching

Allocated nodes (Setonix askaprt partition)

Fetching

Past Incidents

Jun 4, 2026

No incidents reported today.

Jun 3, 2026

Unresolved incident: Name resolution issues on Setonix.

Jun 2, 2026

Pawsey Scheduled Maintenance (June)

Completed - Maintenance has been complete. All services have been returned to service.

Please note that for security and support reasons, Setonix will likely be upgraded to SUSE Linux Enterprise Server 15 SP7 next month. The scientific software stack and default Cray Programming Environment will remain the same, however the AMD GPU driver will need to be upgraded to support SLES 15 SP7.

If you have any questions or queries, please reach out to the Helpful Desk (help@pawsey.org.au)
Jun 2, 18:33 AWST

Update - Banksia, the tape libraries, Mediaflux services and ASKAP ingest have been returned the service. Acacia and Setonix scheduled maintenance is ongoing.
Jun 2, 16:09 AWST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Jun 1, 17:00 AWST

Scheduled - Please read the following carefully. It has important information about maintenance commencing 1st June. This maintenance period will be longer than usual for Setonix and ASKAP Ingest.

HPE will be upgrading the software and firmware of the infrastructure that provides the scratch filesystem on Setonix. They have successfully performed this on the Lustre filesystem attached to the test and development system, as well as the old software filesystem. Unfortunately due to the size of the scratch filesystem, they will unable to perform the scratch filesystem upgrades in the usual eight hour maintenance window.

Additionally, Pawsey will be archiving all accounting data for Setonix and ASKAP ingest before 2025.

To facilitate the Scratch filesystem upgrade and the archiving of accounting data, maintenance for Setonix and ASKAP Ingest will commence at 5 PM on the 1st June 2026, which is a public holiday in Western Australia. This will allow HPE to perform the software upgrade Monday evening, and the firmware update the following day and for the archiving to run overnight.

At this stage Pawsey is expecting HPE to hand Setonix back to Pawsey early Wednesday morning (3rd June 2026).

Maintenance on all other Pawsey systems will be carried out on Tuesday the 2nd June to apply required patches and updates to improve the systems stability, security, and performance. This maintenance window will also be used to undertake other tasks which require down-time to achieve.

Planned work for this window includes:
• Network switches will have their firmware upgraded to a supported release which includes the switch used by core services. The will be potentially an interruption to ALL Pawsey services when this switch is upgraded between 8 AM and 10 AM.
• Setonix will have the final bug and security fixes applied from openSUSE Leap 15.6
• Pshell v1.2.1 will be installed on Setonix
• Gromacs 2026.1 GPU version will be installed on Setonix
• New version of Pawsey's Data Portal will be deployed
• Patching of visualisation services will be undertaken
• Mediaflux server will have the latest bug and security fixes from Rocky Linux
• Mediaflux will be upgraded
• Acacia MWA cluster upgrade to Ceph 19
• Adjustments to the Acacia Ingest control plane
• Acacia compliance runs
• Banksia's tape libraries will have a firmware update
• Banksia's fibre channel switches will have a firmware update
• Banksia's servers will have the latest bug and security fixes from Rocky Linux
• Patching of core Pawsey services will be undertaken

Please note that for security and support reasons, Setonix will likely be upgraded to SUSE Linux Enterprise Server 15 SP7 next month. The scientific software stack and default Cray Programming Environment will remain the same, however the AMD GPU driver will need to be upgraded to support SLES 15 SP7.

If you have any questions, please contact help@pawsey.org.au.
May 26, 09:41 AWST

Jun 1, 2026

May 31, 2026

No incidents reported.

May 30, 2026

No incidents reported.

May 29, 2026

No incidents reported.

May 28, 2026

No incidents reported.

May 27, 2026

No incidents reported.

May 26, 2026

Upstream network provider maintenance

Completed - The scheduled maintenance has been completed.
May 26, 05:00 AWST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 25, 22:00 AWST

Scheduled - Our upstream network provider is performing work on the links that provide Pawsey's primary Internet connection. There may be one or more brief interruptions to access to Pawsey during this time as we switch to alternative paths. Internal connectivity between Pawsey resources (Such as Setonix to Acacia) will not be impacted. Jobs on our HPC systems will continue to be scheduled and launched but may have deteriorated access during this window to talk to off-site licence servers.
May 13, 12:52 AWST

May 25, 2026

May 24, 2026

Banksia Spectralogic Annual Tape Library Cleans - Reduced capacity

Completed - The scheduled maintenance has been completed.
May 24, 17:21 AWST

In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 15, 18:21 AWST

Update - We will be undergoing scheduled maintenance during this time.
May 15, 18:20 AWST

Scheduled - We will be undertaking non-disrupting Banksia tape library maintenance at this time, so available tape copies will be reduced from two to one.
May 15, 18:20 AWST

May 23, 2026

No incidents reported.

May 22, 2026

No incidents reported.

May 21, 2026

No incidents reported.