Completed -
All Pawsey services have been returned to service. Please note that next maintenance is currently scheduled for the *last* Tuesday in June due to HPE resourcing issues. We will provide further updates in the near future.
Work completed:
• HPE have installed RAID cards in the SU Leader nodes in Setonix.
• The NetApp providing the /home filesystem has had an OnTap upgrade.
• Banksia has had new batteries installed in the storage controllers.
• Temporary bridge interfaces on Acacia MWA hosts have been removed.
• ASKAP Buffer has had disk firmware updates applied.
• Operating System updates to the SLURM database daemon and SLURM controller for ASKAP Ingest have been applied.
• Visualisation services have been patched.
• Core Pawsey services have been patched.
Thank you to all Pawsey and HPE staff involved.
As always, be kind, and e-mail our friendly help desk staff (help@pawsey.org.au) if you encounter any issues.
May 7, 10:22 AWST
Verifying -
HPE handed Setonix to Pawsey at 4 AM this morning.
Pawsey have booted Setonix into as testing state and are currently running reframe.
May 7, 08:46 AWST
Update -
Apparently HPE have not "resolved the issue" and refuse to tell Pawsey what the issue is.
May 6, 21:31 AWST
Update -
HPE have "resolved the issue" however will require at least 4 hours before they can return Setonix to Pawsey.
At this stage, Pawsey estimate that they won't be able to return Setonix to researchers until tomorrow.
May 6, 18:00 AWST
Update -
We (Pawsey) are still waiting for HPE to hand Setonix back to Pawsey. We have no ETA. We wait.
May 6, 16:39 AWST
Update -
Core services have been patched.
ASKAP Ingest has been handed back to ASKAP.
HPE are still struggling with the SU Leader nodes. We have no ETA on when Setonix will be handed back to Pawsey.
May 6, 14:07 AWST
Update -
Banksia up and staging has resumed.
May 6, 10:16 AWST
In progress -
Scheduled maintenance is currently in progress. We will provide updates as necessary.
May 6, 08:00 AWST
Scheduled -
Maintenance will be carried out on Pawsey systems on Tuesday the 6th May to apply required patches and updates to improve the systems stability, security, and performance. This maintenance window will also be used to undertake other tasks which require down-time to achieve.
Planned work for this window includes:
• HPE will be installing RAID cards in the SU Leader nodes in Setonix. This will allow HPE to provide operations staff with advanced monitoring as part of their HPE Cray EX platform.
• The NetApp providing the /home filesystem will have an OnTap upgrade.
• Banksia will have new batteries installed in the storage controllers.
• Operating system upgrades for Acacia.
• Remove temporary additional bridge interfaces on Acacia MWA hosts.
• ASKAP Buffer will be having disk firmware updates.
• Operating System updates to the SLURM database daemon and SLURM controller for ASKAP Ingest.
• Patching of visualisation services will be undertaken.
• Patching of core Pawsey services will be undertaken.
We expect to be able to bring all services back by the end of the day (in the case of Setonix, sometime in the evening). If you have any questions, please contact help@pawsey.org.au.
Apr 29, 12:46 AWST