Known issue with an Unresolved Resolution state is an active problem under investigation; a temporary workaround may be available.
A known issue with a Resolved (workaround) Resolution state is an ongoing problem; a permanent workaround is available which may include using different software or hardware.
A known issue with Resolved Resolution state has been corrected.
| Title | Category | Resolution | Description | Posted | Updated |
|---|---|---|---|---|---|
| Multi-node job hang with ORCA 5 | Owens, Pitzer, Software |
Resolved (workaround) |
You may experience a multi-node job hang if the job runs into a module that requires heavy I/O, e.g., MP2 or CCSD. Additionally, it potentially leads to our GPFS performance issue. We have... Read more |
7 months 3 weeks ago | 7 months 3 weeks ago |
| Slurm to be Upgraded to Version 23.11.4 | Owens, Pitzer |
Resolved |
Updates on 04/08/2024: The rolling reboots are completed. Updates: We will perform rolling reboots on this... Read more |
9 months 1 week ago | 7 months 4 weeks ago |
| Slurm on Pitzer is offline |
Resolved |
The Slurm scheduler for Pitzer is currently offline. We are working with the vendor for the fix. Sorry for the inconvenience. |
9 months 1 week ago | 9 months 1 week ago | |
| Slurm database repair on 01/25/2024 | Outage |
Resolved |
We have scheduled a Slurm database repair, which is planned to start at 8:30 am US/Eastern on Thursday, January 25, 2024. During the repair, Slurm database will be offline; running jobs and... Read more |
10 months 2 weeks ago | 10 months 1 week ago |
| PyTorch jobs timeout and hanging | GPU |
Resolved |
We have observed that many PyTorch users frequently encounter random timeouts, which result in the termination of their jobs but leave the process running on the node.... Read more |
1 year 4 months ago | 11 months 1 day ago |
| Rolling reboot of Ascend, Owens and Pitzer starting from Oct 25 2023 | Owens, Pitzer |
Resolved |
Update on Nov 8 2023: Rolling reboots of all clusters are completed. Update on Nov 3 2023: Rolling reboots of Ascend and Pitzer clusters... Read more |
1 year 1 month ago | 1 year 3 weeks ago |
| Running jobs requeued on all clusters | Owens, Pitzer |
Resolved |
The Slurm upgrades during rolling reboots of Ascend, Owens and Pitzer we performed today (Oct 25 2023) cause all running jobs on the systems requeued around 8:45am. You will not be billed for the... Read more |
1 year 1 month ago | 1 year 1 month ago |
| Emergency UPS Maintenance | Maintenance |
Resolved |
A UPS in the data center requires some emergency maintenance to be undertaken at 2PM on Oct 11 2023. There is a very small chance that parts of Owens and of the C18 Pitzer nodes may lose power as... Read more |
1 year 1 month ago | 1 year 1 month ago |
| MOE license server down | Licensing |
Resolved |
The MOE license server is experiencing an unknown issue and potentially down. We are working to resolve the issue. |
1 year 2 months ago | 1 year 2 months ago |
| Outbound Emails from MyOSC are Blocked at MS 365 Servers | Account Management, client portal |
Resolved |
Outbound emails, including account verification emails, from MyOSC to institutional email addresses utilizing MS 365 are being blocked as phishing attempts at the institution's server. ... Read more |
1 year 3 months ago | 1 year 2 months ago |
