High Performance Computing Systems
Onyx
- Quick Start Guide
- User Guide
- PBS Guide
- Modules Guide
- Archive Guide
- Software
- Queue Summary
- System News
| Path | Capacity | Type |
|---|---|---|
| /p/home ($HOME) | 897 TBytes | Lustre |
| /p/work ($WORKDIR) | 13 PBytes | Lustre |
| Login Nodes | Compute Nodes | ||||||
|---|---|---|---|---|---|---|---|
| Standard Memory | Large Memory | KNL | GPU Accelerated | 2-MLA Accelerated | 10-MLA Accelerated | ||
| Total Cores | Nodes | 264 | 12 | 211,640 | 4,810 | 176 | 4 | 2,048 | 32 | 704 | 32 | 2,400 | 60 | 160 | 4 |
| Operating System | SLES | Cray Linux Environment | CentOS | ||||
| Cores/Node | 22 | 44 | 64 | 22 + 1 GPU (1 x 3,584 CUDA cores) |
40 + 2 GPUs (2 x 5,120 CUDA cores) |
40 + 10 GPUs (10 x 5,120 CUDA cores) |
|
| Core Type | Dual Intel E5-2699v4 Broadwell (22 cores/socket) |
Intel Phi 7230 Knights Landing |
Intel E5-2699v4 Broadwell +NVIDIA P100 |
Dual Intel 6148 Skylake (20 cores/socket) +NVIDIA V100 SXM2 |
Dual Intel 6148 Skylake (20 cores/socket) +NVIDIA V100 PCIe |
||
| Core Speed | 2.8 GHz | 1.3 GHz | 2.8 GHz | 2.4 GHz | |||
| Memory/Node | 256 GBytes | 128 GBytes | 1 TByte | 96 GBytes | 256 GBytes +16 GBytes |
192 GBytes +2 x 16 GBytes |
768 GBytes +10 x 32 GBytes |
| Accessible Memory/Node | 8 GBytes | 121 GBytes | 991 GBytes | 90 GBytes | 247 GBytes +16 GBytes |
172 GBytes +2 x 16 GBytes |
735 GBytes +10 x 32 GBytes |
| Memory Model | Shared on node. | Shared on node. Distributed across cluster. |
|||||
| Interconnect Type | Ethernet | Cray Aries | InfiniBand | ||||
Vulcanite
| Path | Capacity | Type |
|---|---|---|
| /home | 4 TBytes | SSD |
| /gpfs/cwfs | 3 PBytes | GPFS |
| Login Nodes | Accelerator Nodes | ||||
|---|---|---|---|---|---|
| 2-GPU | 4-GPU | 8-GPU | |||
| Total Nodes | 2 | 26 | 8 | 5 | |
| Operating System | RHEL 7 | ||||
| Cores/Node | 12 | 24 | 48 | ||
| Core Type | Intel Gold 6126T Skylake (12 cores) |
Intel Gold 6126T Skylake (12 cores) +NVIDIA V100 PCIe |
Dual Intel Gold 6136 Skylake (12 cores/socket) +NVIDIA V100 SXM2 |
Dual Intel Platinum 8160 Skylake (24 cores/socket) +NVIDIA V100 SXM2 |
|
| Core Speed | 2.6 GHz | 3.0 GHz | 2.1 GHz | ||
| Memory/Node | 192 GBytes DDR4-2666 |
192 GBytes DDR4-2666 +2 x 32 GBytes |
384 GBytes DDR4-2666 +4 x 32 GBytes |
768 GBytes DDR4-2666 +8 x 32 GBytes |
|
| Accessible Memory/Node | 8 GBytes | 206 GBytes +2 x 32 GBytes |
384 GBytes +4 x 32 GBytes |
764 GBytes +8 x 32 GBytes |
|
| Interconnect Type | EDR InfiniBand 1x | EDR InfiniBand 2x | EDR InfiniBand 4x | ||
| SSD local on Node | 2 TBytes NVMe | 2 TBytes NVMe | 4 TBytes NVMe | 8 TBytes NVMe | |