High Performance Computing Systems
Warhawk
Node Configuration
Warhawk is an HPE Cray EX system located at the AFRL DSRC. It has 1,024 standard compute nodes, 4 large-memory nodes, 24 1-GPU visualization nodes, and 40 2-GPU Machine-Learning nodes (a total of 1,092 compute nodes or 139,776 compute cores). It has 564 TB of memory and is rated at 6.86 peak PFLOPS.
Login | Standard | Large-Memory | Visualization | Machine-Learning Accelerated | |
---|---|---|---|---|---|
Total Nodes | 7 | 1,024 | 4 | 24 | 40 |
Processor | AMD 7H12 Rome | AMD 7H12 Rome | AMD 7H12 Rome | AMD 7H12 Rome | AMD 7H12 Rome |
Processor Speed | 2.6 GHz | 2.6 GHz | 2.6 GHz | 2.6 GHz | 2.6 GHz |
Sockets / Node | 2 | 2 | 2 | 2 | 2 |
Cores / Node | 128 | 128 | 128 | 128 | 128 |
Total CPU Cores | 896 | 131,072 | 512 | 3,072 | 5,120 |
Usable Memory / Node | 995 GB | 503 GB | 995 GB | 503 GB | 503 GB |
Accelerators / Node | None | None | None | 1 | 2 |
Accelerator | n/a | n/a | n/a | NVIDIA V100 PCIe 3 | NVIDIA V100 PCIe 3 |
Memory / Accelerator | n/a | n/a | n/a | 32 GB | 32 GB |
Storage on Node | None | None | None | None | None |
Interconnect | Cray Slingshot | Cray Slingshot | Cray Slingshot | Cray Slingshot | Cray Slingshot |
Operating System | SLES | SLES | SLES | SLES | SLES |
Path | Formatted Capacity | File System Type | Storage Type | User Quota | Minimum File Retention |
---|---|---|---|---|---|
/p/home ($HOME) | 1.3 PB | Lustre | HDD | 110 GB | None |
/p/work1 ($WORKDIR) | 16.5 PB | Lustre | Hybrid SSD/HDD | None | 30 Days |
/p/work2 | 4.9 PB | Lustre | Hybrid SSD/HDD | None | 30 Days |
/p/cwfs ($CENTER) | 3.3 PB | GPFS | HDD | 100 TB | 120 Days |
/p/work1/projects ($PROJECTS_HOME) | 336 TB | Lustre | HDD | None | None |
Mustang
Node Configuration
Mustang is an HPE SGI 8600 system located at the AFRL DSRC. It has 1,128 standard compute nodes, 24 large-memory compute nodes, and 24 GPU compute nodes (a total of 1,176 compute nodes or 56,448 compute cores). It has 244 TB of memory and is rated at 4.88 peak PFLOPS.
Login | Standard | Large-Memory | GPU | |
---|---|---|---|---|
Total Nodes | 12 | 1,128 | 24 | 24 |
Processor | Intel 8168 Skylake | Intel 8168 Skylake | Intel 8168 Skylake | Intel 8168 Skylake |
Processor Speed | 2.7 GHz | 2.7 GHz | 2.7 GHz | 2.7 GHz |
Sockets / Node | 2 | 2 | 2 | 2 |
Cores / Node | 48 | 48 | 48 | 48 |
Total CPU Cores | 576 | 54,144 | 1,152 | 1,152 |
Usable Memory / Node | 380 GB | 180 GB | 744 GB | 372 GB |
Accelerators / Node | None | None | None | 1 |
Accelerator | n/a | n/a | n/a | NVIDIA P100 PCIe 3 |
Memory / Accelerator | n/a | n/a | n/a | 16 GB |
Storage on Node | None | None | None | None |
Interconnect | Intel Omni-Path | Intel Omni-Path | Intel Omni-Path | Intel Omni-Path |
Operating System | RHEL | RHEL | RHEL | RHEL |
Path | Formatted Capacity | File System Type | Storage Type | User Quota | Minimum File Retention |
---|---|---|---|---|---|
/p/home ($HOME) | 691 TB | Lustre | HDD | 100 GB | None |
/p/work1 ($WORKDIR) | 8.4 PB | Lustre | HDD | None | 21 Days |
/p/cwfs ($CENTER) | 3.3 PB | GPFS | HDD | 100 TB | 120 Days |
/p/work1/projects ($PROJECTS_HOME) | 8.4 PB | Lustre | HDD | None | None |
Raider
Node Configuration
Raider is a Penguin Computing TrueHPC system located at the AFRL DSRC. It has 1,480 standard compute nodes, 8 large-memory nodes, and 24 Visualization nodes, 32 MLA nodes, and 64 High Clock nodes (a total of 199,680 compute cores). It has 447 TB of memory and is rated at 9 peak PFLOPS.
Login | Login-viz | Standard | Large-Memory | Visualization | MLA | High Clock | Transfer | |
---|---|---|---|---|---|---|---|---|
Total Nodes | 6 | 4 | 1,480 | 8 | 24 | 32 | 64 | 2 |
Processor | AMD 7713 Milan | AMD 7713 Milan | AMD 7713 Milan | AMD 7713 Milan | AMD 7713 Milan | AMD 7713 Milan | AMD 73F3 Milan | AMD 7713 Milan |
Processor Speed | 2.0 GHz | 2.0 GHz | 2.0 GHz | 2.0 GHz | 2.0 GHz | 2.0 GHz | 3.4 GHz | 2.0 GHz |
Sockets / Node | 2 | 2 | 2 | 2 | 2 | 2 | 2 | 2 |
Cores / Node | 128 | 128 | 128 | 128 | 128 | 128 | 32 | 128 |
Total CPU Cores | 768 | 512 | 189,440 | 1,024 | 3,072 | 4,096 | 2,048 | 256 |
Usable Memory / Node | 503 GB | 503 GB | 251 GB | 2.0 TB | 503 GB | 503 GB | 503 GB | 503 GB |
Accelerators / Node | 1 | 1 | None | None | 1 | 4 | None | None |
Accelerator | NVIDIA A40 PCIe 4 | NVIDIA A100 SXM 4 | n/a | n/a | NVIDIA A40 PCIe 4 | NVIDIA A100 SXM 4 | n/a | n/a |
Memory / Accelerator | 45 GB | 40 GB | n/a | n/a | 45 GB | 40 GB | n/a | n/a |
Storage on Node | 960 GB NVMe SSD | 960 GB NVMe SSD | 1.91 TB NVMe SSD | 7.68 TB NVMe SSD | None | 3.84 TB NVMe SSD | None | None |
Interconnect | HDR InfiniBand | HDR InfiniBand | HDR InfiniBand | HDR InfiniBand | HDR InfiniBand | HDR InfiniBand | HDR InfiniBand | HDR InfiniBand |
Operating System | RHEL | RHEL | RHEL | RHEL | RHEL | RHEL | RHEL | RHEL |
Path | Formatted Capacity | File System Type | Storage Type | User Quota | Minimum File Retention |
---|---|---|---|---|---|
/p/home ($HOME) | 1.3 PB | Lustre | HDD | 30 GB | None |
/p/work1 ($WORKDIR) | 18 PB | Lustre | Hybrid SSD/HDD | None | 30 Days |
/p/work2 ($WORKDIR2) | 820 TB | Lustre | Hybrid SSD/HDD | None | 30 Days |
/p/cwfs ($CENTER) | 3.3 PB | GPFS | HDD | 100 TB | 120 Days |
/p/app ($PROJECTS_HOME) | 689 TB | Lustre | NVMe SSD | None | None |