High Performance Computing Systems

Warhawk Warhawk
Warhawk is an HPE Cray EX system located at the AFRL DSRC. It has 1,024 standard compute nodes, 4 large-memory nodes, 24 1-GPU visualization nodes, and 40 2-GPU Machine-Learning nodes (a total of 1,092 compute nodes or 139,776 compute cores). It has 564 TB of memory and is rated at 6.86 peak PFLOPS.

Node Configuration
Login Standard Large-Memory Visualization Machine-Learning Accelerated
Total Nodes 7 1,024 4 24 40
Processor AMD 7H12 Rome AMD 7H12 Rome AMD 7H12 Rome AMD 7H12 Rome AMD 7H12 Rome
Processor Speed 2.6 GHz 2.6 GHz 2.6 GHz 2.6 GHz 2.6 GHz
Sockets / Node 2 2 2 2 2
Cores / Node 128 128 128 128 128
Total CPU Cores 896 131,072 512 3,072 5,120
Usable Memory / Node 995 GB 503 GB 995 GB 503 GB 503 GB
Accelerators / Node None None None 1 2
Accelerator n/a n/a n/a NVIDIA V100 PCIe 3 NVIDIA V100 PCIe 3
Memory / Accelerator n/a n/a n/a 32 GB 32 GB
Storage on Node None None None None None
Interconnect Cray Slingshot Cray Slingshot Cray Slingshot Cray Slingshot Cray Slingshot
Operating System SLES SLES SLES SLES SLES

File Systems on Warhawk
Path Formatted Capacity File System Type Storage Type User Quota Minimum File Retention
/p/home ($HOME) 1.3 PB Lustre HDD 110 GB None
/p/work1 ($WORKDIR) 16.5 PB Lustre Hybrid SSD/HDD None 30 Days
/p/work2 4.9 PB Lustre Hybrid SSD/HDD None 30 Days
/p/cwfs ($CENTER) 3.3 PB GPFS HDD 100 TB 120 Days
/p/work1/projects ($PROJECTS_HOME) 336 TB Lustre HDD None None

Mustang Mustang
Mustang is an HPE SGI 8600 system located at the AFRL DSRC. It has 1,128 standard compute nodes, 24 large-memory compute nodes, and 24 GPU compute nodes (a total of 1,176 compute nodes or 56,448 compute cores). It has 244 TB of memory and is rated at 4.88 peak PFLOPS.

Node Configuration
Login Standard Large-Memory GPU
Total Nodes 12 1,128 24 24
Processor Intel 8168 Skylake Intel 8168 Skylake Intel 8168 Skylake Intel 8168 Skylake
Processor Speed 2.7 GHz 2.7 GHz 2.7 GHz 2.7 GHz
Sockets / Node 2 2 2 2
Cores / Node 48 48 48 48
Total CPU Cores 576 54,144 1,152 1,152
Usable Memory / Node 380 GB 180 GB 744 GB 372 GB
Accelerators / Node None None None 1
Accelerator n/a n/a n/a NVIDIA P100 PCIe 3
Memory / Accelerator n/a n/a n/a 16 GB
Storage on Node None None None None
Interconnect Intel Omni-Path Intel Omni-Path Intel Omni-Path Intel Omni-Path
Operating System RHEL RHEL RHEL RHEL

File Systems on Mustang
Path Formatted Capacity File System Type Storage Type User Quota Minimum File Retention
/p/home ($HOME) 691 TB Lustre HDD 100 GB None
/p/work1 ($WORKDIR) 8.4 PB Lustre HDD None 21 Days
/p/cwfs ($CENTER) 3.3 PB GPFS HDD 100 TB 120 Days
/p/work1/projects ($PROJECTS_HOME) 8.4 PB Lustre HDD None None

Raider Raider
Raider is a Penguin Computing TrueHPC system located at the AFRL DSRC. It has 1,480 standard compute nodes, 8 large-memory nodes, and 24 Visualization nodes, 32 MLA nodes, and 64 High Clock nodes (a total of 199,680 compute cores). It has 447 TB of memory and is rated at 9 peak PFLOPS.

Node Configuration
Login Login-viz Standard Large-Memory Visualization MLA High Clock Transfer
Total Nodes 6 4 1,480 8 24 32 64 2
Processor AMD 7713 Milan AMD 7713 Milan AMD 7713 Milan AMD 7713 Milan AMD 7713 Milan AMD 7713 Milan AMD 73F3 Milan AMD 7713 Milan
Processor Speed 2.0 GHz 2.0 GHz 2.0 GHz 2.0 GHz 2.0 GHz 2.0 GHz 3.4 GHz 2.0 GHz
Sockets / Node 2 2 2 2 2 2 2 2
Cores / Node 128 128 128 128 128 128 32 128
Total CPU Cores 768 512 189,440 1,024 3,072 4,096 2,048 256
Usable Memory / Node 503 GB 503 GB 251 GB 2.0 TB 503 GB 503 GB 503 GB 503 GB
Accelerators / Node 1 1 None None 1 4 None None
Accelerator NVIDIA A40 PCIe 4 NVIDIA A100 SXM 4 n/a n/a NVIDIA A40 PCIe 4 NVIDIA A100 SXM 4 n/a n/a
Memory / Accelerator 45 GB 40 GB n/a n/a 45 GB 40 GB n/a n/a
Storage on Node 960 GB NVMe SSD 960 GB NVMe SSD 1.91 TB NVMe SSD 7.68 TB NVMe SSD None 3.84 TB NVMe SSD None None
Interconnect HDR InfiniBand HDR InfiniBand HDR InfiniBand HDR InfiniBand HDR InfiniBand HDR InfiniBand HDR InfiniBand HDR InfiniBand
Operating System RHEL RHEL RHEL RHEL RHEL RHEL RHEL RHEL

File Systems on Raider
Path Formatted Capacity File System Type Storage Type User Quota Minimum File Retention
/p/home ($HOME) 1.3 PB Lustre HDD 30 GB None
/p/work1 ($WORKDIR) 18 PB Lustre Hybrid SSD/HDD None 30 Days
/p/work2 ($WORKDIR2) 820 TB Lustre Hybrid SSD/HDD None 30 Days
/p/cwfs ($CENTER) 3.3 PB GPFS HDD 100 TB 120 Days
/p/app ($PROJECTS_HOME) 689 TB Lustre NVMe SSD None None