Platform Hardware And Software Resources
Hardware Resources
Node Configuration
Node category | Number of nodes (units) | Main specifications | |||
---|---|---|---|---|---|
CPU | Memory | GPU | |||
Management node | 2 | 2*Intel(R) Xeon(R) Platinum 8358P CPU @ 2.60GHz | 512G | / | |
Login node | 2 | 2*Intel(R) Xeon(R) Platinum 8358P CPU @ 2.60GHz | 512G | / | |
CPU1 | 110 | 2*Intel(R) Xeon(R) Platinum 8358P CPU @ 2.60GHz | 512G | / | |
CPU2 | 30 | 2*Intel(R) Xeon(R) Platinum 8358P CPU @ 2.60GHz | 512G | / | |
CPU3 | 20 | 2* AMD EPYC 7763 64-Core Processor 2450 | 512G | / | |
GPU1 | 50 | 2*Intel(R) Xeon(R) Platinum 8358P CPU @ 2.60GHz | 1024G | 8*NVIDIA A800-SXM4-80GB | |
GPU2 | 15 | 2*Intel(R) Xeon(R) Platinum 8358P CPU @ 2.60GHz | 2048G | 8*NVIDIA A800-SXM4-80GB | |
GPU3 | 15 | 2*Intel(R) Xeon(R) Platinum 8358P CPU @ 2.60GHz | 1024G | 8*NVIDIA A40-48GB | |
BIG MEM | 6 | 4*Intel(R) Xeon(R) Gold 6348H CPU @ 2.30GHz | 3072G | / |
Node Performance
CPU Node
Node Category | Frequency per core | Number of Cores per Node | Memory | Nodes | Total Cores | Theoretical Peak/Gflops |
---|---|---|---|---|---|---|
CPU1 | 2.60GHz | 64 | 512G | 110 | 7040 | |
CPU2 | 2.60GHz | 64 | 512G | 30 | 1920 | |
CPU3 | 2.45GHz | 128 | 512G | 20 | 2560 | |
BIGMEM | 2.30GHz | 96 | 3072G | 6 | 1152 |
GPU Node
GPU server Overall configuration using NVLINK 400GB/S
Node Category | Frequency per core | Number of cores per node | Memory | Nodes | Total cores | Graphics memory per GPU | Total Graphics Memory | Theoretical peak/Gflops |
---|---|---|---|---|---|---|---|---|
GPU1 | 2.60GHz | 64 | 1024G | 50 | 3200 | A800-SXM4-80GB | 640GB | |
GPU2 | 2.60GHz | 64 | 2048G | 15 | 960 | A800-SXM4-80GB | 640GB | |
GPU3 | 2.60GHz | 64 | 1024G | 15 | 960 | NVIDIA A40 48GB | 384GB |
Storage Configuration
Storage Type | Mount Point | Storage Space | File System | Remarks |
---|---|---|---|---|
SSD | /hpc2ssd | 309T | GPFS EC | Used to improve the HPC task storage IO read and write performance, such as long time not used data please migrate to HHD Avoid. |
HDD | /hpc2hdd | 3.9P | GPFS EC | For HPC general user storage read/write performance and data storage |
Software Resources
Operating System Resources
Node Type | Operating System |
---|---|
Management node | Red Hat Enterprise Linux release 8.4 (Ootpa) |
Login Node | Ubuntu 20.04 LTS |
CPU1 | Ubuntu 20.04 LTS |
CPU2 | Red Hat Enterprise Linux release 8.4 (Ootpa) |
CPU3 | Ubuntu 20.04 LTS |
GPU1 | Ubuntu 20.04 LTS |
GPU2 | Red Hat Enterprise Linux release 8.4 (Ootpa) |
GPU3 | Ubuntu 20.04 LTS |
BIGMEM | Ubuntu 20.04 LTS |
Compilation Environment Resources
CPU1、CPU3、Big Memory Nodes
Compile Tools | Version | Load Method |
---|---|---|
GCC | 9.4.0(system default) | Use directly |
13.1 | module load compilers/gcc-13.1.0 | |
python | 3.8.4(system default) | Use directly |
icc | 2023.1.0 | module load compilers/icc-2023.1.0 |
cmake | 3.27.0 | module load cmake/3.27.0 |
java | 1.8.11 | Use directly |
CPU2 Node
Compile Tools | Version | Load Method |
---|---|---|
GCC | 8.4.1(system default) | Use directly |
13.1 | module load compilers/gcc-13.1.0 | |
python | 3.6.8(system default) | Use directly |
icc | 2023.1.0 | module load compilers/icc-2023.1.0 |
cmake | 3.27.0 | module load cmake/3.27.0 |
java | 1.8.11 | Use directly |
GPU1节点
Compile Tools | Version | Load Method |
---|---|---|
GCC | 9.4.0(system default) | Use directly |
gcc13.1 | module load compilers/gcc-13.1.0 | |
python | 3.8.4(system default) | Use directly |
icc | 2023.1.0 | module load compilers/icc-2023.1.0 |
cmake | 3.27.0 | module load cmake/3.27.0 |
cuda | 11.3 (cudnn 8.9.3 for cuda11.x ) | module load cuda/11.3 |
11.7 (cudnn 8.9.3 for cuda11.x ) | module load cuda/11.7 | |
11.8 (cudnn 8.9.3 for cuda11.x ) | module load cuda/11.8 | |
12.0 (cudnn 8.9.3 for cuda12.x ) | module load cuda/12.0 | |
12.2 (cudnn 8.9.3 for cuda12.x ) | module load cuda/12.2 | |
nvidia-sdk | 23.7 | module load nvhpc/23.7 |
Maths Libraries
Software Name | Version | Load Method |
---|---|---|
fftw | 3.3.10 | |
intel MKL | 2023 | module load compilers/mkl-2023.1.0 |
nvidia-sdk | 23.7 | module load nvhpc/23.7 |
blas/scalapack/lapack | / |
MPI Environment Resources
No. | Software Name | Version | Installation Path | Load Method |
---|---|---|---|---|
1 | mpich | 4.1.2 gcc | /opt/mpi/mpich-4.1.2 | module load mpi/mpich-4.1.2 |
2 | 4.1.2 icc | /opt/mpi/mpich-4.1.2_icc-2023.1.0 | module load mpi/mpich-4.1.2_icc-2023.1.0 | |
3 | mvapich | 3.0b gcc | /opt/mpi/mvapich-3.0b | module load mpi/mvapich-3.0b |
4 | 3.0b icc | /opt/mpi/mvapich-3.0b_icc-2023.1.0 | module load mpi/mvapich-3.0b_icc-2023.1.0 | |
5 | mvapich | 2-2.3.7-1 gcc | /opt/mpi/mvapich2-2.3.7-1 | module load mpi/mvapich2-2.3.7-1 |
6 | 2-2.3.7-1 icc | /opt/mpi/mvapich2-2.3.7-1_icc-2023.1.0 | module load mpi/mvapich2-2.3.7-1_icc-2023.1.0 | |
7 | openmpi | 4.1.5 gcc | /opt/mpi/openmpi-4.1.5 | module load mpi/openmpi-4.1.5 |
8 | 4.1.5 icc | /opt/mpi/openmpi-4.1.5_icc-2023.1.0 | module load mpi/openmpi-4.1.5_icc-2023.1.0 | |
9 | 4.1.5 gpu | /hpc2ssd/softwares/cuda/openmpi-4.1.5 | module load mpi/openmpi-4.1.5_gpu | |
10 | Intel_mpi | 2021.9 | /opt/intel/oneapi/mpi/2021.9.0 | module load intelmpi-2021.9.0 |
11 | nvidia sdk | 23.7 | /hpc2ssd/softwares/nvidia/hpc_sdk/ | module load nvhpc/23.7 |
Application Software Resources
No. | Software Name | Version | Installation Path | Load Method |
---|---|---|---|---|
1 | GAUSS | g16 | /hpc2ssd/softwares/GAUSS | module load |
2 | HDF5 | 1.14.1-2 | /hpc2ssd/softwares/HDF5-1.14.1-2 | module load |
3 | PnetCDF | 1.12.3 | /hpc2ssd/softwares/PnetCDF-1.12.3 | module load |
4 | QE | 7.2 | /hpc2ssd/softwares/QE-7.2 | module load |
5 | R | 4.3.1 | R-4.3.1 | module load R/4.3.1 |
6 | RASPA2 | /hpc2ssd/softwares/RASPA2 | module load | |
7 | WPS | 4.2 | /hpc2ssd/softwares/WPS-4.2 | |
8 | WRF | 4.2.1 | /hpc2ssd/softwares/WRF-4.2.1 | |
9 | abacus | 3.3.0 | /hpc2ssd/softwares/abacus | |
10 | anaconda3 | 2023 | /hpc2ssd/softwares/anaconda3 | |
11 | ccpem | 20221108 | /hpc2ssd/softwares/ccpem-20221108 | |
12 | cistem | 1.0.0 | /hpc2ssd/softwares/cistem-1.0.0-beta | |
13 | cuda | /hpc2ssd/softwares/cuda | ||
14 | dushin | /hpc2ssd/softwares/dushin | ||
15 | dynamo | /hpc2ssd/softwares/dynamo | ||
16 | elk | 8.5.10 | /hpc2ssd/softwares/elk-8.5.10 | |
17 | gams | 44.1 | /hpc2ssd/softwares/gams44.1_linux_x64_64_sfx | |
18 | gromacs | 2023.2 | /hpc2ssd/softwares/gromacs-2023.2 | module load gromacs/2023.2 |
19 | jasper | 1.9 | j/hpc2ssd/softwares/asper-1.9 | |
20 | lammps_parallel | 3-Mar-20 | /hpc2ssd/softwares/lammps_parallel | module load lammps/2022-parallel |
21 | lammps_serial | /hpc2ssd/softwares/lammps_serial | module load lammps/2022-serial | |
22 | netcdf | /hpc2ssd/softwares/netcdf | ||
23 | pwtk-2.0 | /hpc2ssd/softwares/pwtk-2.0 | ||
24 | pycharm | 2023.1.4 | /hpc2ssd/softwares/pycharm-community-2023.1.4 | |
25 | pytorch | 2.0.1 | /hpc2ssd/softwares/pytorch-2.0.1 | |
26 | relion | /hpc2ssd/softwares/relion | ||
27 | scipion | /hpc2ssd/softwares/scipion | ||
28 | tensorflow-gpu | /hpc2ssd/softwares/tensorflow-gpu | ||
29 | vasp | 6.3.2 | /hpc2ssd/softwares/vasp.6.3.2 | module load vasp/6.3.2 |
30 | docker | 24.0.5 | /usr/bin/docker | |
31 | openFoam | 11 | /opt/openfoam11 |
Bioinformatics Software:
No. | Software Name | Load Method | Remarks |
---|---|---|---|
1 | Aspera | source /hpc2ssd/softwares/anaconda3/bin/activate biological | private key file:/hpc2ssd/softwares/anaconda3/envs/biological/etc/asperaweb_id_dsa.openssh |
2 | SRA tool kit | module load biological/sratoolkit | |
3 | fastp | source /hpc2ssd/softwares/anaconda3/bin/activate biological | |
4 | fastQc | source /hpc2ssd/softwares/anaconda3/bin/activate biological | |
5 | multiqc | source /hpc2ssd/softwares/anaconda3/bin/activate biological | |
6 | Bbmap | source /hpc2ssd/softwares/anaconda3/bin/activate biological | |
7 | Megahit | source /hpc2ssd/softwares/anaconda3/bin/activate biological | |
8 | prodigal | module load biological/prodigal | |
9 | hmmer3 | source /hpc2ssd/softwares/anaconda3/bin/activate biological | |
10 | CRISPRCasFinder | module load biological/crisprcasfinder | |
11 | MAFFT | source /hpc2ssd/softwares/anaconda3/bin/activate biological | |
12 | Blast | source /hpc2ssd/softwares/anaconda3/bin/activate biological | |
13 | muscle | source /hpc2ssd/softwares/anaconda3/bin/activate biological | |
14 | Bowtie2 | source /hpc2ssd/softwares/anaconda3/bin/activate biological | |
15 | pseqsid | used directly | |
16 | Mmseq | module load biological/mmseqs |