Technical characteristics of OSIRIM platform

 

The OSIRIM platform consists of a 1120 core computing cluster distributed over 26 computing servers + 28 Nvidia GTX 1080 TI cards (3584 cuda cores each) distributed over 7 servers, and 3 Nvidia Quadro RTX6000 cards (24 Go RAM) . This cluster is structured as follows :

- User connection nodes  ​

These nodes are used to validate the programs before launching them on the compute cluster. These interactive nodes are shared among all users and should not be used for running long jobs.

- Compute nodes (co2-nc01, …, co2-nc26) ​

These nodes are servers dedicated to calculations. A process running on a compute node accesses data hosted on the storage area, performs a process, and records the result on that area. 

The technical characteristics of the 10 nodes of physical computations are the following ones :

10 IBM servers X3755 M3
- 4 AMD Opteron 6262HE processors with 16 x 1,6Ghz cores
- 512 Go RAM
- 2 x 300 Go RAID1 SSD disk
- 2 x 10Gb/s network

The technical characteristics of the 12 nodes (co2-nc11 to co2-nc22) of physical computations are the following ones :

3  DELL C6420 : 12 servers with following characteristics :
- 2 Intel Xeon Gold 6136 processors with 12 x 3 Ghz cores
- 192 Go RAM
- 2 x 256 Go RAID1 SSD Disk
- 10 Gb/s network

The technical characteristics of the 4 nodes (co2-nc23 to co2-nc26) of physical computations are the following ones :

1  DELL C6525 : 4 servers with following characteristics :
- 2 AMD Epyc Rome 7402 processors with 12 x 2,8 Ghz cores
- 512 Go RAM
- 2 x 256 Go RAID1 SSD Disk
- 10 Gb/s network

- Compute nodes (co2-ng01, …, co2-ng07) ​

These nodes are servers dedicated to GPU calculations. Each of the 7 servers is equipped with 4 Nvidia Geforce GTX 1080TI graphics cards.

The technical characteristics of the 7 nodes are the following ones :
- 7 DELL T630 servers
- 2 Xeon 2640 V4 processors (20 threads)
- 2 x 400 Go RAID1 SSD disk
- 1 x 10 Gb/s network
- 4 GPUs Nvidia GTX 1080 TI (3584 cuda cores each, 11 Go RAM)

- Compute node co2-ng09 ​

This node is dedicated to GPU calculations. It is equipped with 3 Nvidia QUADRO RTX6000 graphics cards.

The technical characteristics of this node are the following ones :
- DELL R740 server
- 2 Xeon Gold 6230 processors (20 cores)
- 2 x 223 Go RAID1 SSD disk
- 1 x 10 Gb/s network
- 3 GPUs Nvidia QUADRO RTX 6000 (4608 cuda cores, 576 Tensor cores, 72 RT cores, 24 Go RAM))

A process running on a compute node accesses data hosted on the storage area, performs a process, and records the result on that area. The data storage on the OSIRIM platform is provided by an EMC Isilon bay composed of :

- 11 X400 nodes of 36 SATA drives of 3 TB each
- each node is connected to the network via a trunk of 2 links 10Gb/s
- the useful volume is about 1 Po

OneFS is the OS of the storage array that integrates both the file system, volume management, and data security.
The set consists of a single distributed file system, with a single namespace, which has the ability to present data to servers following multiple protocols. NFS and HDFS are the access protocols used on OSIRIM.