Institute for Condensed Matter Physics (ICMP) of the NAS of Ukraine

The ICMP computer cluster consists of 17 computational nodes, 1 coordinating node, and 3 data storage system nodes. There are 136 2.0GHz Intel Xeon E5405 CPUs available for a computing work, giving the total peak productivity of about 1.1 TFlops. At the same time the LINPACK tests show the productivity around 850 Gflops, reached due to the high-speed Infiniband connection with 10 Gb/s two-way bandwidth.

All the software used on the ICMP cluster is free software. The operating system in use is the Rocks Linux distribution, developed specially for computing clusters. The SGE queuing system is used to control the tasks submitted for computing. Parallel tasks can run through the OpenMPI library. The Intel compiler and MKL library are available besides the standard gcc compilers. A big set of various numerical libraries is present as well.

The present capacity of data storage system is 4TB. It was built on the basis of a RAID-5 hard drive array of 1TB disks, and the high-end Lustre file system. In case of a hard disk failure the system is able to hot-swap the hard drives.

The cluster is connected to the Ukrainian academic network though an optical fiber cable with 1 Gb/s bandwidth and is part of national GRID project.

Computing nodes (17 nodes)

Data storage system

Storage system is built on Lustre file system and consists of three nodes with hard disks combined into RAID arrays. One node is a head node of the Lustre server (MDS) and the remaining two are actual storage nodes (OSS).

Network

All the computing nodes are connected by the Infiniband 4x DDR network,network card MHES18-XTC,network commutator Mallanox MTS2400 InfiniBand HCA 24-Port HCA Switch.This network is used for communication between parallel user tasks. The connection between computing nodes and Lustre file server is through Gigabit Ethernet.