The Hyperion Cluster - Hardware

NOTE: The old Hyperion Cluster, which this page refers to, no longer exists in here described form, it has been assimilated into the newer Quantum Hyperion cluster as its sub-cluster and also its modules and packages are different!

This is but a remnant of its old documentation.

Login Nodes

The Hyperion cluster currently has two login nodes (out of which one is still experimental). Login nodes are the only nodes of the cluster to which the users have direct access and from which they can submit their jobs and work with the input/output data.

Graviton

Machine IBM eServer xSeries 346 [8840-45Y] (2U)
CPU 2x Intel Xeon 3.6 GHz (Irwindale, 90 nm, Socket 604, 64-bit, 1 Core, Hyper Threading, 3.6 GHz, 2 MB L2 Cache, 800 MHz FSB, TDP 103 W, Instructions and features: MMX, SSE, SSE2, SSE3; No virtualization (VT-x) support!)
Chipset Intel E7520 with Chipkill technology (Lindenhurst, 800 MHz FSB, TDP 10 W, Max. 32 GB of Dual-Channel DDR 266 (32 GB) / DDR 333 (16 GB) / DDR2 400 (16 GB) ECC Memory with max. 6.4 GB/s Bandwidth, PCI-Express 1.1 in configuration 3x8, Embedded Options Available)
Logical Processors 4
RAM 6x 2 GB ECC DDR
2x 1 GB ECC DDR
RAM Total 14 GB (Maximum possible 16 GB)
Disks Bay 0: Seagate Cheetah 10K.6 ST373307LC (IBM-ESXS, 3.5", 73.4 GB, 10k RPM, 8 MB Cache, 80-pin SCA-2, Ultra320 LVD SCSI-2 Wide, sustained throughput 59.9 MB/s, Average access read 4.7 ms / write 5.3 ms)
Bay 1: IBM DTN073C3UCDY10FN (IBM-ESXS, 3.5", 73.5 GB, 10k RPM, 80-pin SCA-2, Ultra320 LVD SCSI-2 Wide)
Bay 2: IBM DTN073C3UCDY10FN (IBM-ESXS, 3.5", 73.5 GB, 10k RPM, 80-pin SCA-2, Ultra320 LVD SCSI-2 Wide)
Bay 3: Seagate Cheetah 73LP ST373405LC (IBM-ESXS, 3.5", 73.4 GB, 10k RPM, 4 MB Cache, 80-pin SCA-2, Ultra160 LVD SCSI-2 Wide, sustained throughput 38.4-63.9 MB/s, Average access read 5.3 ms / write 5.7 ms)
Bay 4: Fujitsu MAT3073NC (IBM-ESXS, 3.5", 73.5 GB, 10k RPM, 8 MB Cache, 80-pin SCA-2, Ultra320 LVD SCSI-2 Wide, sustained throughput up to 132.4 MB/s, Average access read 4.5 ms / write 5.0 ms)
Bay 5: Seagate Cheetah 15K.5 ST373455LC (IBM-ESXS, 3.5", 73.4 GB, 15k RPM, 16 MB Cache, 80-pin SCA-2, Ultra320 LVD SCSI-2 Wide, sustained throughput 73-125 MB/s, Average access read 3.5 ms / write 4.0 ms)
Usable Disk Capacity 192 GB (Software RAID 10)
Link 2x Broadcom Corporation NetXtreme BCM5721 Gigabit Ethernet PCI Express

Tape backup connected to Graviton

Enclosure IBM 1U Rackmount Tape Enclosure [8765-1UX]
Tapes 2x IBM 200/400 GB Ultrium LTO-2 Half High Tape Drive
Storage interface 1x 68-pin VHDCI LVD SCSI-3 (F)
Storage Capacity per Tape 200 GB (uncompresed) / 400 GB (compressed)
Photos Tape Storage front View

Tachyon

Machine IBM System x3650 [7979-A2Y] (2U) [Description]
CPU 2x Intel Xeon E5335 (Clovertown, 65 nm, Socket LGA 771, 64-bit, 4 Cores, 2 GHz, 8 MB L2 Cache, 1333 MHz FSB, TDP 80 W, Instructions and features: MMX, SSE, SSE2, SSE3, SSSE3, XD bit, Intel VT-x)
Chipset Intel 5000P with Chipkill technology (Blackford, 1333 MHz FSB, TDP 30 W, Tcase 105 °C, Max. 64 GB of Quad-Channel DDR2 533/677 FBDIMM ECC Memory with max. 21 GB/s Bandwidth, PCI-Express 1.1 in configuration 4x4, Embedded Options Available)
Logical Processors 8
RAM 8x Samsung 4 GB 2Rx4 DDR2 667 MHz PC2-5300F ECC Fully Buffered DIMM
4x 1 GB ECC DDR2
RAM Total 36 GB (Maximum possible 64 GB)
Disks 1x Seagate Cheetah 15K.5 ST373455SS (IBM-ESXS, 3.5", 73.4 GB, 15k RPM, 16 MB Cache, 1.4M hours MTBF, SAS2, 3 Gbps, sustained throughput 73-125 MB/s, Average access read 3.5 ms / write 4.0 ms)
1x VPCA073900EST1 (IBM-ESXS, 3.5", 73.4 GB, SAS2, 3 Gbps)
4x VPA146C3-ETS10 (IBM-ESXS, 3.5", 146 GB, SAS2, 3 Gbps)
Usable Disk Capacity 340 GB (HW RAID on-board ServeRAID 8k = Adaptec AAC-RAID) + DS3200 (see below)
Link 2x Broadcom Corporation NetXtreme II BCM5708 Gigabit Ethernet
1x Intel QLE7340 (Infiniband, QDR, 40 Gbps, single-port, QSFP)
Photos Top to bottom, Tapes, DS3200, Tachyon, Phonon, Graviton

DS3200 connected to Tachyon

Machine IBM System Storage DS3200 [1726-HC2] (2U)
Controllers 2
Storage interface
per controller 		3x External SAS, 3 Gbps
1x SAS Expansion
RAM/Cache
per controller 		512 GB (Maximum possible 1 GB)
Disks
Usable Disk Capacity 1.4 TB

Execution Nodes

These are the nodes, where all the submitted jobs are executed. Users do not have direct access to these nodes and all jobs are managed by the Grid Engine, but they can submit their jobs there via the login nodes.

Total Execution Nodes 21
Total Logical Execution Processors 672 (= 21x 32)
Total Execution RAM 1600 GB (= 17x 64 GB + 4x 128 GB)

Node 2, ..., 21

Machine(s) 5x 2U Supermicro A+ Server 2022TG-HTRF with four Supermicro H8DGT-HF-based nodes each
CPU per Node 2x AMD Opteron 6272 (Interlagos, 32 nm, Socket G34, 64-bit, 16 Cores, 2.1 GHz, all cores turbo 2.4 GHz, max. turbo 3.0 GHz (half-cores), 8x 2 MB L2 Cache, 2x 8 MB L3 cache, 3.2 GHz HyperTransport, 4-channel UDDR3/RDDR3 up to PC3-12800, TDP 115 W, Instructions and features: MMX, SSE, SSE2, SSE3, SSSE3, SSE4.1, SSE4.2, SSE4a, NX bit, AMD-V, AES, CLMUL, AVX, XOP, FMA4)
Chipset per Node AMD SR5670 + SP5100 (65 nm, 16-bit up/down HyperTransport 3.0 up to 5.2 GT/s, 200-1000 MHz HT1 frequencies, 1200-2600 MHz HT3 frequencies, LDTSTOP interface and CPU throttling, 30 PCI-Express Gen. 2 general purpose lanes and up to 9 devices on specific ports, Rev. 1.26 compliant IOMMU, one x4 A-Link Express II interface to AMD SouthBridge with up to 2.5 Gb/s / Lane, PCI Rev. 2.3 bus at 33 MHz with up to 6 bus master devices, 40-bit addressing, and spread spectrum support, SMBus Rev. 2.0, full support for ACPI states S1, S3, S4, and S5, AMD PowerNow!, TDP 15.4 + 4.5 W)
Logical Processors per Node 32
RAM per Node
nodes 2, ..., 5, 10, ..., 214x 16GB 2Rx4 2G x 72-bit 1600 MHz PC3L-12800 CL11 ECC Registered 240-Pin DIMM (Kingston KVR16LR11D4/16HA or similar)
nodes 6, ..., 98x 16GB 2Rx4 2G x 72-bit 1600 MHz PC3L-12800 CL11 ECC Registered 240-Pin DIMM (Kingston KVR16LR11D4/16HA or similar)
RAM Total per Node
nodes 2, ..., 5, 10, ..., 2164 GB (Maximum possible 512 GB)
nodes 6, ..., 9128 GB (Maximum possible 512 GB)
Disks per Node 1x Seagate Constellation CS ST1000NC001 (24x7, 3.5", 1 TB, 7200 RPM, 64 MB Cache, 800k hours MTBF, 4 KB sectors, 512 B Emulation, SATA, 6 Gbps, sustained throughput 150-180 MB/s, Average access read 9.5 ms / write 10.5 ms)
Usable Disk Capacity per Node 1 TB
Links per Node 2x Intel 82576 Gigabit Ethernet (one dual-port)
1x Dedicated LAN for IPMI 2.0 with virtual media and KVM over LAN (Winbond WPCM450 BMC)
1x Intel QLE7340 (Infiniband, QDR, 40 Gbps, single-port, QSFP)
Photos node2..21 2U boxes overview node2..21 node top node2..21 node back node2..21 baseboard and IB detail node2..21 node front node2..21 node disk

Node 22

Machine 4U Supermicro A+ Server 4022G-6F with one Supermicro H8DG6-F-based node
CPU per Node 2x AMD Opteron 6272 (Interlagos, 32 nm, Socket G34, 64-bit, 16 Cores, 2.1 GHz, all cores turbo 2.4 GHz, max. turbo 3.0 GHz (half-cores), 8x 2 MB L2 Cache, 2x 8 MB L3 cache, 3.2 GHz HyperTransport, 4-channel UDDR3/RDDR3 up to PC3-12800, TDP 115 W, Instructions and features: MMX, SSE, SSE2, SSE3, SSSE3, SSE4.1, SSE4.2, SSE4a, NX bit, AMD-V, AES, CLMUL, AVX, XOP, FMA4)
Chipset per Node AMD SR5690 + SP5100 (65 nm, 16-bit up/down HyperTransport 3.0 up to 5.2 GT/s, 200-1000 MHz HT1 frequencies, 1200-2600 MHz HT3 frequencies, LDTSTOP interface and CPU throttling, 42 PCI-Express Gen. 2 general purpose lanes and up to 11 devices on specific ports, Rev. 1.26 compliant IOMMU, one x4 A-Link Express II interface to AMD SouthBridge with up to 2.5 Gb/s / Lane, PCI Rev. 2.3 bus at 33 MHz with up to 6 bus master devices, 40-bit addressing, and spread spectrum support, SMBus Rev. 2.0, full support for ACPI states S1, S3, S4, and S5, AMD PowerNow!, TDP 18 + 4.5 W)
Logical Processors per Node 32
RAM per Node 4x 16GB 2Rx4 2G x 72-bit 1600 MHz PC3L-12800 CL11 ECC Registered 240-Pin DIMM (Kingston KVR16LR11D4/16HA or similar)
RAM Total per Node 64 GB (Maximum possible 512 GB)
Disks per Node 1x Seagate Constellation CS ST1000NC001 (24x7, 3.5", 1 TB, 7200 RPM, 64 MB Cache, 800k hours MTBF, 4 KB sectors, 512 B Emulation, SATA, 6 Gbps, sustained throughput 150-180 MB/s, Average access read 9.5 ms / write 10.5 ms)
Usable Disk Capacity per Node 1 TB
Links per Node 2x Intel 82576 Gigabit Ethernet (one dual-port)
1x Dedicated LAN for IPMI 2.0 with virtual media and KVM over LAN (Winbond WPCM450 BMC)
1x Intel QLE7340 (Infiniband, QDR, 40 Gbps, single-port, QSFP)
GPU per Node 1x nVidia GeForce GTX Titan (GK110-400-A1, Kepler architecture, 28 nm, 2688 CUDA cores, Base clock 837 MHz, Avg. boost clock 876 MHz, Max. boost clock 993 MHz, Memory clock 1502 MHz QDR (6008 MHz), RAM 6144 MB 384-bit GDDR5, 288.4 GB/s, 4499.7 GFLOPS single-precision, 1499.9 GFLOPS double-precision, 250 W)

Storage

MMG-Storage2

Machine
CPU
Logical Processors
RAM
RAM Total
RAID Controller Areca ARC-1222 Ver:2.0 (Intel IOP348 800 MHz, 256 MB DDR2-533 SDRAM, 2x SFF-8087, PCI-Express x8, 8x 3 Gb/s SAS/SATA HDDs, LowProfile, RAID 0/1/10/3/5/6/30/50/60/Single/JBOD, multiple RAID selection, Ethernet management) with Areca battery for backup
Disks for main RAID 5x 4 TB
Hot Swap 3.5" RAID Bays 5x Total
Usable Storage Capacity 12 TB in RAID 6
Links 1x Gigabit Ethernet
Photos MMG-Storage2 - front view MMG-Storage2 - internal view MMG-Storage2 - detail of RAID controller back-side MMG-Storage2 - detail of RAID controller front-side

Magnon

Machine 4U Supermicro 846BE2C-R1K28B chasis with one Supermicro X10DRi-LN4+ motherboard
CPU 2x Intel Xeon E5-2630 v4 (Broadwell-EP, 14 nm, Socket 2011, 64-bit, 10 Cores, HyperThreading, 2.2 GHz, Turbo Boost 2.0: 2/2/2/3/4/5/6/7/9/9, max. turbo 3.1 GHz (2-cores), 10x 256 KB L2 Cache, 25 MB L3 cache, 2x 8.0 GT/s QPI, 4-channel DDR4 up to PC4-2133, TDP 84 W, Instructions and features: MMX, SSE, SSE2, SSE3, SSSE3, SSE4.1, SSE4.2, AVX, AVX2, FMA3, F16C, XD bit, VT-x, VT-d, AES-NI, Smart Cache)
Logical Processors 40
RAM 8x Kingston KVR24R17D4/16 16GB 2Rx4 2G x 72-bit PC4-2400 CL17 ECC Registered w/Parity 288-pin DIMM (RDIMM)
RAM Total 128 GB (Maximum possible 768 GB RDIMM or 3 TB 3DS LRDIMM in 24 slots)
RAID Controller Areca ARC-1883i Ver:2.0 (Dual Core RAID-on-Chip 1.2 GHz, 2 GB on-board DDR3-1866 SDRAM, 2x SFF-8643, PCI-Express 3.0 x8, up to 256 12 Gb/s SAS or 6 Gb/s and 3 Gb/s SAS/SATA HDDs/SDDs, Low Profile, RAID 0/1/10(1E)/3/5/6/00/30/50/60/100/Single/JBOD, multiple RAID selection, stripe up to 1 MB, HDD firmware update support, Ethernet management) with Areca ARC-1883-CAP capacitor 2 GB flash memory for backup
Disks for main RAID 13x Hitachi UltraStar-He8 HGST HUH728080AL5200/0F23268 (Helium platform Enterprise Hard Drive, 24x7, 3.5", 8 TB, 7200 RPM, 128 MB Cache, 2.5M hours MTBF, 512e Format, ISE (Instant Secure Erase), SAS 12 Gbps, sustained throughput 205 MB/s, Average access read 8.5 ms / write 9.0 ms)
Hot Swap 3.5" RAID Bays 24x Total (out of which 11x Empty)
Disks for system and RAID metacache 2x Intel SSD DC S3610 (200 GB, 2.5", SATA 6 Gb/s, 20 nm, MLC, Sequential Read 550 MB/s / Write 230 MB/s, Random Read 82k IOPS / Write 12k IOPS, Latency Read 55 us / Write 66 us, MTBF 2M hours, Hardware Encryption AES 256-bit)
SSD for RAID Cache 2x Intel SSD DC P3700 (800 GB, NVMe, Half Height PCI-Express 3.0 x4, 20 nm, MLC, Sequential Read 2800 MB/s / Write 1900 MB/s, Random Read 460k IOPS / Write 90k IOPS, Latency Read/Write 20 us, MTBF 2M hours)
Usable Storage Capacity 88 TB in RAID 6
Links 4x Gigabit Ethernet (1x on-board Intel i350 Quad Port Gigabit Ethernet with Virtual Machine Device Queues)
1x Dedicated LAN for IPMI 2.0 with virtual media and KVM over LAN (ASPEED AST2400 BMC)
1x Intel QLE7342 (Infiniband, QDR, 2x 40 Gbps, dual-port, QSFP)
PSU Power 1280 W (dual redundancy)
Photos Magnon - front view off Magnon - front view on Magnon - read view Magnon - top internal Magnon - internal view on NVMes Magnon - NVMe front view Magnon - NVMe rear view Magnon - top view on system SSDs Magnon - top view of RAID HDD Magnon - RAM module Magnon - PSU module Magnon - Infiniband card front view Magnon - Infiniband card rear view Magnon - Infiniband card view of the header Magnon - RAID controller Magnon - RAID capacitor backup flash module

Other Cluster Services

Muon

Machine Lenovo ThinkCentre A52 (type 8298-7CG) (Desktop)
CPU Intel Pentium D 820 (Smithfield, 90 nm, Socket LGA775, 64-bit, 2 Core, no Hyper Threading, 2.8 GHz, 2x 1 MB L2 Cache, 800 MT/s FSB, TDP 95 W, Instructions and features: MMX, SSE, SSE2, SSE3; EIST, XD)
Chipset NB: Intel 82945G (945G, ICH7/ICH7R, Lakeport-G, FSB 1066 MT/s, DDR2 400/533/667, max. memory bandwidth 10.7 GB/s, PAE 32-bit, graphics GMA 950, 22.2 W)
SB: Intel 82801GB (ICH7, Intel Management Engine, HD Audio, 1x UDMA 100/66/33 PATA, 4x SATA 3 Gbps, 8x USB 2.0, 3.3 W)
Logical Processors 2
RAM Kingston KHX6400D2LLK2/2G [DataSheet] (Kit of 2x: 1 GB, 128M x 64-bit, DDR2-800 (PC2-6400) CL4 Gold 240-pin DIMM Kit, 2.0 V) [2 modules total]
RAM Total 2 GB (max. possible 4 GB)
Graphics Intel GMA950 (Integrated, 256-bit core, video memory DVMT scheme up to 224 MB, core 400 MHz, 1.6 GP/s, 1.6 GT/s, 10.6 GB/s, res. 2048x1536 analog and digital, DX 9.0, Vertex shader 3.0, OpenGL 1.4 with ARB)
Disks 1x Hitachi DeskStar T7K250 HDT722516DLA380 (3.5", 160 GB, 7200 RPM, 8 MB Cache, SATA 3 Gb/s)
Usable Disk Capacity 160 GB
Link 1x Broadcom NeXtreme BCM5789KFBG (1 Gbps, integrated)
1x SMC 1225TX-PF-50 (PCI, 10/100 Mbps, SMC EN5251BE)
PSU Power 225 W
Photos Muon Front Muon Angle Muon Back Muon ID Muon Top Muon In1 Muon In2 Muon In3 Muon In4 Muon In5 Muon South Bridge Muon HDD Muon Ethernet Top Muon Ethetnet Bottom

Muon 2

Case Cooler Master Elite 333
Motherboard Gigabyte GA-EP35-DS3 (rev 2.1)
CPU Intel Core 2 Duo E8200 (Wolfdale, 45 nm, Socket LGA775, 64-bit, 2 Core, no Hyper Threading, 2.67 GHz, 6 MB L2 Cache, 1333 MT/s FSB, TDP 65 W, Instructions and features: MMX, SSE, SSE2, SSE3, SSSE3, SSE4.1; EIST, XD, iAMT2, VT-x, TXT)
Chipset NB: Intel 82P35 [Datasheet] (P35, ICH9/ICH9R, Bearlake (P+), 90 nm, FSB 800/1066/1333 MT/s, DDR2/DDR3 667/800/1066, max. memory 8 GB, max. memory bandwidth 12.8 GB/s (DDR2) / 17 GB/s (DDR3), Intel Flex Memory Technology, Intel Turbo Memory, PCI Express 1.1 (up to x16 with 8 GB/s bandwidth + x4), 16 W)
SB: Intel 82801IUX-SFF (ICH9, HD Audio, 1x UDMA 100/66/33 PATA, 4x SATA 3 Gbps, 12x USB 2.0, 1x 1Gbps LAN, 2.5 W)
Logical Processors 2
RAM Kingston KVR667D2N5K2/2G (Kit of 2x: 1 GB, 128M x 64-bit, DDR2-667 (PC2-5300) CL5 240-pin DIMM Kit, 1.8 V) [2 modules total]
RAM Total 2 GB (max. possible 8 GB)
Graphics Leadtek WinFast PX8600 GT TDH Heatpipe Version (nVidia GeForce 8600 GT, PCI Express, 256 MB GDDR3 128-bit, core 540 MHz, memory 700 MHz, 32 stream processors, 8.64 GT/s, 22.4 GB/s, res. 2048x1536 analog and digital, DX 9.0, Vertex shader 3.0, OpenGL 1.4 with ARB, 2x DVI, 1x HDTV/VIVO TV Out)
Disks 1x Western Digital WD3201ABYS (WD RE2, 3.5", 320 GB, 7200 RPM, 16 MB Cache, SATA 3 Gb/s)
Usable Disk Capacity 320 GB
Link 1x Realtek 8111B (1 Gbps, integrated)
1x Realtek RTL8139D (PCI 2.2, 10/100 Mbps, no 802.1Q VLAN)
PSU Power Fortron FSP350-60GLN, 350 W
Photos Muon2 Front Muon2 Back Muon2 Angle Front Muon2 Angle Back Muon2 ID Muon2 Internals Muon2 Internals Muon2 Internals Muon2 Internals Muon2 RAM Top Muon2 RAM Bottom Muon2 HDD Muon2 HDD Muon2 Graphics Top Muon2 Graphics Bottom Muon2 LAN Top Muon2 LAN Bottom

Meson (Hyperion Router)

Machine Mikrotik hEX Routerboard 750Gr3
CPU Mediatek MT7621A (MIPS1004Kc, 32-bit, 2 Core, 880 MHz, LFBGA346, 32 KB Instruction L1 Cache, 32 KB Data L1 Cache, 256 KB L2 Cache, SMP capable, 16-bit DDR2/DDR3 up to 256/512 MB RAM interface; SPI, NAND Flash, SDXC, eMMC, SDIO/SDHC hosts; USB 3.0/2.0 host, PCI-Express 1.1 host; I2C, UART, JTAG, MDC, MDIO, GPIO; Audio SPDIF-Tx, I2S, PCM; embedded 5-port Gbps Ethernet Switch + RGMII; HW storage accelerator, 2 Gbps IPv4/6 routing, NAT, NAPT+HQoS; HW Crypto engine 200 Mbps IPSec throughput; Firmware: Linux 2.6.36/3.10 SDK, OpenWrt)
Logical Processors 2
RAM 256 MB
Link 5x 1 Gbps Ethernet (embedded)
1x USB 2.0/3.0
PSU Power 5 W
Photos Meson Front Meson Top Meson Side Angle Meson Bottom

Switches

Rack

Rack Model 1x APC NetShelter SX AR3100 (19", 42U x 600 x 1070, black, ventable, closed)
Additional Fixed
Accessories 		2x APC AP9572 (Rack PDU, Basic, Zero U, 16A, 230V, output sockets 15x IEC 60320 C13, input sockets 1x IEC 60320 C20, for UPS power distribution)
1x Eaton eSWA05 (ePDU SW, 3-Phase, 350-400 V, 16 A, output sockets 21x IEC 60320 C13 + 3x IEC 60320 C19, Managed power distribution unit for direct power connection)
Photos APC AR3100 rack front APC AR3100 rack back APC AR3100 rack front open APC PDU Basic APC PDU Basic APC PDU Basic APC PDU Basic Eaton eSWA05 ePDU Eaton eSWA05 ePDU Eaton eSWA05 ePDU

UPS

Cluster Rack-base EATON UPS

UPS Model EATON UPS 9PX8KiRTNBP31 (6U)
Included Modules 1x EATON 9PX 8000i (Power Module, 3U)
1x EATON 9PX EBM 240 (9PXEBM240RT, Battery Module, 3U)
1x EATON Network Management Card [cz] (Ethernet Management, within 9PX 8000)
1x EATON MBP11Ki31 (3-Phase HotSwap Maintenance Bypass Module, on the back of 9PX EBM 240V)
Capacity 8 kVA / 7.2 kW
Power Input 3-phase 350-400 V, 50 A nominal, max. power 11 kVA
Weight 88 kg
Photos Eaton 9PX8K UPS front view Eaton 9PX8K UPS rear view Eaton 9PX8K UPS rear view Eaton 9PX8K UPS rear view

Old KIPL/KM Cluster - Hardware

Login Nodes (KIPL)

Neutrino

Execution Nodes (KIPL)

Node 16, 18

Workstation Nodes (KM)

Nellie

Dolores

Node 02, ..., 11

Node 12, ..., 15

Node 17

Switches

UPS

KIPL PC-Lab Room 316T - Hardware

Workstation Nodes (316T)

MSI1 - Teacher PC

MSI2

Machine HP Pavilion Elite m9065.de, Prod #: KE618AA-ABD (Midi Tower)
CPU Intel Core 2 Quad Q6600 (Kentsfield, 65 nm, Socket LGA774, 64-bit, 4 Cores, no Hyper Threading, 2.4 GHz, 2x 4 MB L2 Cache, 1066 MT/s FSB, TDP 105/95 W, Instructions and features: MMX, SSE, SSE2, SSE3, SSSE3; EIST, XD, VT-x)
Chipset
Logical Processors 4
RAM 1x Kingston KVR667D2N5K2/4G (Kit of 2x: 2 GB, 256M x 64-bit, DDR2-667 CL5 240-pin DIMM, 1.8 V) [2 modules total]
1x Samsung M378T2953EZ3-CE6 (Kit of 2x: 1 GB, 128M x 64-bit, 64M x 8 * 16ea, 4 banks, PC2-4200, 533 MHz CL4 240-pin DIMM, 1.8 V) [2 modules total]
RAM Total 6 GB (max. possible 8 GB)
Disks 1x Western Digital Black WD1003FZEX (3.5", 1 TB, WD Black Desktop class, 7200 RPM, 64 MB Cache, SATAIII 6 Gb/s, Advanced Format, sustained throughput: 150 MB/s)
Usable Disk Capacity 1 TB
Link
Photos MSI2 HDD MSI2 graphics card top MSI2 graphics card front MSI2 graphics card back MSI2 memory modules front MSI2 memory modules back MSI2 internals MSI2 internals MSI2 internals MSI2 case front MSI2 case side front MSI2 ID label MSI2 case back MSI2 case side back

MSI3

MSI4

MSI5

Machine HP Pavilion a6165.de, Prod #: GM293AA-ABD (Midi Tower)
CPU Intel Core 2 Quad Q6600 (Kentsfield, 65 nm, Socket LGA774, 64-bit, 4 Cores, no Hyper Threading, 2.4 GHz, 2x 4 MB L2 Cache, 1066 MT/s FSB, TDP 105/95 W, Instructions and features: MMX, SSE, SSE2, SSE3, SSSE3; EIST, XD, VT-x)
Chipset
Logical Processors 4
RAM 2x Kingston KVR667D2N5K2/4G (Kit of 2x: 2 GB, 256M x 64-bit, DDR2-667 CL5 240-pin DIMM, 1.8 V) [4 modules total]
RAM Total 8 GB (max. possible 8 GB)
Graphics Asus Ranger 200 (nVidia GeForce 8400 GS (G86), 256 MB RAM DDR2 800 MHz, 64-bit RAM bus, PCI-Express x16, HP part number: 5188-8905, 80 nm, 210M transistors, core 450 MHz, shader 900 MHz, core configuration 16:8:4 [unified sharers:texture mapping units:render output units], 1.8 GP/s, 3.6 GT/s, 6.4 GB/s, 28.8 GFLOPS single precision, 40 W TDP)
Disks 1x Western Digital Red WD10EFRX (3.5", 1 TB, WD Red NAS class, 24/7, 5400 RPM, 64 MB Cache, SATAIII 6 Gb/s, Advanced Format, NCQ, MTBF 1Mh)
Usable Disk Capacity 1 TB
Link
Photos MSI5 HDD MSI5 graphics card top MSI5 graphics card front MSI5 graphics card back MSI5 memory module front and back MSI5 internals MSI5 internals MSI5 case back MSI5 case front MSI5 case side front MSI5 ID labels MSI5 case side back

MSI6

MSI7

MSI8

MSI9

Other Related Servers - Hardware

License and Miscellaneous Servers

Electron

Machine 3U Chenbro RM31212-BH chasis with one Tyan S2932 motherboard
CPU 2x AMD Opteron 2220 (Santa Rosa, 90 nm, Socket F (LGA 1027), 64-bit, 2 Cores, 2.8 GHz, 2x 1 MB L2 Cache, 1 GHz HyperTransport, 2-channel DDR2 up to Reg. PC2-5300, TDP 95 W, Instructions and features: MMX, SSE, SSE2, SSE3, Enhanced 3DNow!, NX bit, AMD-V)
Chipset nVidia nForce Professional 3600 MCP + NEC uPD720400 PCI Express – PCI/PCI-X Bridge
Logical Processors 4
RAM 8x Hynix HYMP351P72AMP4-Y5 (4 GB, 2Rx4, 512M x 72-bit, DDR2-667, PC2-5300P-555-12, CL5, 1.8 V, 240-pin ECC Reg. DIMM)
4x Kingston KVR667D2S4P5K2/2G (Kit of 2x 1 GB, 1Rx4, 256M x 72-bit, DDR2-667, PC2-5300, CL5, 1.8 V, 240-pin ECC Reg. DIMM, 3.987 W)
RAM Total 40 GB (Maximum possible 128 GB DDR2 in 16 slots)
RAID Controller Areca ARC-1230 (Intel IOP333 I/O processor, 256 MB socket DDR-400 SODIMM with ECC (max. 1 GB), 12x SATA II (3 Gbps), PCI-Express x8, RAID 0/1/10(1E)/3/5/6/JBOD, Ethernet management) with Areca ARC-6120BA-T11x battery backup
Disks for main RAID 3x Hitachi DeskStar E7K500 HDS725050KLA360 (500 GB, 7200 RPM, 16 MB cache, SATA II, 3 Gbps, 1Mh MTBF, 24x7, avg. seek 8.5 ms, sustained 64.8-31 MB/s, idle 9.6 W) [bay 4, 5, 6]
3x Western Digital Re WD5003ABYZ-011FA0 (WD Re, 500 GB, 7200 RPM, 64 MB cache, SATA III, 6 Gbps, sustained 128 MB/s, 1.2Mh MTBF, max. 6.5 W, idle 4.4 W) [bay 7, 8, 9]
1x Western Digital WD5003ABYX-01WERA1 (WD Re4, 500 GB, 7200 RPM, 64 MB cache, SATA II, 3 Gbps, 1.2Mh MTBF) [bay 3]
Hot Swap 3.5" RAID Bays 12x Total (out of which 3x Empty)
Disks for system 2x Western Digital Re WD5003ABYZ-011FA0 (WD Re, 500 GB, 7200 RPM, 64 MB cache, SATA III, 6 Gbps, sustained 128 MB/s, 1.2Mh MTBF, max. 6.5 W, idle 4.4 W, Warranty end 2.2.2022) [bay 1, 2]
Usable Storage Capacity 2.5 TB in RAID 6 + 150 GB in RAID 1 (system)
Links
PSU Power 724 W (tripple redundancy) (Model: Zippy M1Z3-6760P3V)
Photos Electron - front view Electron - back view Electron - top view Electron - top view Electron - top view Electron - top view Electron - top view Electron - top view Electron - top view Electron - top view Electron - top view Electron - RAID top view Electron - RAID bottom view Electron - RAID BBU Electron - angle top view Electron - PSU Electron - RAM Electron - MB ID Electron - System HDD Electron - HDDs Electron - New System HDDs

Virtualization Servers

Phonon

Machine 2U Supermicro 825TQ-R740LPB chasis with one Supermicro X10DRi motherboard
CPU 2x Intel Xeon E5-2630 v3 (Haswell-EP, 22 nm, Socket 2011-3, 64-bit, 8 Cores, HyperThreading, 2.4 GHz, Turbo Boost 2.0: 2/2/2/2/2/2/8/8, max. turbo 3.2 GHz (2-cores), 8x 256 KB L2 Cache, 20 MB L3 cache, 2x 8.0 GT/s QPI, 4-channel DDR4 up to PC4-1866, TDP 85 W, Instructions and features: MMX, SSE, SSE2, SSE3, SSSE3, SSE4.1, SSE4.2, AVX, AVX2, FMA3, F16C, XD bit, VT-x, VT-d, AES-NI, Smart Cache)
Logical Processors 32
RAM 8x Samsung M393A1G40DB0-CPB [DataSheet] 8GB 1Rx4 1G x 72-bit PC4-2133 CL15 ECC Registered w/Parity 288-pin DIMM (RDIMM), LP (31 mm)
RAM Total 64 GB (Maximum possible 1 TB ECC RDIMM or 2 TB ECC 3DS LRDIMM in 16 slots)
RAID Controller Supermicro AOC-SAS2LP-H8iR-16DD (LSI SAS2 2108, 512 MB on-board DDR2 800 MHz, 2x SFF-8087, PCI-Express x8, up to 16 6 Gb/s SAS/SATA HDDs/SDDs, Low Profile, RAID 0/1/10/5/50/6/60) with Supermicro BTR-0018L battery for backup
Disks for main RAID (with system) 6x Toshiba MG03SCA300 (Enterprise HDD, 24x7, 2.5", 3 TB, 7200 RPM, 64 MB Cache, 1.2M hours MTBF, SAS 6 Gbps, sustained throughput 155 MB/s, Average access 4.17 ms, 11.3 W during r/w, 6 W idle)
Hot Swap 2.5" RAID Bays 8x Total (out of which 2x Empty)
SSD for system support 2x Supermicro SuperDOM 64GB (SATA3 6 Gb/s, module for special on-board SATA connector, Sequential Read 520 MB/s / Write 185 MB/s)
Usable RAID Storage Capacity 12 TB in RAID 6
Links 2x Gigabit Ethernet (1x on-board Intel i350 Dual Port Gigabit Ethernet (DataSheet) with Virtual Machine Device Queues (8 VMs), PCI-SIG I/O SR-IOV support, IEEE802.1AS - IEEE 1588 Precision Time Protocol support, Per-packet timestamp)
1x Dedicated LAN for IPMI 2.0 with virtual media and KVM over LAN (ASPEED AST2400 BMC)
Warranty 3y NBD ending 20.2.2018
Photos

Contents of this page was written and is maintained by Martin Dráb © 2016-2017 KIPL FJFI CVUT / DSSE FNSPE CTU in Prague