As per TOP 500's Jan 2018 ratings, MIHIR is India’s second fastest supercomputer with 2.8 Petaflops of peak performance powered by Intel Xeon Broadwell E5-2695 v4 CPU and has total storage of 6.3 Petabytes. It has Intel KNL 7210 nodes with a peak performance of 31.92 TFLOPS .
| Hardware |
| Cray XC40 System | System Configuration |
| Cray XC40 Compute Cabinets | 13 |
| Interconnect Network | Cray Aries with Dragonfly topology |
| Total Peak Performance | 2,806 TFLOPS |
| COmpute Nodes |
| Number of Nodes | 2320 |
| Processor | Intel Xeon Broadwell E5-2695 v4 CPU (18 core, 2.1 GHz) |
| Memory Per Node | 128 GiB Memory DDR4-2400 w/ Chipkill TM technology |
| Total Memory | 290 TiB |
| Accelerator Nodes |
| Number of Nodes | 12 |
| Accelerator Card | Intel KNL 7210, self-hosted mode, single socket per node |
| Memory Per Node | |
| Total Peak Performance | 31.92 TFLOPS |
| Additional Nodes |
| External Login Nodes | 5 |
| Utility Servers | 8 |
| Utility Racks | 1 |
| Storage System Configuration |
| Parallel File System | Lustre |
| IOPS per File System – Home and Scratch | 50,000+ |
| Lnet Nodes | 30 |
| Storage Array (For Home and Scratch) | Sonexion 3000 |
| Storage Racks | 6 racks + 5 Tape library frames |
| PFS - HOME |
| Useable Storage | 6 PB @ 152 GiB/s |
| Sonexion Config | One MMU + 19 SSU |
| Lustre I/O Nodes (Embedded) | 2 MDS + 38 OSS (Active/Active config) |
| HDD Data | 6 TB – 7.2K RPM on GridRAID (RAID 6) |
| HDD Metadata | 900 GB – 10K RPM on RAID 10 |
| Number of Files per MMU | 4B+ |
| PFS - SCRATCH |
| Useable Storage | 637 TiB @ 34 GiB/s |
| Sonexion Config | One MMU + 3 SSU |
| Lustre I/O Nodes (Embedded) | 2 MDS + 6 OSS (Active/Active config) |
| HDD Data | 4 TB – 10K RPM on GridRAID (RAID 6) |
| HDD Metadata | 900 GB – 10K RPM on RAID 10 |
| Number of Files per MMU | 4B+ |
| HSM/Arcive Tier |
| Archive Useable | 16.86 PB @ 10 GiB/s |
| Storage Array Disk Cache for HSM | NetApp E5600 series (233 TiB @ 20 GB/s) |
| SM Servers | 2 Metadata controllers + 2 Connection Managers + 4 connector Agents + 2 External gateways |
| Tape Library | | SpectraLogic TFinity
| Number of drives LTO-7 | 48 |
| Media LTO-7 Qty/Slots | 3640 |
| HSM Solution | Versity VSM 1.0 |
| Software Stack |
| Cray Linux Environment | 6.x |
| Cray Programming Environment (CPE) | 10 Seats |
| Intel Parallel Studio XE Professional Edition | 2 Seats |
| Workload Manager | PBS Pro 13.0 |
| Additional/Optional debugger | 2048 core |
| PV-View License | 1 |
