logo

EnterTheGrid - Primeur Weekly

EnterTheGrid - Primeur is the premier Grid and Supercomputing information source in the world. Primeur Weekly delivers the news each week in your e-mail box.

>Primeur Magazine
>PrimeurLive!
>EnterTheGrid
>Analysis
>Backissues
>Calendar
>Subscribe
>Advertise
>Contact
Primeur Weekly 11 July 2005
>Special
>How do you build a supercomputer? Together!
>RV-NRW coordinates HPC and Grid in North Rhein Westphalia
>The Paderborn hpcLine cluster: a marriage of Intel and AMD processors
>PC2 - Paderborn Centre for Parallel Computing
>Japan on its way to petascale computing
>What supercomputers still cannot do
>Focus
>Steve Scott, Chief Technology Officer, Cray interviewed by Christopher Lazou
>EuroFlash
>Astronomy looks into the future: the role of European Infrastructures
>New offspring in the PRIMERGY 64-bit server family
>Grid computing and virtual collaboration begins to realise its international potential
>CD-adapco accelerates its software and consulting business with additional Cray XD1 supercomputers
>USFlash
>Australia's no. 1 supercomputer now available to researchers at APAC National Facility
>TORQUE 1.2.0p5 for Linux
>Sun Microsystems to work with US NLR to extend Grid computing
>Massively Parallel Technologies announces successful early beta testing of bioinformatics solution
>Army approves General Dynamics/Lockheed Martin system design for Warfighter Information Network-Tactical (WIN-T)
>California State Automobile Association chooses Callidus and IBM to transform incentive compensation into strategic asset
>Improved storm forecast capability demonstrated in a multi-partner programme at the Center for Analysis and Prediction of Storms and the Pittsburgh Supercomputing Center
>SANRAD and emBoot team to deliver iSCSI diskless boot
>Oracle announces general availability of Oracle Database 10g Release 2
>Salesforce.com's 267,000 subscribers to go On Demand with Oracle Grid
>SGI attacks mid-range market with aggressively priced server and storage offerings
The Paderborn hpcLine cluster: a marriage of Intel and AMD processors
Paderborn 21 June 2005

At the inauguration in Paderborn of the new hpcLine cluster, PC2 manager Jens Simon explained the design choices made in the cluster and showed some benchmark results. With 1,978 Tflop/s of Linpack performance, the machine ranks at position 205 of the TOP500 list of the world's most powerful supercomputers.

Advertisement
Visit our sponsors
Advertisement
Visit our sponsors

The basic architecture consists of a number of computational nodes, a number of visualisation nodes, an Infiniband interconnect, and FC Raid disks. The system can support several visualisation devices, including a rear projection stereoscopic wall and Inifinity wall, and a tiled display. It will also be connected to the Grid, allowing remote visualisation and computational steering.

The system is designed to support interactive visualisation (computational steering) of large simulations. Therefore there were minimum requirements on the number and performance of the visualisation nodes, the storage capacity, and the interconnect speed. For the number of computional nodes the choice was: as many fast processors as we can afford.

The 8 visualisation nodes consist of 2,4 Ghz dual AMD Opterons with nVidia Quadro FX 4500 PCI-e graphic cards and 12 Gbyte of main memory. The 200 compute nodes each have 3,2 GHz dual Intel Xeon processors with 2 Gbyte of main memory. Infiniband is connected through HCA PCI-e boards. There is a 216 port Infiniband switch. The system has 5 Tbyte of FC-Raid and a 10 Tbyte parallel filesystem.

The stereoscopic visualisation system has been built in one of the PC2's conference rooms. It consists of a 1,80m by 2,40m projection screen, with back side projection. The resolution is 1400 x 1050 pixels and tracking is through infrared, that can be on the VR-glasses or the fly-stick. Two of the hpcLine's visualisation nodes are needed for the visualisation projection system.

Cooling the large hpcLine system was a design problem. At 2,6 Tflop/s of computing speed, the system needs 70 kW of electricity power. And as we know that has to come out as heat one way or the other. The computer room at PC2 had only 60kW of air cooling power. Hence the choice was to install a special water cooling system, just for the new computer, or come up with some other idea. The latter was done. The processors generate about 60% of the heat. They are directly cooled and that cooling system is through a heat exchange linked to the buildings climate system. Although the latter has a relatively high temperature (as it is not designed to deliver low temperatures) of 24-30oC, this proves to be enough to let the hpcLine's residual cooling requirements fit into the air cooling's capacity.

The compute node design allows for later inclusion of other special processors, like FPGA's, GPU's or Cell processors.

The system has a large collection of software and tools. The access is through the CCS management software: the computer centre management software is designed by the PC2. The operating system is Linux Redhat AS release 4. Compilers include the usal GNU gcc compiler and the Intel C/C++ and Fortran compilers. Both Scali MPI and MPICH are supported. Scientific libraries include Intel MKL and Atlas. padViz and Amira are available for scientific visualisation.

Simon concluded his presentation by giving a number of benchmarks results, including SPEC results, NAS parallel benchmark and Linpack benchmark results.

The main purpose of the system is in exploring interactive visualisation and computational steering, which are difficult to capture in simple benchmarking figures. PC2 and its users are already setting up a number of projects to use the system's capacity.

Advertisement
Visit our sponsors
Advertisement
Visit our sponsors
Ad Emmen

EnterTheGrid - Primeur

James Stewartstraat 248

1325 JN Almere

The Netherlands

http://www.hoise.com/primeur

mailto:primeur@hoise.com

© EnterTheGrid - Primeur Weekly