IBM and ASTRON 64-Bit Microserver Prototype Prepares for Big Bang's Big Data, Background information

download IBM and ASTRON 64-Bit Microserver Prototype Prepares for Big Bang's Big Data, Background information

of 22

  • date post

  • Category


  • view

  • download


Embed Size (px)


IBM and the Netherlands Institute for Radio Astronomy ASTRON have unveiled the world’s first water-cooled 64-bit microserver. The prototype, which is roughly the size of a smartphone, is part of the proposed IT roadmap for the Square Kilometre Array (SKA), an international consortium to build the world’s largest and most sensitive radio telescope. Scientists estimate that the processing power required to operate the telescope will be equal to several millions of today’s fastest computers. The microserver’s team has designed and demonstrated a prototype 64-bit microserver using a PowerPC based chip from Freescale Semiconductor running Linux Fedora and IBM DB2. At 133 × 55 mm2 the microserver contains all of the essential functions of today’s servers, which are 4 to 10 times larger in size. Not only is the microserver compact, it is also very energy-efficient. One of its innovations is hotwater cooling, which in addition to keeping the chip operating temperature below 85 degrees C, will also transport electrical power by means of a copper plate. The concept is based on the same technology IBM developed for the SuperMUC supercomputer located outside of Munich, Germany. IBM scientists hope to keep each microserver operating between 35–40 watts including the system on a chip (SOC) — the current design is 60 watts. The next step for scientists is to begin to take 128 of the microserver boards using the newest T4240 chips to create a 2U rack unit with 1536 cores and 3072 threads with up to 6 terabytes of DRAM. In addition, they will be adding an Ethernet switch and power module to the integrated water-cooling.

Transcript of IBM and ASTRON 64-Bit Microserver Prototype Prepares for Big Bang's Big Data, Background information

  • 1. The IBM/ASTRON DOME 64-bit Server Demonstrator: Findings, Status and Outlook Ronald P. Luijten Data Motion Architect IBM Research - Zurich 6 June 2014 DISCLAIMER: This presentation is entirely Ronalds view and not necessarily that of IBM.
  • 2. Definition Server: The integration of an entire server node motherboard* into a single microchip except DRAM, Nor-boot flash and power conversion logic. 3 305mm 245mm 133mmx55mm * no graphics This does NOT imply low performance!
  • 3. 2012 IBM Corporation Up to 2 Million+ Antennas What does this mean? 4 SKA: Largest Radio-astronomy antenna !Big data on Steroids
  • 4. ~ 10 Pb/s 86400 sec/day Central Signal Proc Science Data Proc 10..14 ExaByte/day ? ~ 1 PB/Day. Prelim. Spec. SKA, R.T. Schilizzi et al. 2007 / Chr. Broekema ? 5
  • 5. 22001142 IIBBMM CCoorrppoorraattioionn ~ 10 Pb/s 86400 sec/day 10..14 ExaByte/day CSP SDP ? ~ 1 PB/Day. 330 disks/day 120000 disks/yr ? Top-500 Supercomputing(11/2013). 0.3Watt/Gflop/s !Todays industry focus is 1 Eflop @ 20MW. (2018) "( 0.02 Gflop/s) "Most recent data from SKA: "CSP.max. power 7.5MW "SDP.max. power 1 MW "Latest need for SKA 4 Exaflop (SKA1 - Mid) " 1.2GW80MW Too easy (for us) Too hard Moores law Factor 80-1200 6 !multiple breakthroughs needed
  • 6. DOME Project: 5 Years, 33M Euro User Platform 2012 2013 IBIBMM C Coorrppoorraatitoionn Algorithms & Machines Ronald P. Luijten HPC User Forum April 2014 7 IBM at CeBIT 2013 Rethink your business 7 System Analysis Data & Streaming Sustainable (Green) Computing Nanophotonics Computing Transport Storage -Nanophotonics -Real Time Communications -Compressive Sampling -Microservers -Accelerators -Access Patterns -Student projects -Events -Research Collaboration IBM / ASTRON DOME project Technology roadmap development
  • 7. IBM DOME Server Motivation & Objectives Create the worlds highest density 64 bit -server drawer Useful for both SKA radio-astronomy and IBM future business Platform for Business Analytics appliance pre-product research Datacenter in-a-box Very high energy efficiency / very low cost (radioastronomers) Use commodity components only, HW + SW standards Leverage free computing paradigm Enhance with Value Add: packaging, system integration, Density and speed of light Most efficient cooling using IBM technology (ref: SuperMUC TOP500 machine) Must be true 64 bit to enable business applications Must run server class OS (SLES11 or RHEL6, or equivalent) Precluded ARM (64-bit Silicon was not available) PPC64 is available in SoC from FSL since 2011 (I am poor no $$$ for my own SoC) This is a research project capability demonstrator only 9
  • 8. 10 Compute node board form factor Standard FB-DIMM memory board 30 mm 133 mm 133 mm 55 mm
  • 9. IBM / ASTRON compute node board diagram DRAM DRAM P5020 SPI flash PSoC Power converter Power converter USB I2C Serial JTAG Multiple Ethernet SDcard SATA 11
  • 10. Compute node processor options 12 FSL SoC parts P5040 T4240 CPU GHz 2.2 1.8 CPUs 4 cores, 1 thread per core 12 cores, 2 threads per core Primary cache 32 KB I + 32 KB D per core 32 KB I + 32 KB D per core Secondary cache 512 KB I+D 2 MB per 4 CPUs L3 cache 1 MB on chip 1.5 MB on chip Memory 2 x 2 GB, DDR3/L3, ECC 3 x 2 GB, DDR3/L3, ECC core e5500, ppc64 e6500, ppc64 1 DP FP unit per core 1 DP FP unit per core 128 bit SP altivec unit per core node 45nm 28nm TDP 55W 60W T4240 DIMM connector: 2 times SATA 4 times 10 Gigabit ethernet SD card interface USB interface Some power supplies
  • 11. T4240 SoC block diagram 13
  • 12. 14 T4240 board layout FRONT Decoupling Capacitors area BACK
  • 13. Hot Water Cooling Most Energy Efficient solution: j Low TPUE possible (