IBM and ASTRON 64bit μServer for DOME

download IBM and ASTRON 64bit μServer for DOME

of 31

  • date post

  • Category


  • view

  • download


Embed Size (px)


IBM and ASTRON, the Netherlands Institute for Radio Astronomy, will unveil a prototype high-density, 64-bit microserver CPU placed on a 133 x 55 mm board running Linux. The partners are building the microserver as part of the DOME project, which is tasked with building an IT roadmap for the Square Kilometer Array, an international consortium to build the world's largest and most sensitive radio telescope. Scientists estimate that the processing power required to operate the telescope will be equal to several millions of today's fastest computers. IBM scientist Ronald Luijten (@ronaldgadget) will present the microserver in English from ASTRON's offices in Dwingeloo, The Netherlands. This was recorded on 3 July 14:00  Central European Time

Transcript of IBM and ASTRON 64bit μServer for DOME

  • 1. The DOME 64-bit Server and its Ecosystem Ronald P. Luijten Data Motion Architect IBM Research - Zurich 3 July 2014 DISCLAIMER: This presentation is entirely Ronalds view and not necessarily that of IBM.
  • 2. Definition Server: The integration of an entire server node motherboard* into a single microchip except DRAM, Nor-boot flash and power conversion logic. 2 305mm 245mm 133mmx55mm * no graphics This does NOT imply low performance!
  • 3. 2012 IBM Corporation 3 SKA (Square Kilometer Array) to measure Big Bang Picture source: NZZ march 2014 Big Bang Inflation Protons created Start of nucleosynthesis through fusion End of nucleosynthesis Modern Universe 0 10-32s 10-6s 0.01s 3min 380000 years 13.8 Billion years
  • 4. 2012 IBM Corporation Up to 2 Million+ Antennas What does this mean? 4 SKA: Largest Radio-astronomy antenna Big data on Steroids
  • 5. ~ 10 Pb/s 86400 sec/day 10..14 ExaByte/day ?? ~ 1 PB/Day. Prelim. Spec. SKA, R.T. Schilizzi et al. 2007 / Chr. Broekema ?? Science Data ProcCentral Signal Proc 5
  • 6. 2012 IBM Corporation 2014 IBM Corporation ~ 10 Pb/s 86400 sec/day 10..14 ExaByte/day ?? ~ 1 PB/Day. 330 disks/day 120000 disks/yr ?? Top-500 Supercomputing(11/2013). 0.3Watt/Gflop/s Todays industry focus is 1 Eflop @ 20MW. (2018) ( 0.02 Gflop/s) Most recent data from SKA: CSP.max. power 7.5MW SDP.max. power 1 MW Latest need for SKA 4 Exaflop (SKA1 - Mid) 1.2GW80MW Too easy (for us) Too hard Moores law Factor 80-1200 SDPCSP 6 multiple breakthroughs needed
  • 7. 7 2012 IBM Corporation DOME
  • 8. DOME Project: 5 Years, 33M Euro Ronald P. Luijten HPC User Forum April 2014 8 2012 IBM Corporation 2013 IBM Corporation IBM at CeBIT 2013 Rethink your business 8 System Analysis Data & Streaming Sustainable (Green) Computing Nanophotonics Computing Transport Storage Algorithms & Machines -Nanophotonics -Real Time Communications -Compressive Sampling -Microservers -Accelerators -Access Patterns -Student projects -Events -Research Collaboration User Platform IBM / ASTRON DOME project Technology roadmap development
  • 9. IBM DOME Server Motivation & Objectives Create the worlds highest density 64 bit -server drawer Useful for both SKA radio-astronomy and IBM future business Platform for Business Analytics appliance pre-product research Datacenter in-a-box Very high energy efficiency / very low cost (radioastronomers) Use commodity components only, HW + SW standards Leverage free computing paradigm Enhance with Value Add: packaging, system integration, Density and speed of light Most efficient cooling using IBM technology (ref: SuperMUC TOP500 machine) Must be true 64 bit to enable business applications Must run server class OS (SLES11 or RHEL6, or equivalent) Precluded ARM (64-bit Silicon was not available) PPC64 is available in SoC from FSL since 2011 (I am poor no $$$ for my own SoC) This is a research project capability demonstrator only 9
  • 10. 10 Compute node board form factor 133 mm 30 mmStandard FB-DIMM memory board 133 mm 55 mm
  • 11. P5020 DRAM DRAM PSoC SPI flash Power converter Power converter USB JTAG Serial I2C Multiple Ethernet SDcard SATA IBM / ASTRON compute node board diagram 11
  • 12. P5020 DRAM DRAM PSoC SPI flash Power converter Power converter USB JTAG Serial I2C Multiple Ethernet SDcard SATA IBM / ASTRON compute node board diagram 12 PSOC collapses 6 functions into a small chip to save Area, Power and Cost 1. On/Off and Power up sequencing 2. Provide uServer boot configuration 3. JTAG debug access 4. Serial port access (Linux) 5. Temperature monitoring and protection 6. Management interface and control
  • 13. Compute node processor options 13 FSL SoC parts P5040 T4240 CPU GHz 2.2 1.8 CPUs 4 cores, 1 thread per core 12 cores, 2 threads per core Primary cache 32 KB I + 32 KB D per core 32 KB I + 32 KB D per core Secondary cache 512 KB I+D 2 MB per 4 CPUs L3 cache 1 MB on chip 1.5 MB on chip Memory 2 x 2 GB, DDR3/L3, ECC 3 x 2 GB, DDR3/L3, ECC core e5500, ppc64 e6500, ppc64 1 DP FP unit per core 1 DP FP unit per core 128 bit SP altivec unit per core node 45nm 28nm TDP 55W 60W T4240 DIMM connector: 2 times SATA 4 times 10 Gigabit ethernet SD card interface USB interface Some power supplies
  • 14. T4240 SoC block diagram 14
  • 15. Hot Water Cooling Most Energy Efficient solution: Low PUE possible (