Table Of ContentMitsuhisa Sato E ditor
Advanced Software
Technologies for
Post-Peta Scale
Computing
The Japanese Post-Peta CREST Research
Project
Advanced Software Technologies for Post-Peta
Scale Computing
Mitsuhisa Sato
Editor
Advanced Software
Technologies for Post-Peta
Scale Computing
The Japanese Post-Peta CREST Research
Project
123
Editor
MitsuhisaSato
RIKENCenterforComputationalScience
Kobe,Japan
ISBN978-981-13-1923-5 ISBN978-981-13-1924-2 (eBook)
https://doi.org/10.1007/978-981-13-1924-2
LibraryofCongressControlNumber:2018959846
©SpringerNatureSingaporePteLtd.2019
Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpartof
thematerialisconcerned,specificallytherightsoftranslation,reprinting,reuseofillustrations,recitation,
broadcasting,reproductiononmicrofilmsorinanyotherphysicalway,andtransmissionorinformation
storageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilarmethodology
nowknownorhereafterdeveloped.
Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication
doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant
protectivelawsandregulationsandthereforefreeforgeneraluse.
Thepublisher,theauthorsandtheeditorsaresafetoassumethattheadviceandinformationinthisbook
arebelievedtobetrueandaccurateatthedateofpublication.Neitherthepublishernortheauthorsor
theeditorsgiveawarranty,expressorimplied,withrespecttothematerialcontainedhereinorforany
errorsoromissionsthatmayhavebeenmade.Thepublisherremainsneutralwithregardtojurisdictional
claimsinpublishedmapsandinstitutionalaffiliations.
ThisSpringerimprintispublishedbytheregisteredcompanySpringerNatureSingaporePteLtd.
The registered company address is: 152 Beach Road, #21-01/04 Gateway East, Singapore 189721,
Singapore
Preface
Computational Science, which enables us to explore uncharted fields of science
through applications of high performance computing, is a third paradigm of
scientificresearchwhichhasbecomeindispensableforthedevelopmentofscience
andtechnologyofthetwenty-firstcentury.
Computational Science has been making great progress rapidly. The computa-
tional capability of supercomputers is now reaching on the verge of surpassing a
Peta-flops(1015 floatingoperationspersecond).Thisadvanceallowsusinmaking
it possible to explore a wide range of phenomena through computer simulations
which was impossible in the past, for example, the creation and evolution of
the universe, the quantum origin of the functions of nano- and biomaterials
and its implication to life, and global climate changes. At the same time, the
development of intelligent information processing technologies is beginning to
enableahandlingandanalysisofenormousamountofdata,whichareaccelerating
discoveries in many science disciplines, such as genome analyses, high energy
acceleratorexperiments,astronomicalobservations,andsatelliteobservationofgeo-
environments. In short, computational science is rapidly developing into a unified
frameworkinwhichlarge-scalemodelingandsimulation,large-scaledataanalysis,
andexperiments/observationareintegratedtogethertosolvegrandchallengeissues
in various branches of science. As such, computational science has now become
anindispensabletooltobetterunderstandnature,life,andenvironmentinorderto
createabetterfutureformankind.
In Japan, the importance of computational sciences was explicitly noted in the
JapaneseGovernment’sThirdBasicPlanofScienceandTechnology(2006–2010),
andanationalprojectforthedevelopmentof“NextGenerationSupercomputer”has
beencarriedoutfrom2006asoneofthekeytechnologiesofnationalimportance.
The K computer has been produced as a major result of the project, achieving
world’sbestperformanceinTOP500listin2011.Currently,theFLAGSHIP2020
project for the development of the next Japanese flagship supercomputer has been
launchedin2014,andthedevelopmentisunderway.Theoperationforthepublic
servicewillbescheduledaround2020.
v
vi Preface
In2010,theJapanScienceandTechnologyAgency(JST)hasinitiatedaresearch
area, titled “Development of System Software Technologies for Post-Peta Scale
High Performance Computing,” as a part of its Strategic Basic Research Program
(CREST). The project was named “JST CREST Post-Petascale software project.”
Theresearchareaoftheprojectaimedatdevelopingsystemsoftwaretechnologies
as well as related systems to be used for high performance computing systems
including the next generations of the Japanese flagship system, the K computer,
whichisunderdevelopment.Severalresearchesanddevelopmentswereconducted
for system software enabling us to exploit maximum efficiency and performance
from supercomputers composed of general purpose many-core processors as well
as accelerators such as GPUs and FPGA. From 2010 to 2012, 14 research teams
were selected, and 5-year research has been being conducted by each research
team. Many Japanese researchers and graduate students related to HPC have been
participatingintheseresearchteams.
ThisbookdescribesthemajoroutcomesobtainedbyresearchteamsoftheJST
CRESTpost-petascalesoftwareproject.
Advancedsystemsoftwareisthekeytechnologyforpost-petascaleandexascale
high performance computing systems which will be developed in next decade. I
hope that the technologies developed in the JST CREST post-petascale software
projectwillplayarolebridgingtoexascalecomputingandbeyondthroughsystem
softwaretechnologiesandadvancethefuturecomputationalscience.
Kobe,Japan MitsuhisaSato
May2018
Contents
1 JST CREST Post-petascale Software Project Bridging
toExascaleComputing..................................................... 1
MitsuhisaSato
2 ppOpen-HPC/pK-Open-HPC: Application Development
FrameworkwithAutomaticTuning(AT)................................ 11
Kengo Nakajima, Masaharu Matsumoto, Masatoshi Kawai,
Takahiro Katagiri, Takashi Arakawa, Hisashi Yashiro,
andAkihiroIda
3 ScalableEigen-AnalysisEngineforLarge-ScaleEigenvalue
Problems..................................................................... 37
TetsuyaSakurai,YasunoriFutamura,AkiraImakura,andToshiyuki
Imamura
4 SystemSoftwareforMany-CoreandMulti-coreArchitecture........ 59
AtsushiHori,YuichiTsujita,AkioShimada,KazumiYoshinaga,
Namiki Mitaro, Go Fukazawa, Mikiko Sato, George Bosilca,
AurélienBouteiller,andThomasHerault
5 Highly Productive, High Performance Application
FrameworksforPostPetascaleComputing ............................. 77
Naoya Maruyama, Takayuki Aoki, Kenjiro Taura, Rio Yokota,
Mohamed Wahib, Motohiko Matsuda, Keisuke Fukuda,
Takashi Shimokawabe, Naoyuki Onodera, Michel Müller,
andShintaroIwasaki
6 SystemSoftwareforData-IntensiveScience............................. 99
OsamuTatebe,YoshihiroOyama,MasahiroTanaka,HirokiOhtsuji,
FuyumasaTakatsu,andXiemingLi
7 ApproachesforMemory-EfficientCommunicationLibrary
andRuntimeCommunicationOptimization ............................ 121
TakeshiNanri
vii
viii Contents
8 ADevelopmentPlatformforEmbeddedDomain-Specific
Languages ................................................................... 139
ShigeruChiba,YungYuZhuang,andThanh-ChungDao
9 Xevolver:AUser-DefinedCodeTransformationApproach
toStreamliningLegacyCodeMigration................................. 163
Hiroyuki Takizawa, Reiji Suda, Daisuke Takahashi,
andRyusukeEgawa
10 NumericalLibraryBasedonHierarchicalDomainDecomposition.. 183
Ryuji Shioya, Masao Ogino, Yoshitaka Wada, Kohei Murotani,
Seiichi Koshizuka, Hiroshi Kawai, Shin-ichiro Sugimoto,
andAmaneTakei
11 Advanced Computing and Optimization
Infrastructure for Extremely Large-Scale Graphs
onPost-peta-scaleSupercomputers....................................... 207
KatsukiFujisawa,ToyotaroSuzumura,HitoshiSato,KojiUeno,
Satoshi Imamura, Ryo Mizote, Akira Tanaka, Nozomi Hata,
andToshioEndo
12 Software Technology That Deals with Deeper Memory
HierarchyinPost-petascaleEra .......................................... 227
ToshioEndo,HirokoMidorikawa,andYukinoriSato
13 PowerManagementFrameworkforPost-petascale
Supercomputers ............................................................ 249
MasaakiKondo,IkuoMiyoshi,KojiInoue,andShinobuMiwa
14 ProjectCASSIA—FrameworkforExhaustiveandLarge-Scale
SocialSimulation— ........................................................ 271
Itsuki Noda, Yohsuke Murase, Nobuyasu Ito, Kiyoshi
Izumi, Hiromitsu Hattori, Tomio Kamada, Hideyuki Mizuta,
andMikioTakeuchi
15 GPUAcceleratedLanguageandCommunicationSupport
byFPGA..................................................................... 301
TaisukeBoku,ToshihiroHanawa,HitoshiMurai,MasahiroNakao,
YoheiMiki,HideharuAmano,andMasayukiUmemura
Chapter 1
JST CREST Post-petascale Software
Project Bridging to Exascale Computing
MitsuhisaSato
Abstract JSTCRESTpost-petascalesoftwareprojectaimedtoestablishsoftware
technologies to explore extreme performance computing beyond petascale com-
puting, on the road to exascale computing. Several research and development has
been conducted for system software enabling us to exploit maximum efficiency
and reliability from high-performance computing systems composed of general-
purpose many-core processors as well as accelerators including GPGPU from
the second half of the 2010s to 2020s. The research topics cover from system
software such as programming languages, compilers, runtime systems, operating
systems, communication middleware, and file systems to application development
supportsoftwareandultra-largedataprocessingsoftware.Aswellasconventional
technologies for large-scale numerical computation, the project was also able to
address the storage technology required for big data processing, the complexity
of memory hierarchy, and the power problem. Exploration for the direction of
future high-performance computing is also an urgent and significant agenda in
our research area. This chapter presents the outline of JST CREST post-petascale
softwareprojectwithbriefdescriptionoftheresearchtopics,followedbysummary
ofresultsandachievements.
1.1 Trends ofHigh-PerformanceComputing
High-performance computing systems used for cutting edge of advanced compu-
tational have reached several petaflops (a million billion calculations per second)
performance and will be targeted to the next generation of exascale systems as a
post-petascale system. Scientific applications require increasing performance for
industrialandsocietalgeneralimprovements.
M.Sato((cid:2))
RIKENCenterforComputationalScience,Kobe,Japan
e-mail:[email protected]
©SpringerNatureSingaporePteLtd.2019 1
M.Sato(ed.),AdvancedSoftwareTechnologiesforPost-PetaScaleComputing,
https://doi.org/10.1007/978-981-13-1924-2_1
2 M.Sato
Japan already has installed several petascale computers including the K com-
puter in RIKEN and now explores the evolution toward future exascale systems.
FollowingtheendoftheexistingMoorelaw,thenumberofcoreperchipincreases
andspecializedhardwarehasbeenusedtoacceleratespecifictypeofapplications.
The number of processors and the interconnecting network increase also and
we have then to face new programming problems. Post-petascale systems and
future exascale computers are expected to have an ultra-large-scale and high-
performance architecture with nodes of many-core processors and accelerators.
To manage these ultra-large-scale parallel systems, we require new sophisticated
system software technologies, allowing to manage complex parallel computations
with huge distributed data, minimizing the energy consumption, and with fault-
resilientproperties.
JST CREST post-petascale software project has been launched to establish
softwaretechnologiestoexploreextremeperformancecomputingbeyondpetascale
computing,ontheroadtoexascalecomputing.Theabilitytomanageandprogram
these future high-performance systems efficiently is considered by all research
nationalagenciesallalongtheworldasastrategicandimportantissue.
1.2 OutlineofJST CREST Post-petascaleSoftwareProject
CREST (Core Research for Evolutional Science and Technology) is a funding
program supported by JST (Japan Science and Technology Agency), which is an
independent public body of the Ministry of Education, Culture, Sports, Science
and Technology (MEXT), Japan. CREST is a funding program for team-based
researchexpectedtoproduceoutstandingresultstoleadscientificandtechnological
innovation.JSTCRESTpost-petascalesoftwareprojectisoneofCRESTprograms,
startingfrom2012.
Our research area was funded under the title of “Development of System
Software Technologies for Post-petascale High-Performance Computing.” It was
launchedbythefirstprogramresearchsupervisor,Prof.AkinoriYonezawa,RIKEN,
from2012to2014,anditwastakenovertothesecondprogramresearchsupervisor,
Prof.MitsuhisaSato,RIKEN,from2015to2018.
The research area aimed at developing software technologies as well as related
systems to be used for high-performance computing in the post generations of the
Japanese national supercomputer, the K computer. Several research and develop-
ment has been conducted for system software enabling us to exploit maximum
efficiency and reliability from high-performance computing systems composed of
general-purpose many-core processors as well as accelerators including GPGPU
from the second half of the 2010s to 2020s. In addition to the system software
such as programming languages, compilers, runtime systems, operating systems,
communication middleware, and file systems, application development support
softwareandultra-largedataprocessingsystemsarealsothetargetsforourresearch
anddevelopment.
