Table Of ContentSSSeeerririeieess s I ISISSSSSNNN:: : 1 11999333555---333222333555 NNN
EEE MMM
MMM
III
SSSYYYNNNTTTHHHEEESSSIIISSS LLLEEECCCTTTUUURRREEESSS OOONNN RORORO &&&CCC MMMooorrrgggaaannn& & & CCClllaaayyypppoooooolll PPPuuubbbllliiissshhheeerrrsss
VVV
SSS
CCCOOOMMMPPPUUUTTTEEERRR AAARRRCCCHHHIIITTTEEECCCTTTUUURRREEE KYKYKY
• T • T • T
UUU
LLL
LLL
SSS
SSSeeerrriiieeesss E EEdddiiitttooorrr::: M MMaaarrrkkk D DD.. . H HHiilillll,l, , U UUnnniiivvveeerrrsssiiitttyyy o oofff W WWiiissscccooonnnsssiiinnn ENENEN
MMMuuullltttiiittthhhrrreeeaaadddiiinnnggg
MMMuuullltttiiittthhhrrreeeaaadddiiinnnggg AAArrrccchhhiiittteeeccctttuuurrreee
MMMaaarrriioioo N NNeeemmmiirirrooovvvssskkkyyy,, , I IICCCRRREEEAAA R RReeesseseeaaarrrcchchh P PPrrroooffefeesssssosoorr,r, , B BBaaarrrccceeelloloonnnaaa S SSuuupppeeerrrcccooommmpppuuutteteerrr C CCeeennntteteerrr
AAArrrccchhhiiittteeeccctttuuurrreee
DDDeeeaaannn M MM.. . T TTuuulllllslsseeennn,, , U UUnnniivivveeerrrssisitittyyy o ooff f C CCaaallilififofoorrrnnniiaiaa,, , S SSaaannn D DDiieieegggooo
MMMuuulltlttiititthhhrrreeeaaadddeeeddd a aarrrccchhhiititteeeccctttuuurrreeesss n nnooowww a aappppppeeeaaarrr a aacccrrrooossssss t tthhheee e eennntttiirirreee r rraaannngggeee o ooff f c ccooommmpppuuutttiininnggg d ddeeevvviicicceeesss,, , f ffrrrooommm t tthhheee
hhhiigigghhheeessstt-t--pppeeerrrffofoorrmrmmiininnggg g ggeeennneeerraraall l p ppuuurrrpppooossseee d ddeeevvviicicceeesss t totoo l loloowww---eeennnddd e eemmmbbbeeeddddddeeeddd p pprrorooccceeessssssooorrsrss.. . M MMuuulltltititiththhrrereeaaadddiininnggg e eennnaaabbblleleesss
aaa p pprrroooccceeessssssooorrr c ccooorrreee t totoo m mmooorrreee e eefffffefeecccttitivivveeellylyy u uuttitilililizizzeee i ititstss c ccooommmpppuuuttataattitioioonnnaaall l r rreeesssooouuurrrccceeesss,, , a aasss a aa s ssttataalllll l i ininn o oonnneee t ththhrrreeeaaaddd n nneeeeeeddd
MMM
nnnooott t c ccaaauuussseee e eexxxeeecccuuuttitioioonnn r rereesssooouuurrcrcceeesss t totoo b bbeee i ididdllelee.. . T TThhhiisiss e eennnaaabbblleleesss t ththheee c ccooommmpppuuutteteerr r a aarrcrcchhhiititeteeccctt t t totoo m mmaaaxxxiimimmiizizzeee p ppeeerrrffofoorrmrmmaaannnccceee ULULUL
TTT
wwwiitiththhiininn a aarrreeeaaa c ccooonnnsssttrtrraaaiininnttstss,, , p ppooowwweeerrr c ccooonnnsssttrtrraaaiininnttstss,, , o oorrr e eennneeerrrgggyyy c ccooonnnsssttrtrraaaiininnttstss.. . H HHooowwweeevvveeerr,r, , t ththheee a aarrrccchhhiititeteecccttutuurrraaall l o oopppttitioioonnnsss ITITIT
HHH
ffofoorrr t ththheee p pprrroooccceeessssssooorrr d ddeeesssiigiggnnneeerrr o oorrr a aarrrccchhhiititeteeccctt t l loloooookkkiininnggg t totoo i imimmppplleleemmmeeennntt t m mmuuulltltititiththhrrreeeaaadddiininnggg a aarrreee q qquuuiititetee e eexxxtteteennnsssiivivveee a aannnddd RERERE
AAA
vvvaaarrriieieeddd,, , aaasss eeevvviididdeeennnccceeeddd nnnooottt ooonnnllylyy bbbyyy ttthhheee rrreeessseeeaaarrrccchhh llilititteeerrraaatttuuurrreee bbbuuuttt aaallslssooo bbbyyy ttthhheee vvvaaarrriieieetttyyy ooofff cccooommmmmmeeerrrccciiaiaalll DDD
INININ
iimimmppplleleemmmeeennnttataattitioioonnnsss... GGG
A A A
RRR
TTThhhiisiss b bbooooookkk i ininnttrtrroooddduuuccceeesss t ththheee b bbaaasssiicicc c ccooonnnccceeepppttstss o ooff f m mmuuulltltititiththhrrreeeaaadddiininnggg,, , d ddeeessscccrrriibibbeeesss t ththheee a aa n nnuuummmbbbeeerrr o ooff f m mmooodddeeellslss o oofff CCC
HHH
mmmuuulltltititiththhrrereeaaadddiininnggg,, , a aannnddd t ththheeennn d ddeeevvveeelloloopppsss t ththheee t ththhrrereeeee c ccllalaassssssiicicc m mmooodddeeellslss ( (c(ccoooaaarrrssseee---gggrrraaaiininn,, , fi fifinnneee---gggrrraaaiininn,, , a aannnddd s ssiimimmuuulltltataannneeeooouuusss ITITIT MMMaaarrriiiooo NNNeeemmmiiirrrooovvvssskkkyyy
EEE
CCC
mmmuuulltltititiththhrrreeeaaadddiininnggg))) i ininn g ggrrreeeaaatteteerrr d ddeeettataaiilil.l. . I IItt t d ddeeessscccrrriibibbeeesss a aa w wwiididdeee v vvaaarrriieieetttyyy o ooff f a aarrrccchhhiititeteecccttutuurrraaall l a aannnddd s ssooofffttwtwwaaarrreee d ddeeesssiigiggnnn TTT
UUU
RRR DDDeeeaaannn MMM... TTTuuullllllssseeennn
ttrtrraaadddeeeooofffffsfss,, , a aasss w wweeelllll l a aasss o ooppppppooorrrttutuunnniitititieieesss s sspppeeeccciifiifificcc t totoo m mmuuulltltititiththhrrereeaaadddiininnggg a aarrcrcchhhiititeteecccttutuurrereesss.. . F FFiininnaaalllllylyy,, , i itit t d ddeeettataaiililslss a aa n nnuuummmbbbeeerrr EEE
)))
oooff f i imimmpppooorrrttataannntt t c ccooommmmmmeeerrrccciiaiaall l a aannnddd a aacccaaadddeeemmmiicicc h hhaaarrrdddwwwaaarrreee i imimmppplleleemmmeeennnttataattitioioonnnsss o ooff f m mmuuulltltititiththhrrreeeaaadddiininnggg...
AAAbbbooouuuttt S SSYYYNNNTTTHHHEEESSSIIIsss
TTThhhiisiss v vvooolluluummmeee i isiss a aa p pprririninntteteeddd v vveeerrsrssiioioonnn o ooff f a aa w wwooorrkrkk t ththhaaatt t a aappppppeeeaaarrsrss i ininn t ththheee S SSyyynnntththheeessisisiss
DDDiigiggiititataall l L LLiibibbrrraaarrryyy o ooff f E EEnnngggiininneeeeeerrriininnggg a aannnddd C CCooommmpppuuutteteerrr S SSccicieieennnccecee.. . S SSyyynnntththheeessisisis s L LLeeecccttutuurrereesss MMM
OOO
ppprroroovvviididdeee c ccooonnnccciisisesee, , ,o oorririgiggiininnaaall l p pprrereesseseennnttataattitioioonnnss s o ooff f i imimmpppooorrtrtataannntt t r rereesseseeaaarrcrcchhh a aannnddd d ddeeevvveeelloloopppmmmeeennnttt
RRR
ttotoopppiiciccss,s , ,p ppuuubbbllilisishshheeeddd q qquuuiicicckkkllyly,y , ,i ininn d ddiigiggiititataall l a aannnddd p pprririninntt t f fofoorrmrmmaaattsts.s . .F FFooorr r m mmooorreree i ininnffofoorrmrmmaaattitioioonnn GGG
AAA
vvviisisisitit t w wwwwwwww..m.mmooorrrgggaaannncccllalaayyypppooooooll.l.c.ccooommm NNN
&&&
CCC SSSYYYNNNTTTHHHEEESSSIIISSS LLLEEECCCTTTUUURRREEESSS OOONNN
IIISSSBBBNNN::: 999777888---111---666000888444555---888555555---444
MMMooorrrgggaaannn & & & CCClllaaayyypppoooooolll PPPuuubbbllliiissshhheeerrrsss 999000000000000 LAYLAYLAY CCCOOOMMMPPPUUUTTTEEERRR AAARRRCCCHHHIIITTTEEECCCTTTUUURRREEE
PPP
wwwwwwwww...mmmooorrrgggaaannnccclllaaayyypppoooooolll...cccooommm OOO
999777888111666000888444555888555555444 OOO
LLL MMMaaarrrkkk D DD.. . H HHiiilllll,l, , SSSeeerrriiieeesss E EEdddiiitttooorrr
Multithreading Architecture
Synthesis Lectures on Computer
Architecture
Editor
MarkD.Hill,UniversityofWisconsin
SynthesisLecturesonComputerArchitecturepublishes50-to100-pagepublicationsontopics
pertainingtothescienceandartofdesigning,analyzing,selectingandinterconnectinghardware
componentstocreatecomputersthatmeetfunctional,performanceandcostgoals.Thescopewill
largelyfollowthepurviewofpremiercomputerarchitectureconferences,suchasISCA,HPCA,
MICRO,andASPLOS.
MultithreadingArchitecture
MarioNemirovskyandDeanM.Tullsen
2012
PerformanceAnalysisandTuningforGeneralPurposeGraphicsProcessingUnits(GPGPU)
HyesoonKim,RichardVuduc,SaraBaghsorkhi,JeeChoi,andWen-meiHwu
2012
AutomaticParallelization:AnOverviewofFundamentalCompilerTechniques
SamuelP.Midkiff
2012
PhaseChangeMemory:FromDevicestoSystems
MoinuddinK.Qureshi,SudhanvaGurumurthi,andBipinRajendran
2011
Multi-CoreCacheHierarchies
RajeevBalasubramonian,NormanP.Jouppi,andNaveenMuralimanohar
2011
APrimeronMemoryConsistencyandCacheCoherence
DanielJ.Sorin,MarkD.Hill,andDavidA.Wood
2011
DynamicBinaryModification:Tools,Techniques,andApplications
KimHazelwood
2011
iv
QuantumComputingforComputerArchitects,SecondEdition
TzvetanS.Metodi,ArvinI.Faruque,andFredericT.Chong
2011
HighPerformanceDatacenterNetworks:Architectures,Algorithms,andOpportunities
DennisAbtsandJohnKim
2011
ProcessorMicroarchitecture:AnImplementationPerspective
AntonioGonzález,FernandoLatorre,andGrigoriosMagklis
2010
TransactionalMemory,2ndedition
TimHarris,JamesLarus,andRaviRajwar
2010
ComputerArchitecturePerformanceEvaluationMethods
LievenEeckhout
2010
IntroductiontoReconfigurableSupercomputing
MarcoLanzagorta,StephenBique,andRobertRosenberg
2009
On-ChipNetworks
NatalieEnrightJergerandLi-ShiuanPeh
2009
TheMemorySystem:YouCan’tAvoidIt,YouCan’tIgnoreIt,YouCan’tFakeIt
BruceJacob
2009
FaultTolerantComputerArchitecture
DanielJ.Sorin
2009
TheDatacenterasaComputer:AnIntroductiontotheDesignofWarehouse-ScaleMachines
LuizAndréBarrosoandUrsHölzle
2009
ComputerArchitectureTechniquesforPower-Efficiency
StefanosKaxirasandMargaretMartonosi
2008
ChipMultiprocessorArchitecture:TechniquestoImproveThroughputandLatency
KunleOlukotun,LanceHammond,andJamesLaudon
2007
v
TransactionalMemory
JamesR.LarusandRaviRajwar
2006
QuantumComputingforComputerArchitects
TzvetanS.MetodiandFredericT.Chong
2006
Copyright©2013byMorgan&Claypool
Allrightsreserved.Nopartofthispublicationmaybereproduced,storedinaretrievalsystem,ortransmittedin
anyformorbyanymeans—electronic,mechanical,photocopy,recording,oranyotherexceptforbriefquotationsin
printedreviews,withoutthepriorpermissionofthepublisher.
MultithreadingArchitecture
MarioNemirovskyandDeanM.Tullsen
www.morganclaypool.com
ISBN:9781608458554 paperback
ISBN:9781608458561 ebook
DOI10.2200/S00458ED1V01Y201212CAC021
APublicationintheMorgan&ClaypoolPublishersseries
SYNTHESISLECTURESONCOMPUTERARCHITECTURE
Lecture#21
SeriesEditor:MarkD.Hill,UniversityofWisconsin
SeriesISSN
SynthesisLecturesonComputerArchitecture
Print1935-3235 Electronic1935-3243
Multithreading Architecture
Mario Nemirovsky
ICREAResearchProfessorattheBarcelonaSupercomputerCenter
Dean M.Tullsen
Professor,UniversityofCalifornia,SanDiego
SYNTHESISLECTURESONCOMPUTERARCHITECTURE#21
M
&C Morgan &cLaypool publishers
ABSTRACT
Multithreaded architectures now appear across the entire range of computing devices, from the
highest-performinggeneralpurposedevicestolow-endembeddedprocessors.Multithreadingen-
ablesaprocessorcoretomoreeffectivelyutilizeitscomputationalresources,asastallinonethread
need not cause execution resources to be idle.This enables the computer architect to maximize
performancewithinareaconstraints,powerconstraints,orenergyconstraints.However,thearchi-
tectural options for the processor designer or architect looking to implement multithreading are
quiteextensiveandvaried,asevidencednotonlybytheresearchliteraturebutalsobythevarietyof
commercialimplementations.
Thisbookintroducesthebasicconceptsofmultithreading,describestheanumberofmodels
ofmultithreading,andthendevelopsthethreeclassicmodels(coarse-grain,fine-grain,andsimul-
taneous multithreading) in greater detail.It describes a wide variety of architectural and software
designtradeoffs,aswellasopportunitiesspecifictomultithreadingarchitectures.Finally,itdetailsa
numberofimportantcommercialandacademichardwareimplementationsofmultithreading.
KEYWORDS
multithreading
