Video Compression and Communications: From Basics to H.261, H.263, H.264, MPEG4 for DVB and HSDPA-Style Adaptive Turbo-Transceivers

704 Pages·2007·10.98 MB·English

by  Lajos Hanzo

Video Compression and Communications

Video Compression and
Communications
From Basics to H.261, H.263, H.264,
MPEG4 for DVB and HSDPA-Style
Adaptive Turbo-Transceivers
Second Edition
L. Hanzo, P. J. Cherriman and J. Streit
Allof
UniversityofSouthampton,UK
IEEE Communications Society, Sponsor
John Wiley & Sons, Ltd
Copyright(cid:1)c 2007 JohnWiley&SonsLtd,TheAtrium,SouthernGate,Chichester,
WestSussexPO198SQ,England
Telephone [phone]
Email(forordersandcustomerserviceenquiries):[email protected]
VisitourHomePageonwww.wiley.com
AllRightsReserved.Nopartofthispublicationmaybereproduced,storedinaretrievalsystemortransmittedin
anyformorbyanymeans,electronic,mechanical,photocopying,recording,scanningorotherwise,exceptunder
thetermsoftheCopyright,DesignsandPatentsAct1988orunderthetermsofalicenceissuedbytheCopyright
LicensingAgencyLtd,90TottenhamCourtRoad,LondonW1T4LP,UK,withoutthepermissioninwritingofthe
Publisher.RequeststothePublishershouldbeaddressedtothePermissionsDepartment,JohnWiley&SonsLtd,
TheAtrium,SouthernGate,Chichester,WestSussexPO198SQ,England,[email protected],or
faxedto([phone].
Designationsusedbycompaniestodistinguishtheirproductsareoftenclaimedastrademarks.Allbrandnamesand
productnamesusedinthisbookaretradenames,servicemarks,trademarksorregisteredtrademarksoftheir
respectiveowners.ThePublisherisnotassociatedwithanyproductorvendormentionedinthisbook.All
trademarksreferredtointhetextofthispublicationarethepropertyoftheirrespectiveowners.
Thispublicationisdesignedtoprovideaccurateandauthoritativeinformationinregardtothesubjectmatter
covered.ItissoldontheunderstandingthatthePublisherisnotengagedinrenderingprofessionalservices.If
professionaladviceorotherexpertassistanceisrequired,theservicesofacompetentprofessionalshouldbesought.
OtherWileyEditorialOffices
JohnWiley&SonsInc.,111RiverStreet,Hoboken,NJ07030,USA
Jossey-Bass,989MarketStreet,SanFrancisco,CA94103-1741,USA
Wiley-VCHVerlagGmbH,Boschstr.12,D-69469Weinheim,Germany
JohnWiley&SonsAustraliaLtd,42McDougallStreet,Milton,Queensland4064,Australia
JohnWiley&Sons(Asia)PteLtd,2ClementiLoop#02-01,JinXingDistripark,Singapore129809
JohnWiley&SonsCanadaLtd,22WorcesterRoad,Etobicoke,Ontario,CanadaM9W1L1
Wileyalsopublishes itsbooksinavariety ofelectronic formats.Somecontent thatappears inprintmaynotbe
availableinelectronicbooks.
IEEECommunicationsSociety,Sponsor
COMMS-SLiaisontoIEEEPress,MostafaHashemSherif
LibraryofCongressCataloging-in-PublicationData
Hanzo,Lajos,1952-
VideoCompressionandCommunications:frombasicstoH.261,H.263,
H.264,MPEG4forDVBandHSDPA-styleadaptiveturbo-transceivers/L.Hanzo,
P.J.CherrimanandJ.Streit–2nded.
p.cm.
Includesbibliographicalreferencesandindex.
ISBN978-0-470-51849-6(cloth)
1.Videocompression.2.Digitalvideo.3.Mobilecommunicationsystems.
I.Cherriman,PeterJ.,1972-II.Streit,Ju¨rgen,1968-III.
Title.
TK6680.5.H3652007
006.6’–dc22
2007024178
BritishLibraryCataloguinginPublicationData
AcataloguerecordforthisbookisavailablefromtheBritishLibrary
ISBN978-0-470-51849-6(HB)
TypesetbytheauthorsusingLATEXsoftware.
PrintedandboundinGreatBritainbyAntonyRoweLtd,Chippenham,England.
Thisbookisprintedonacid-freepaperresponsiblymanufactured fromsustainableforestryinwhichatleasttwo
treesareplantedforeachoneusedforpaperproduction.
Contents
AbouttheAuthors xvii
OtherWileyandIEEEPressBooksonRelatedTopics xix
Preface xxi
Acknowledgments xxiii
1 Introduction 1
1.1 ABriefIntroductiontoCompressionTheory . . . . . . . . . . . . . . . . . 1
1.2 IntroductiontoVideoFormats . . . . . . . . . . . . . . . . . . . . . . . . . 2
1.3 EvolutionofVideoCompressionStandards . . . . . . . . . . . . . . . . . . 5
1.3.1 TheInternationalTelecommunicationsUnion’sH.120Standard . . . 8
1.3.2 JointPhotographicExpertsGroup . . . . . . . . . . . . . . . . . . . 8
1.3.3 TheITUH.261Standard . . . . . . . . . . . . . . . . . . . . . . . . 11
1.3.4 TheMotionPicturesExpertGroup. . . . . . . . . . . . . . . . . . . 11
1.3.5 TheMPEG-2Standard . . . . . . . . . . . . . . . . . . . . . . . . . 12
1.3.6 TheITUH.263Standard . . . . . . . . . . . . . . . . . . . . . . . . 12
1.3.7 TheITUH.263+/H.263++Standards . . . . . . . . . . . . . . . . . 13
1.3.8 TheMPEG-4Standard . . . . . . . . . . . . . . . . . . . . . . . . . 13
1.3.9 TheH.26L/H.264Standard. . . . . . . . . . . . . . . . . . . . . . . 14
1.4 VideoCommunications . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
1.5 OrganizationoftheMonograph . . . . . . . . . . . . . . . . . . . . . . . . 17
I Video Codecs forHSDPA-styleAdaptiveVideophones 19
2 FractalImageCodecs 21
2.1 FractalPrinciples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
2.2 One-dimensionalFractalCoding. . . . . . . . . . . . . . . . . . . . . . . . 23
2.2.1 FractalCodecDesign . . . . . . . . . . . . . . . . . . . . . . . . . . 27
2.2.2 FractalCodecPerformance. . . . . . . . . . . . . . . . . . . . . . . 28
vi CONTENTS
2.3 ErrorSensitivityandComplexity . . . . . . . . . . . . . . . . . . . . . . . 32
2.4 SummaryandConclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
3 LowBitrateDCTCodecsandHSDPA-styleVideophoneTransceivers 35
3.1 VideoCodecOutline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
3.2 ThePrincipleofMotionCompensation . . . . . . . . . . . . . . . . . . . . 37
3.2.1 DistanceMeasures . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
3.2.2 MotionSearchAlgorithms . . . . . . . . . . . . . . . . . . . . . . . 42
3.2.2.1 FullorExhaustiveMotionSearch . . . . . . . . . . . . . . 42
3.2.2.2 Gradient-basedMotionEstimation . . . . . . . . . . . . . 43
3.2.2.3 HierarchicalorTreeSearch . . . . . . . . . . . . . . . . . 44
3.2.2.4 SubsamplingSearch . . . . . . . . . . . . . . . . . . . . . 45
3.2.2.5 Post-processingofMotionVectors . . . . . . . . . . . . . 46
3.2.2.6 Gain-cost-controlledMotionCompensation . . . . . . . . 46
3.2.3 OtherMotionEstimationTechniques . . . . . . . . . . . . . . . . . 48
3.2.3.1 Pel-recursiveDisplacementEstimation . . . . . . . . . . . 49
3.2.3.2 GridInterpolationTechniques . . . . . . . . . . . . . . . . 49
3.2.3.3 MCUsingHigherOrderTransformations. . . . . . . . . . 49
3.2.3.4 MCintheTransformDomain . . . . . . . . . . . . . . . . 50
3.2.4 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 50
3.3 TransformCoding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
3.3.1 One-dimensionalTransformCoding . . . . . . . . . . . . . . . . . . 51
3.3.2 Two-dimensionalTransformCoding . . . . . . . . . . . . . . . . . . 52
3.3.3 QuantizerTrainingforSingle-classDCT . . . . . . . . . . . . . . . 55
3.3.4 QuantizerTrainingforMulticlassDCT . . . . . . . . . . . . . . . . 56
3.4 TheCodecOutline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
3.5 InitialIntra-frameCoding . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
3.6 Gain-controlledMotionCompensation . . . . . . . . . . . . . . . . . . . . 60
3.7 TheMCERActive/PassiveConcept . . . . . . . . . . . . . . . . . . . . . . 61
3.8 PartialForcedUpdateoftheReconstructedFrameBuffers . . . . . . . . . . 62
3.9 TheGain/Cost-controlledInter-frameCodec . . . . . . . . . . . . . . . . . 64
3.9.1 ComplexityConsiderationsandReductionTechniques . . . . . . . . 65
3.10 TheBit-allocationStrategy. . . . . . . . . . . . . . . . . . . . . . . . . . . 66
3.11 Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
3.12 DCTCodecPerformanceunderErroneousConditions . . . . . . . . . . . . 70
3.12.1 BitSensitivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
3.12.2 BitSensitivityofCodecIandII . . . . . . . . . . . . . . . . . . . . 71
3.13 DCT-basedLow-rateVideoTransceivers . . . . . . . . . . . . . . . . . . . 72
3.13.1 ChoiceofModem . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
3.13.2 Source-matchedTransceiver . . . . . . . . . . . . . . . . . . . . . . 73
3.13.2.1 System1 . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
3.13.2.1.1 SystemConcept . . . . . . . . . . . . . . . . . . 73
3.13.2.1.2 Sensitivity-matchedModulation . . . . . . . . . 74
3.13.2.1.3 SourceSensitivity . . . . . . . . . . . . . . . . . 74
3.13.2.1.4 ForwardErrorCorrection . . . . . . . . . . . . . 75
3.13.2.1.5 TransmissionFormat . . . . . . . . . . . . . . . 75
CONTENTS vii
3.13.2.2 System2 . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
3.13.2.2.1 AutomaticRepeatRequest . . . . . . . . . . . . 78
3.13.2.3 Systems3–5 . . . . . . . . . . . . . . . . . . . . . . . . . 79
3.14 SystemPerformance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
3.14.1 PerformanceofSystem1 . . . . . . . . . . . . . . . . . . . . . . . . 80
3.14.2 PerformanceofSystem2 . . . . . . . . . . . . . . . . . . . . . . . . 83
3.14.2.1 FERPerformance . . . . . . . . . . . . . . . . . . . . . . 83
3.14.2.2 SlotOccupancyPerformance . . . . . . . . . . . . . . . . 85
3.14.2.3 PSNRPerformance . . . . . . . . . . . . . . . . . . . . . 86
3.14.3 PerformanceofSystems3–5 . . . . . . . . . . . . . . . . . . . . . . 87
3.15 SummaryandConclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
4 VeryLowBitrateVQCodecsandHSDPA-styleVideophoneTransceivers 93
4.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
4.2 TheCodebookDesign . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
4.3 TheVectorQuantizerDesign . . . . . . . . . . . . . . . . . . . . . . . . . 95
4.3.1 MeanandShapeGainVectorQuantization . . . . . . . . . . . . . . 99
4.3.2 AdaptiveVectorQuantization . . . . . . . . . . . . . . . . . . . . . 100
4.3.3 ClassifiedVectorQuantization . . . . . . . . . . . . . . . . . . . . . 102
4.3.4 AlgorithmicComplexity . . . . . . . . . . . . . . . . . . . . . . . . 103
4.4 PerformanceunderErroneousConditions . . . . . . . . . . . . . . . . . . . 105
4.4.1 Bit-allocationStrategy . . . . . . . . . . . . . . . . . . . . . . . . . 105
4.4.2 BitSensitivity. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
4.5 VQ-basedLow-rateVideoTransceivers . . . . . . . . . . . . . . . . . . . . 107
4.5.1 ChoiceofModulation . . . . . . . . . . . . . . . . . . . . . . . . . 107
4.5.2 ForwardErrorCorrection . . . . . . . . . . . . . . . . . . . . . . . 109
4.5.3 ArchitectureofSystem1 . . . . . . . . . . . . . . . . . . . . . . . . 109
4.5.4 ArchitectureofSystem2 . . . . . . . . . . . . . . . . . . . . . . . . 111
4.5.5 ArchitectureofSystems3–6 . . . . . . . . . . . . . . . . . . . . . . 112
4.6 SystemPerformance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
4.6.1 SimulationEnvironment . . . . . . . . . . . . . . . . . . . . . . . . 113
4.6.2 PerformanceofSystems1and3 . . . . . . . . . . . . . . . . . . . . 114
4.6.3 PerformanceofSystems4and5 . . . . . . . . . . . . . . . . . . . . 115
4.6.4 PerformanceofSystems2and6 . . . . . . . . . . . . . . . . . . . . 117
4.7 JointIterativeDecodingofTrellis-basedVector-quantizedVideoandTCM . 118
4.7.1 Introduction. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118
4.7.2 SystemOverview . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120
4.7.3 Compression . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120
4.7.4 VectorQuantizationDecomposition . . . . . . . . . . . . . . . . . . 121
4.7.5 SerialConcatenationandIterativeDecoding. . . . . . . . . . . . . . 121
4.7.6 TransmissionFrameStructure . . . . . . . . . . . . . . . . . . . . . 122
4.7.7 FrameDifferenceDecomposition . . . . . . . . . . . . . . . . . . . 123
4.7.8 VQCodebook . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 124
4.7.9 VQ-inducedCodeConstraints . . . . . . . . . . . . . . . . . . . . . 126
4.7.10 VQTrellisStructure . . . . . . . . . . . . . . . . . . . . . . . . . . 127
4.7.11 VQEncoding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129