Camera image quality benchmarking

386 Pages·2018·13.094 MB·English

by  Denman, Hugh, Eliasson, Henrik, Phillips, Jonathan B

(cid:2)
CameraImageQualityBenchmarking
(cid:2) (cid:2)
(cid:2)
(cid:2)
Wiley-IS&TSeriesinImagingScienceandTechnology
SeriesEditorialBoard:
SusanFarnand
GeoffreyWolfe
RajaBala
GauravSharma
StevenJ.Simske
SuzanneGrinnan
ReproductionofColour(6thEdition)
R.W.G.Hunt
Colorimetry:FundamentalsandApplications
NoburuOhtaandAlanR.Robertson
ColorConstancy
MarcEbner
ColorGamutMapping
JánMorovič
(cid:2) PanoramicImaging:Sensor-LineCamerasandLaserRange-Finders (cid:2)
FayHuang,ReinhardKletteandKarstenScheibe
DigitalColorManagement(2ndEdition)
EdwardJ.GiorgianniandThomasE.Madden
TheJPEG2000Suite
PeterSchelkens,AthanassiosSkodrasandTouradjEbrahimi(Eds.)
ColorManagement:UnderstandingandUsingICCProfiles
PhilGreen(Ed.)
FourierMethodsinImaging
RogerL.Easton,Jr.
MeasuringColour(4thEdition)
R.W.G.HuntandM.R.Pointer
TheArtandScienceofHDRImaging
JohnMcCannandAlessandroRizzi
ComputationalColourScienceUsingMATLAB(2ndEdition)
StephenWestland,CaterinaRipamontiandVienCheung
ColorinComputerVision:FundamentalsandApplications
TheoGevers,ArjanGijsenij,JoostvandeWeijerandJan-MarkGeusebroek
(cid:2)
(cid:2)
ColorAppearanceModels(3rdEdition)
MarkD.Fairchild
2.5DPrinting:BridgingtheGapbetween2Dand3DApplications
CarinnaParramanandMariaV.OrtizSegovia
PublishedinAssociationwiththeSocietyforImagingScienceandTechnology
(cid:2) (cid:2)
(cid:2)
(cid:2)
Camera Image Quality Benchmarking
JonathanB.Phillips
GoogleInc.,USA
HenrikEliasson
EclipseOpticsAB,Sweden
(cid:2) (cid:2)
WithcontributionsonvideoimagequalitybyHughDenman
(cid:2)
(cid:2)
Thiseditionfirstpublished2018
©2018JohnWileyandSonsLtd
Allrightsreserved.Nopartofthispublicationmaybereproduced,storedinaretrievalsystem,or
transmitted,inanyformorbyanymeans,electronic,mechanical,photocopying,recordingorotherwise,
exceptaspermittedbylaw.Adviceonhowtoobtainpermissiontoreusematerialfromthistitleisavailable
athttp://www.wiley.com/go/permissions.
TherightofJonathanB.PhillipsandHenrikEliassontobeidentifiedastheauthorsofthiswork/the
editorialmaterialinthisworkhasbeenassertedinaccordancewithlaw.
RegisteredOffices
JohnWiley&Sons,Inc.,111RiverStreet,Hoboken,NJ07030,USA
JohnWiley&SonsLtd,TheAtrium,SouthernGate,Chichester,WestSussex,PO198SQ,UK
EditorialOffice
TheAtrium,SouthernGate,Chichester,WestSussex,PO198SQ,UK
Fordetailsofourglobaleditorialoffices,customerservices,andmoreinformationaboutWileyproducts
visitusatwww.wiley.com.
Wileyalsopublishesitsbooksinavarietyofelectronicformatsandbyprint-on-demand.Somecontentthat
appearsinstandardprintversionsofthisbookmaynotbeavailableinotherformats.
LimitofLiability/DisclaimerofWarranty
Whilethepublisherandauthorshaveusedtheirbesteffortsinpreparingthiswork,theymakeno
representationsorwarrantieswithrespecttotheaccuracyorcompletenessofthecontentsofthisworkand
specificallydisclaimallwarranties,includingwithoutlimitationanyimpliedwarrantiesofmerchantabilityor
fitnessforaparticularpurpose.Nowarrantymaybecreatedorextendedbysalesrepresentatives,written
salesmaterialsorpromotionalstatementsforthiswork.Thefactthatanorganization,website,orproductis
referredtointhisworkasacitationand/orpotentialsourceoffurtherinformationdoesnotmeanthatthe
publisherandauthorsendorsetheinformationorservicestheorganization,website,orproductmayprovide
(cid:2) (cid:2)
orrecommendationsitmaymake.Thisworkissoldwiththeunderstandingthatthepublisherisnotengaged
inrenderingprofessionalservices.Theadviceandstrategiescontainedhereinmaynotbesuitableforyour
situation.Youshouldconsultwithaspecialistwhereappropriate.Further,readersshouldbeawarethat
websiteslistedinthisworkmayhavechangedordisappearedbetweenwhenthisworkwaswrittenandwhen
itisread.Neitherthepublishernorauthorsshallbeliableforanylossofprofitoranyothercommercial
damages,includingbutnotlimitedtospecial,incidental,consequential,orotherdamages.
Thecontentofthebook,includingtheviewsandopinionsexpressed,aresolelyattributabletotheAuthors
anddonotreflectanyofficialpolicyorpracticeofKodak,itssubsidiariesoraffiliates.Kodak’spermission
shouldnotimplyanyapprovalorverificationbyKodakofthefactualandopinioncontentsofthebook.
LibraryofCongressCataloging-in-PublicationData
Names:Phillips,JonathanB.,1970-author.|Eliasson,Henrik,author.|
Denman,Hugh,1978-contributor.
Title:Cameraimagequalitybenchmarking/byJonathanB.Phillips,Henrik
Eliasson;withcontributionsonvideoimagequalitybyHughDenman.
Description:Hoboken,NJ:JohnWiley&Sons,2017.|Includes
bibliographicalreferencesandindex.|
Identifiers:LCCN2017024315(print)|LCCN2017041277(ebook)|ISBN
9781119054528(pdf)|ISBN9781119054511(epub)|ISBN9781119054498
(cloth)
Subjects:LCSH:Imageprocessing.|Imagingsystems–Imagequality.
Classification:LCCTA1637(ebook)|LCCTA1637.P4832017(print)|DDC
771.3–dc23
LCrecordavailableathttps://lccn.loc.gov/2017024315
CoverDesign:Wiley
CoverImage:©jericho667/GettyImages
Setin10/12ptWarnockProbySPiGlobal,Chennai,India
10 9 8 7 6 5 4 3 2 1
(cid:2)
(cid:2)
vii
Contents
AbouttheAuthors xv
SeriesPreface xvii
Preface xix
ListofAbbreviations xxiii
AbouttheCompanionWebsite xxvii
1 Introduction 1
1.1 ImageContentandImageQuality 2
1.1.1 Color 3
1.1.2 Shape 8
(cid:2) 1.1.3 Texture 10 (cid:2)
1.1.4 Depth 11
1.1.5 LuminanceRange 12
1.1.6 Motion 15
1.2 Benchmarking 18
1.3 BookContent 22
SummaryofthisChapter 24
References 25
2 DefiningImageQuality 27
2.1 WhatisImageQuality? 27
2.2 ImageQualityAttributes 29
2.3 SubjectiveandObjectiveImageQualityAssessment 31
SummaryofthisChapter 32
References 33
3 ImageQualityAttributes 35
3.1 GlobalAttributes 35
3.1.1 Exposure,TonalReproduction,andFlare 35
3.1.2 Color 39
3.1.3 GeometricalArtifacts 40
3.1.3.1 PerspectiveDistortion 40
3.1.3.2 OpticalDistortion 42
3.1.3.3 OtherGeometricalArtifacts 42
3.1.4 Nonuniformities 43
(cid:2)
(cid:2)
viii Contents
3.1.4.1 LuminanceShading 45
3.1.4.2 ColorShading 45
3.2 LocalAttributes 45
3.2.1 SharpnessandResolution 45
3.2.2 Noise 49
3.2.3 TextureRendition 50
3.2.4 ColorFringing 50
3.2.5 ImageDefects 51
3.2.6 Artifacts 51
3.2.6.1 AliasingandDemosaicingArtifacts 52
3.2.6.2 StillImageCompressionArtifacts 53
3.2.6.3 Flicker 53
3.2.6.4 HDRProcessingArtifacts 55
3.2.6.5 LensGhosting 55
3.3 VideoQualityAttributes 56
3.3.1 FrameRate 56
3.3.2 ExposureandWhiteBalanceResponsivenessandConsistency 58
3.3.3 FocusAdaption 58
3.3.4 Audio-VisualSynchronization 58
3.3.5 VideoCompressionArtifacts 59
3.3.6 TemporalNoise 60
3.3.7 FixedPatternNoise 60
(cid:2) 3.3.8 MosquitoNoise 60 (cid:2)
SummaryofthisChapter 60
References 61
4 TheCamera 63
4.1 ThePinholeCamera 63
4.2 Lens 64
4.2.1 Aberrations 64
4.2.1.1 Third-OrderAberrations 65
4.2.1.2 ChromaticAberrations 66
4.2.2 OpticalParameters 67
4.2.3 RelativeIllumination 69
4.2.4 DepthofField 70
4.2.5 Diffraction 71
4.2.6 StrayLight 73
4.2.7 ImageQualityAttributesRelatedtotheLens 74
4.3 ImageSensor 75
4.3.1 CCDImageSensors 75
4.3.2 CMOSImageSensors 77
4.3.3 ColorImaging 81
4.3.4 ImageSensorPerformance 82
4.3.5 CCDversusCMOS 89
4.3.6 ImageQualityAttributesRelatedtotheImageSensor 90
4.4 ImageSignalProcessor 91
4.4.1 ImageProcessing 91
(cid:2)
(cid:2)
Contents ix
4.4.2 ImageCompression 98
4.4.2.1 ChromaSubsampling 98
4.4.2.2 TransformCoding 98
4.4.2.3 CoefficientQuantization 99
4.4.2.4 CoefficientCompression 100
4.4.3 ControlAlgorithms 101
4.4.4 ImageQualityAttributesRelatedtotheISP 101
4.5 Illumination 102
4.5.1 LEDFlash 103
4.5.2 XenonFlash 103
4.6 VideoProcessing 103
4.6.1 VideoStabilization 103
4.6.1.1 GlobalMotionModels 104
4.6.1.2 GlobalMotionEstimation 105
4.6.1.3 GlobalMotionCompensation 106
4.6.2 VideoCompression 107
4.6.2.1 ComputationofResiduals 107
4.6.2.2 VideoCompressionStandardsandCodecs 109
4.6.2.3 SomeSignificantVideoCompressionStandards 110
4.6.2.4 ANoteOnVideoStreamStructure 111
4.7 SystemConsiderations 111
SummaryofthisChapter 112
(cid:2) References 113 (cid:2)
5 SubjectiveImageQualityAssessment—TheoryandPractice 117
5.1 Psychophysics 118
5.2 MeasurementScales 120
5.3 PsychophysicalMethodologies 122
5.3.1 RankOrder 123
5.3.2 CategoryScaling 123
5.3.3 AcceptabilityScaling 124
5.3.4 AnchoredScaling 125
5.3.5 Forced-ChoiceComparison 125
5.3.6 MagnitudeEstimation 125
5.3.7 MethodologyComparison 126
5.4 Cross-ModalPsychophysics 126
5.4.1 ExampleResearch 127
5.4.2 ImageQuality-RelatedDemonstration 128
5.5 ThurstonianScaling 129
5.6 QualityRuler 131
5.6.1 RulerGeneration 134
5.6.2 QualityRulerInsights 135
5.6.2.1 LabCross-Comparisons 135
5.6.2.2 SQS JNDValidation 136
2
5.6.2.3 QualityRulerStandardDeviationTrends 139
5.6.2.4 ObserverImpact 141
5.6.3 PerspectivefromAcademia 142
(cid:2)
(cid:2)
x Contents
5.6.4 PracticalExample 144
5.6.5 QualityRulerApplicationstoImageQualityBenchmarking 147
5.7 SubjectiveVideoQuality 148
5.7.1 Terminology 149
5.7.2 ObserverSelection 149
5.7.3 ViewingSetup 150
5.7.4 VideoDisplayandPlayback 151
5.7.5 ClipSelection 152
5.7.6 PresentationProtocols 154
5.7.7 AssessmentMethods 156
5.7.8 InterpretingResults 158
5.7.9 ITURecommendations 159
5.7.9.1 TheDouble-StimulusImpairmentScaleMethod 160
5.7.9.2 TheDouble-StimulusContinuousQualityScaleMethod 160
5.7.9.3 TheSimultaneousDouble-StimulusforContinuousEvaluationMethod 160
5.7.9.4 TheAbsoluteCategoryRatingMethod 161
5.7.9.5 TheSingleStimulusContinuousQualityEvaluationMethod 161
5.7.9.6 TheSubjectiveAssessmentofMultimediaVideoQualityMethod 161
5.7.9.7 ITUMethodologyComparison 162
5.7.10 OtherSources 162
SummaryofthisChapter 162
References 163
(cid:2) (cid:2)
6 ObjectiveImageQualityAssessment—TheoryandPractice 167
6.1 ExposureandTone 168
6.1.1 ExposureIndexandISOSensitivity 168
6.1.2 Opto-ElectronicConversionFunction 169
6.1.3 PracticalConsiderations 170
6.2 DynamicRange 170
6.3 Color 171
6.3.1 LightSources 171
6.3.2 Scene 174
6.3.3 Observer 176
6.3.4 BasicColorMetrics 178
6.3.5 RGBColorSpaces 180
6.3.6 PracticalConsiderations 181
6.4 Shading 181
6.4.1 PracticalConsiderations 182
6.5 GeometricDistortion 182
6.5.1 PracticalConsiderations 184
6.6 StrayLight 184
6.6.1 PracticalConsiderations 185
6.7 SharpnessandResolution 185
6.7.1 TheModulationTransferFunction 186
6.7.2 TheContrastTransferFunction 191
6.7.3 GeometryinOpticalSystemsandtheMTF 193
6.7.4 SamplingandAliasing 194
(cid:2)
(cid:2)
Contents xi
6.7.5 SystemMTF 195
6.7.6 MeasuringtheMTF 198
6.7.7 EdgeSFR 198
6.7.8 SineModulatedSiemensStarSFR 201
6.7.9 ComparingEdgeSFRandSineModulatedSiemensSFR 203
6.7.10 PracticalConsiderations 204
6.8 TextureBlur 204
6.8.1 ChartConstruction 206
6.8.2 PracticalConsiderations 206
6.8.3 AlternativeMethods 207
6.9 Noise 207
6.9.1 NoiseandColor 207
6.9.2 SpatialFrequencyDependence 209
6.9.3 SignaltoNoiseMeasurementsinNonlinearSystemsandNoiseComponent
Analysis 211
6.9.4 PracticalConsiderations 212
6.10 ColorFringing 213
6.11 ImageDefects 214
6.12 VideoQualityMetrics 214
6.12.1 FrameRateandFrameRateConsistency 215
6.12.2 FrameExposureTimeandConsistency 215
6.12.3 AutoWhiteBalanceConsistency 216
(cid:2) 6.12.4 AutofocusingTimeandStability 216 (cid:2)
6.12.5 VideoStabilizationPerformance 217
6.12.6 Audio-VideoSynchronization 218
6.13 RelatedInternationalStandards 218
SummaryofthisChapter 221
References 221
7 PerceptuallyCorrelatedImageQualityMetrics 227
7.1 AspectsofHumanVision 227
7.1.1 PhysiologicalProcesses 227
7.2 HVSModeling 232
7.3 ViewingConditions 232
7.4 SpatialImageQualityMetrics 234
7.4.1 Sharpness 235
7.4.1.1 EdgeAcutance 235
7.4.1.2 MappingAcutancetoJNDValues 237
7.4.1.3 OtherPerceptualSharpnessMetrics 239
7.4.2 TextureBlur 239
7.4.3 VisualNoise 240
7.5 Color 244
7.5.1 ChromaticAdaptationTransformations 244
7.5.2 ColorAppearanceModels 245
7.5.3 ColorandSpatialContent—ImageAppearanceModels 247
7.5.4 ImageQualityBenchmarkingandColor 249
7.6 OtherMetrics 251
(cid:2)