Content Distribution for Mobile Internet: A Cloud-based Approach

256 Pages·2023·10.447 MB·English

by  Zhenhua Li, Yafei Dai, Guihai Chen, Yunhao Liu

Zhenhua Li
Yafei Dai
Guihai Chen
Yunhao Liu
Content Distribution
for Mobile Internet:
A Cloud-based
Approach
Second Edition
Content Distribution for Mobile Internet:
A Cloud-based Approach
Zhenhua Li • Yafei Dai (cid:129) Guihai Chen (cid:129) Yunhao Liu
Content Distribution
for Mobile Internet:
A Cloud-based Approach
Second Edition
ZhenhuaLi YafeiDai
TsinghuaUniversity PekingUniversity
Beijing,Beijing,China Beijing,Beijing,China
GuihaiChen YunhaoLiu
ShanghaiJiaoTongUniversity TsinghuaUniversity
Shanghai,Shanghai,China Beijing,Beijing,China
ISBN978-981-19-6981-2 ISBN978-981-19-6982-9 (eBook)
https://doi.org/10.1007/978-981-19-6982-9
©TheEditor(s)(ifapplicable)andTheAuthor(s),underexclusivelicensetoSpringerNatureSingapore
PteLtd.2023
Thisworkissubjecttocopyright.AllrightsaresolelyandexclusivelylicensedbythePublisher,whether
thewholeorpartofthematerialisconcerned,specificallytherightsoftranslation,reprinting,reuse
ofillustrations,recitation,broadcasting,reproductiononmicrofilmsorinanyotherphysicalway,and
transmissionorinformationstorageandretrieval,electronicadaptation,computersoftware,orbysimilar
ordissimilarmethodologynowknownorhereafterdeveloped.
Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication
doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant
protectivelawsandregulationsandthereforefreeforgeneraluse.
Thepublisher,theauthors,andtheeditorsaresafetoassumethattheadviceandinformationinthisbook
arebelievedtobetrueandaccurateatthedateofpublication.Neitherthepublishernortheauthorsor
theeditorsgiveawarranty,expressedorimplied,withrespecttothematerialcontainedhereinorforany
errorsoromissionsthatmayhavebeenmade.Thepublisherremainsneutralwithregardtojurisdictional
claimsinpublishedmapsandinstitutionalaffiliations.
ThisSpringerimprintispublishedbytheregisteredcompanySpringerNatureSingaporePteLtd.
The registered company address is: 152 Beach Road, #21-01/04 Gateway East, Singapore 189721,
Singapore
Preface
Content distribution (also known as content delivery) is among the most funda-
mental functions of the Internet, i.e., distributing digital content from one node
to another node or multiple nodes. Here digital content can be in the form of a
web page, an image, software, audio, video, big data, etc.; a node can be a large
servercluster,apersonalcomputer,asmartphone,asmallsensor,atinyRFID(radio
frequencyidentificationdevice)tag,andsoon.
TypicalcontentdistributionparadigmsincludeClient/Server(C/S)overTCP/IP
connections,ContentDeliveryNetwork(CDN)likeAkamaiandChinaCache,Peer-
to-Peer(P2P)likeBitTorrentandeMule,SuperNodeRelay(SNR)likeKaZaaand
Skype, and Peering via Internet eXchange (PIX) that is adopted by many Internet
Service Providers (ISPs) to overcome the traditional Transit-Stub architecture’s
shortcomings. They each have specific merits and drawbacks, targeting distinct
applicationscenariossuchasfiledownload,mediastreaming,real-timeinteraction,
andAR/VR.
Since Amazon’s launch of Elastic Compute Cloud (EC2) in 2006 and Apple’s
releaseofiPhonein2007,Internetcontentdistributionhasillustratedastrongtrend
of polarization. On one hand, great fortune has been invested by those “content
hypergiants”(e.g.,GoogleandNetflix)inbuildingheavyweightandintegrateddata
centers across the world, in order to achieve the economies of scale and the high
flexibility/efficiency of content distribution. On the other hand, end-user devices
have become increasingly lightweight, mobile, and heterogeneous, thus posing
rigorousandvolatilerequirementsonthebandwidth,latency,trafficusage,energy
consumption,servicereliability,andsecurity/privacyofcontentdistribution.
Through comprehensive real-world measurements, unfortunately, we observe
thatexistingcontentdistributiontechniquesoftenexhibitundesirableorevenpoor
performance under the above-described new settings. Motivated by the trend of
“heavy-cloud vs. light-end,” this book is dedicated to uncovering the root causes
of today’s mobile networking problems and designing innovative cloud-based
solutionstopracticallyaddresssuchproblems,intermsoffourkeymetrics:Speed
(PartII),Cost(PartIII),Reliability(PartIV),andSecurity(PartV).
v
vi Preface
Our work included in this book has led to not only academic papers published
in prestigious conferences like SIGCOMM, NSDI, MobiCom, and MobiSys, but
alsoactualeffectonindustrialsystemssuchasXiaomiMobile,MIUIOS,Tencent
AppStore,BaiduPhoneGuard,UUTest.cn,andWiFi.com.Inaddition,theincluded
workhaswonseveralacademicawards,e.g.,BestStudentPaperAwardoftheACM
MMSys2017conference,ExcellentPaperAwardoftheTsinghuaScienceandTech-
nology 2019 journal, Best Demo Award of the ACM MobiCom 2019 conference,
andBestStudentPaperAwardoftheACMSIGCOMM2021conference(thefirst
timeAsianscholarsgetthisawardfromSIGCOMM).
In this book, we provide a series of insightful measurement findings and first-
handsystemexperiencestoresearchersandpractitionersworkingonmobileInternet
and cloud computing/storage. Additionally, we have released as much code and
data used in our work as possible to benefit the community. Should you have any
questions or suggestions, please contact the four authors (in particular the first
author) via [email protected], [email protected], [email protected],
[email protected].
Finally,wesincerelyappreciatetheprofessionalassistancefromCelineChang,
Jingying Chen, Lenold Esithor, Christina Fehling, Ramesh Marimuthu, and Ellen
Seo at Springer Press. Also, we would like to thank the following people for their
contributions to this book: Sen Bai, Jian Chen, Qi Chen, Yan Chen, Fan Dang, Di
Gao,LiangyiGong,TaehoJung,XiangyangLi,YangLi,HaoLin,ZhenLu,Kebin
Liu, Wei Liu, Yao Liu, Rui Miao, Chen Qian, Feng Qian, Zhiyun Qian, Weiwei
Wang, Xianlong Wang, Yinlong Wang, Christo Wilson, Ao Xiao, Xianlong Xin,
TianyinXu,JinyuYang,XinleiYang,EnnanZhai,LanZhang,BenZhao,andXin
Zhong. In particular, we are grateful for Yannan Zheng’s helping typeset several
chaptersofthisbook.
Beijing,China ZhenhuaLi
Beijing,China YafeiDai
Shanghai,China GuihaiChen
Beijing,China YunhaoLiu
December2021
Acknowledgments
ThisworkissupportedinpartbytheNationalKeyR&DProgramofChinaunder
grant2022YFB4500703;theNationalNaturalScienceFoundationofChina(NSFC)
undergrants61902211and62202266;andMicrosoftResearchAsia.
vii
Contents
PartI GetStarted
1 BackgroundandOverview ................................................ 3
1.1 InternetContentDistribution ........................................ 3
1.2 CloudComputingandMobileInternet.............................. 7
1.3 FrontierTechniques.................................................. 8
1.4 OverviewoftheBookStructure..................................... 13
References.................................................................... 14
PartII Metric1Speed:BandwidthIstheFirst
2 FastandLightBandwidthTestingforMobileInternet ................ 19
2.1 Introduction........................................................... 19
2.2 UnderstandingState-of-the-ArtBTSes.............................. 22
2.2.1 Methodology................................................. 22
2.2.2 AnalyzingDeployedBTSes................................. 23
2.2.3 MeasurementResults........................................ 24
2.2.4 CaseStudies.................................................. 25
2.3 DesignofFastBTS .................................................. 28
2.3.1 CrucialIntervalSampling(CIS) ............................ 29
2.3.2 ElasticBandwidthProbing(EBP)........................... 32
2.3.3 Data-DrivenServerSelection(DSS)........................ 36
2.3.4 AdaptiveMulti-Homing(AMH)............................ 37
2.4 Implementation....................................................... 38
2.5 Evaluation ............................................................ 38
2.5.1 ExperimentSetup............................................ 38
2.5.2 End-to-EndPerformance .................................... 40
2.5.3 IndividualComponents...................................... 42
2.6 ConcludingRemarks................................................. 45
References.................................................................... 46
ix
x Contents
3 OfflineDownloadingviaCloudand/orSmartAPs ..................... 49
3.1 Introduction........................................................... 49
3.2 RelatedWork......................................................... 53
3.3 SystemOverview..................................................... 55
3.3.1 OverviewofXuanfeng....................................... 55
3.3.2 OverviewoftheSmartAPSystems......................... 56
3.4 WorkloadCharacteristics ............................................ 58
3.5 PerformanceoftheCloud-BasedSystem........................... 61
3.5.1 Pre-downloadingPerformance .............................. 61
3.5.2 FetchingPerformance........................................ 63
3.5.3 End-to-EndPerformance .................................... 66
3.6 PerformanceoftheSmartAPs....................................... 66
3.6.1 Methodology................................................. 66
3.6.2 BenchmarkResults .......................................... 68
3.7 TheODRMiddleware................................................ 71
3.7.1 DesignandImplementation ................................. 71
3.7.2 PerformanceEvaluation ..................................... 74
3.8 Conclusion............................................................ 75
References.................................................................... 76
PartIII Metric2Cost:NeverWasteonTrafficUsage
4 Cross-ApplicationCellularTrafficOptimization....................... 81
4.1 Introduction........................................................... 81
4.2 State-of-the-ArtSystems............................................. 84
4.3 MeasuringCellularTraffic........................................... 86
4.3.1 DatasetCollection............................................ 87
4.3.2 ContentAnalysis............................................. 88
4.4 SystemOverview..................................................... 91
4.5 Mechanisms .......................................................... 94
4.5.1 ImageCompression.......................................... 94
4.5.2 ContentValidation ........................................... 96
4.5.3 TrafficFiltering .............................................. 97
4.5.4 Value-BasedWebCaching(VBWC)........................ 98
4.6 Evaluation ............................................................ 99
4.6.1 DataCollectionandMethodology .......................... 99
4.6.2 TrafficReduction............................................. 100
4.6.3 SystemOverhead ............................................ 102
4.6.4 LatencyPenalty.............................................. 107
4.7 Conclusion............................................................ 108
References.................................................................... 109
5 BoostingMobileVirtualNetworkOperator............................. 111
5.1 Introduction........................................................... 111
5.2 Background........................................................... 114
5.3 MeasurementDataCollection....................................... 116
Contents xi
5.4 DataUsageCharacterization......................................... 117
5.5 NetworkPerformance................................................ 122
5.6 DataUsagePredictionandDataResellingOptimization .......... 124
5.6.1 DataUsagePredictionandModeling....................... 124
5.6.2 DataResellingOptimization ................................ 128
5.7 CustomerChurnProfilingandMitigation........................... 130
5.8 InaccurateBillinginMVNO ........................................ 134
5.9 RelatedWork......................................................... 136
5.10 ConcludingRemarks................................................. 136
References.................................................................... 137
PartIV Metric3Reliability:StayConnectedAlltheTime
6 EnhancingNationwideCellularReliability.............................. 143
6.1 Introduction........................................................... 143
6.2 StudyMethodology .................................................. 146
6.2.1 LimitationsofVanillaAndroid.............................. 146
6.2.2 ContinuousMonitoringInfrastructure ...................... 148
6.2.3 Large-ScaleDeployment .................................... 150
6.3 MeasurementResults ................................................ 150
6.3.1 GeneralStatistics............................................. 151
6.3.2 AndroidPhoneLandscape................................... 153
6.3.3 ISPandBaseStationLandscape ............................ 159
6.4 Enhancements ........................................................ 162
6.4.1 GuidelinesinPrinciple....................................... 162
6.4.2 Real-WorldPractices ........................................ 163
6.4.3 DeploymentandEvaluation................................. 168
6.5 Conclusion............................................................ 170
References.................................................................... 170
7 LegalInternetAccessUnderExtremeCensorship ..................... 173
7.1 Introduction........................................................... 173
7.2 ExtremeInternetCensorship......................................... 175
7.3 TheScholarCloudSystem ........................................... 177
7.4 MeasurementStudy.................................................. 179
7.4.1 CommonPractices........................................... 179
7.4.2 Methodology................................................. 180
7.4.3 MeasurementResults........................................ 181
7.5 RelatedWork......................................................... 185
7.6 LimitationandDiscussion........................................... 185
References.................................................................... 186
PartV Metric4Security:DoNotRelaxOurVigilance
8 CombatingNationwideWiFiSecurityThreats ......................... 191
8.1 Introduction........................................................... 191