IMPROVING BANDWIDTH ALLOCATION IN CLOUD COMPUTING ENVIRONMENTS VIA ...

183 Pages·2016·1.91 MB·English

IMPROVING BANDWIDTH ALLOCATION IN CLOUD COMPUTING
ENVIRONMENTS VIA "BANDWIDTH AS A SERVICE" PARTITIONING
SCHEME
by
Anthony Amaro Jr
A thesis submitted to the Graduate College of
Texas State University in partial fulfillment
of the requirements for the degree of
Master of Science
with a Major in Computer Science
August 2016
Committee Members:
Wuxu Peng, Chair
Xiao Chen
Stan McClellan
COPYRIGHT
by
Anthony Amaro Jr
2016
FAIR USE AND AUTHOR’S PERMISSION STATEMENT
Fair Use
This work is protected by the Copyright Laws of the United States (Public Law
94-553, section 107). Consistent with fair use as defined in the Copyright Laws,
brief quotations from this material are allowed with proper acknowledgement.
Use of this material for financial gain without the author’s express written
permission is not allowed.
Duplication Permission
As the copyright holder of this work I, Anthony Amaro Jr, authorize duplication
of this work, in whole or in part, for educational or scholarly purposes only.
DEDICATION
This work is dedicated to my beautiful wife, Martha Shea Amaro, of whose
patience and loving-kindness I am wholly unworthy; my daughters Lillian Elaine
and Lana Dee, the lights of my life; my grandparents Aura and Abelardo Castillo,
whose bravery and sacrifice allowed our family a chance at a better life; my uncle
Marlon Castillo and aunt Lisa Castillo who where there for me when I needed
them the most, and my mother Vivian, whose intense love, determination, and...
...Mom, there are no words to describe just how important you are to me.
ACKNOWLEDGEMENTS
Many thanks go to Dr. Wuxu Peng, whom without his guidance and inspiration
I would not be involved in research. I would like to thank Dr. Xiao Chen and Dr.
Stan McClellan for their support during the thesis process. I also wish to thank
my loving family for their patience and understanding during many late nights of
study for the past few years.
Finally, I would like to thank the people dear to my heart: Hilliard and Tanya
Robertson, Shawn and Sarah Croft, Sam and Sarah Brown, Nicholas and Beth
Shaff,andEricandPamelaBrown,andalloftheirfamilies,whoseloveandsupport
I have relied upon all of these years, and for many years to come.
v
TABLE OF CONTENTS
Page
ACKNOWLEDGEMENTS . . . . . . . . . . . . . . . . . . . . . . . . . . . v
LIST OF FIGURES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . x
ABSTRACT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xii
CHAPTER
I. INTRODUCTION . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Motivation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
Bandwidth as a Service . . . . . . . . . . . . . . . . . . . . . . . . 3
Thesis Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
II. RELATED WORK . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
CloudMirror: Application-Aware Bandwidth Reservations in the
Cloud . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Sharing Bandwidth by Allocating Switch Buffer in Data Center
Networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
Sharing the Data Center Network . . . . . . . . . . . . . . . . . . . 10
Towards Predictable Data Center Networks . . . . . . . . . . . . . 11
Chatty Tenants and the Cloud Network Sharing Problem . . . . . . 13
Gatekeeper: Bandwidth Guarantees for Multi-Tenant Datacenter
Networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
FairCloud: Sharing the Network in Cloud Computing . . . . . . . . 16
SecondNet: A Data Center Network Virtualization Architecture
with Bandwidth Guarantees . . . . . . . . . . . . . . . . . . . . 18
Towards Flexible Guarantees in Clouds: Adaptive Bandwidth
Allocation and Pricing . . . . . . . . . . . . . . . . . . . . . . . 19
ElasticSwitch: Practical Work-Conserving Bandwidth Guarantees
for Cloud Computing . . . . . . . . . . . . . . . . . . . . . . . . 21
vi
BwMan: Bandwidth Manager for Elastic Services in the Cloud . . . 22
QoS-Guaranteed Bandwidth Shifting and Redistribution in Mobile
Cloud Environment . . . . . . . . . . . . . . . . . . . . . . . . . 23
A Dynamic Bandwidth Allocator for Virtual Machines in a Cloud
Environment . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24
Quality of Service (QoS) Guaranteed Network Resource Allocation
via Software Defined Networking (SDN) . . . . . . . . . . . . . 26
Transport Layer Optimization for Cloud Computing Applications
via Satellite: TCP Noordwijk+ . . . . . . . . . . . . . . . . . . 27
Towards Bandwidth Guarantee in Multi-Tenancy Cloud
Computing Networks . . . . . . . . . . . . . . . . . . . . . . . . 28
NetShare and Stochastic NetShare: Predictable Bandwidth
Allocation for Data Centers . . . . . . . . . . . . . . . . . . . . 29
III. BANDWIDTH CONTROL CONCEPT . . . . . . . . . . . . . . . . . 31
Unexceeded Bandwidth Utilization . . . . . . . . . . . . . . . . . . 31
Bandwidth Groups and the Free Pool . . . . . . . . . . . . . . . . . 32
Bandwidth Group Depression . . . . . . . . . . . . . . . . . . . . . 33
Resetting Bandwidth Group Limits . . . . . . . . . . . . . . . . . . 34
IV. BANDWIDTH CONTROLLER ALGORITHM . . . . . . . . . . . . 37
Data is Sent / Received . . . . . . . . . . . . . . . . . . . . . . . . 37
Quanta Timer Expiry . . . . . . . . . . . . . . . . . . . . . . . . . 38
Software Implementation . . . . . . . . . . . . . . . . . . . . . . . . 39
V. EXPERIMENTAL DATA . . . . . . . . . . . . . . . . . . . . . . . . 41
System Test Description . . . . . . . . . . . . . . . . . . . . . . . . 41
Test Description - Client Sends Data to Server with Bandwidth
Limiting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Server Receiving Data - Server Incoming Bandwidth Limited . 43
Client Sending Data - Server Incoming Bandwidth Limited . . 48
vii
Test Description - Bandwidth Limited Client Sends Data to Server 52
Client Sending Data - Client Outgoing Bandwidth Limited . . 52
Server Receiving Data - Client Outgoing Bandwidth Limited . 57
Comparison with Uncategorized Bandwidth Control . . . . . . . . 61
VI. VIRTUAL SWITCH PERFORMANCE . . . . . . . . . . . . . . . . 65
Performance Test Setup . . . . . . . . . . . . . . . . . . . . . . . . 66
CPU Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
VM1 to VM2 Bandwidth Throughput . . . . . . . . . . . . . . . . 68
VM2 to PM Bandwidth Throughput . . . . . . . . . . . . . . . . . 69
PM to VM1 Bandwidth Throughput . . . . . . . . . . . . . . . . . 70
Approaches to Hypervisor Virtual Switching . . . . . . . . . . . . . 71
Xen Bridge . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
XenLoop . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
XenSockets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
Direct I/O . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
vFlood . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74
Large Receive Offload . . . . . . . . . . . . . . . . . . . . . . . 75
Open vSwitch . . . . . . . . . . . . . . . . . . . . . . . . . . . 75
Virtual Switching with Intelligent NIC . . . . . . . . . . . . . 76
Virtual Machine Device Queues . . . . . . . . . . . . . . . . . 76
SR-IOV . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77
VII. ISSUES AND CONCERNS . . . . . . . . . . . . . . . . . . . . . . . 79
Covetous Bandwidth Effect . . . . . . . . . . . . . . . . . . . . . . 79
Transport Congestion Window and RTX . . . . . . . . . . . . . . . 80
Explicit Congestion Notification . . . . . . . . . . . . . . . . . . . . 81
viii
SCTP Streams and Head of Line Blocking . . . . . . . . . . . . . . 81
VIII. CONCLUSION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
APPENDIX SECTION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
REFERENCES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 168
ix
LIST OF FIGURES
Figure Page
I.1 Tenants and Servers within the Cloud Data Center . . . . . . . . . . 2
I.2 Bandwidth as a Service - Conceptual View . . . . . . . . . . . . . . . 3
I.3 Dynamic Management of Bandwidth Groups . . . . . . . . . . . . . . 4
III.1 Example Bandwidth Groups with Fixed Bandwidth Allocation . . . . 31
III.2 Example Bandwidth Groups with Variable Utilization . . . . . . . . . 32
III.3 Example Bandwidth Groups and the Free Pool . . . . . . . . . . . . 33
III.4 Example Bandwidth Groups Growth . . . . . . . . . . . . . . . . . . 34
III.5 Example Bandwidth Groups Limit Reset . . . . . . . . . . . . . . . . 35
III.6 Example Bandwidth Groups Exceed Maximum . . . . . . . . . . . . 36
IV.1 Algorithm Data Flow . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
IV.2 Quanta Timer Expiry . . . . . . . . . . . . . . . . . . . . . . . . . . 38
IV.3 SCTP Bandwidth Controller . . . . . . . . . . . . . . . . . . . . . . . 39
V.1 Incoming Bandwidth Limiting Test . . . . . . . . . . . . . . . . . . . 42
V.2 Incoming Bandwidth Group 0 - 10000 bytes/sec Minimum Assured . 44
V.3 Incoming Bandwidth Group 1 - 20000 bytes/sec Minimum Assured . 45
V.4 Incoming Bandwidth Group 2 - 30000 bytes/sec Minimum Assured . 46
V.5 Incoming Bandwidth Group 3 - 40000 bytes/sec Minimum Assured . 47
V.6 Outgoing Bandwidth Group 0 - 10000 bytes/sec Minimum Assured . 48
V.7 Outgoing Bandwidth Group 1 - 20000 bytes/sec Minimum Assured . 49
V.8 Outgoing Bandwidth Group 2 - 30000 bytes/sec Minimum Assured . 50
V.9 Outgoing Bandwidth Group 3 - 40000 bytes/sec Minimum Assured . 51
V.10 Outgoing Bandwidth Limiting Test . . . . . . . . . . . . . . . . . . . 52
x