Table Of Content3D LIVE – 3D Live Interactions through Visual Environments Project N. 318483
D2. 2: Report on the needs and requirements of the 3D-Live platform
Date 13/11/2013
D2.2 Report on the Needs and Requirements
of the 3D LIVE Platform
Deliverable data
Deliverable no & name D2.2 Report on the Needs and Requirements of the 3DLive Platform
Main Contributors ARTS
Other Contributors CERTH/ITI, IT Innov, CYBER, CENG, SportsC
Deliverable Nature R
PU Public X
Dissemination level
Restricted to other program participants
PP
(including the Commission Services)
Restricted to a group specified by the
RE consortium (including the Commission
Services)
Confidential, only for members of the
CO consortium (including the Commission
Services)
Date 13/11/2013
Status First Version – Update after reviewers’ recommendations letter.
3D LIVE Consortium Dissemination: Public 1/132
3D LIVE – 3D Live Interactions through Visual Environments Project N. 318483
D2. 2: Report on the needs and requirements of the 3D-Live platform
Date 13/11/2013
Document history
Version Date Author /Reviewer Description
V0.1 06/03/2013 B.Poussard Initial Structure
V0.2 16/05/2013 All partners Fusion of contributions, Formatting adjustments
V1.0 31/05/2013 B.Poussard First Version to be reviewed by 3DLive partners.
V1.1 10/06/2013 All partners Updates after the first review:
- Spelling/vocabulary review
- Key terms section moved
- Discussion and Conclusion updates
- Update needs and requirements details missing for
uses cases’ scenarios
V1.2 17/06/2013 All partners Update scenarios in appendix, Update legends and final
formatting details.
V1.3 19/06/2013 B. Poussard Formatting updates
V2.0 21/06/2013 B. Poussard Final Version
V2.1 25/10/2013 B. Poussard Modifications thanks to reviewers’ recommendations:
V2.2 12/11/2013 B. Poussard Editing the Executive Summary.
S. Asteriadis Formatting modifications.
Updating Requirements: [3.1.1], [3.2.1], [3.2.2], [3.3.3],
[4.1.1], [6.1.1], [6.2.1], [6.4.1 ], [6.4.3],
V2.3 13/11/2013 B. Poussard Adding some words about 3D audio in 6.1.1 + key term
3D Sound. Adding a paragraph in the Golf users’
S. Asteriadis.
recruitment section and in the concluding remarks.
Updating requirements: [1.1.8], [1.1.6], [1.1.9], [3.2.2],
[3.5.5], [4.2.2].
3D LIVE Consortium Dissemination: Public 2/132
3D LIVE – 3D Live Interactions through Visual Environments Project N. 318483
D2. 2: Report on the needs and requirements of the 3D-Live platform
Date 13/11/2013
Updating section 6.5.1
Formatting annex page numbering.
3D LIVE Consortium Dissemination: Public 3/132
3D LIVE – 3D Live Interactions through Visual Environments Project N. 318483
D2. 2: Report on the needs and requirements of the 3D-Live platform
Date 13/11/2013
Table of Contents
1 EXECUTIVE SUMMARY ....................................................................................................................... 6
2 INTRODUCTION ..................................................................................................................................... 7
2.1 SUMMARY OF 3D LIVE PROJECT ......................................................................................................... 7
2.2 PARTNERS IN 3D LIVE PROJECT .......................................................................................................... 7
2.3 PURPOSE, INTENDED AUDIENCE AND SCOPE ........................................................................................ 7
2.4 RELATED 3D LIVE DOCUMENTS ......................................................................................................... 8
2.5 FUNCTIONAL DESCRIPTION OF WORKPACKAGES ................................................................................. 8
2.6 STRUCTURE OF THE DELIVERABLE ...................................................................................................... 9
2.7 DISCUSSION ON EC REVIEWING TEAM REMARKS ............................................................................... 10
3 KEY TERMS ........................................................................................................................................... 11
4 PREVIOUS WORK ................................................................................................................................. 13
4.1 3D TELE-IMMERSIVE ENVIRONMENTS ............................................................................................... 13
4.2 AUGMENTED SPORT EXPERIMENTATIONS .......................................................................................... 15
5 NEEDS AND REQUIREMENTS OF THE THREE USE-CASES’ SCENARIOS ............................ 24
6 NEEDS AND REQUIREMENTS FOR THE 3D LIVE MODULES .................................................. 30
6.1 RENDERING AND VISUALISATION ...................................................................................................... 30
6.1.1 Needs identified in the module 1: Rendering and Visualization ................................................... 30
6.1.2 Requirements of component 1.1: Rendering Engine ..................................................................... 30
6.1.3 Requirements of component 1.2: Display systems ........................................................................ 32
6.1.4 Requirements of component 1.3: Rendering Hardware ................................................................ 34
6.1.5 Requirements of component 1.4: Sensory-motor interfaces .......................................................... 35
6.1.6 Requirements of component 1.5: Social Platform......................................................................... 36
6.1.7 Requirements of component 1.6: Evaluation Tool ........................................................................ 37
6.1.8 Requirements of component 1.7: User Interface........................................................................... 39
6.1.9 Rendering and Visualization: Traceability Matrix ....................................................................... 40
6.2 3D RECONSTRUCTION OF ENVIRONMENT .......................................................................................... 43
6.2.1 Needs identified in the module 2: 3D Environment Reconstruction ............................................. 43
6.2.2 Requirements of component 2.1: Gateway .................................................................................. 44
6.2.3 Requirements of component 2.2: Sensor Agent............................................................................. 45
6.2.4 Requirements of component 2.3: AMQP Interface ....................................................................... 46
6.2.5 Requirements of component 2.4: Data Manager .......................................................................... 47
6.2.6 Requirements of component 2.5: Sensor Data Fusion Service ..................................................... 48
6.2.7 Requirements of component 2.6: Live Environment Modeller ...................................................... 49
6.2.8 3D Reconstruction of Environment Traceability matrix ............................................................... 50
6.3 BODY 3D RECONSTRUCTION ............................................................................................................. 51
6.3.1 Needs identified in the module 3: Body 3D Reconstruction .......................................................... 51
6.3.2 Requirements of component 3.1: Animation ................................................................................. 51
6.3.3 Requirements of component 3.2: Reconstruction.......................................................................... 52
6.3.4 Requirements of component 3.3: ECC metrics ............................................................................. 53
6.3.5 Body 3D Reconstruction Traceability matrix ............................................................................... 55
6.4 ACTIVITY RECOGNITION .................................................................................................................... 56
6.4.1 Needs identified in the module 4: Activity Recognition ................................................................ 56
6.4.2 Requirements of component 4.1: Activity recognition .................................................................. 56
6.4.3 Requirements of component 4.2: ECC metrics ............................................................................. 57
6.4.4 Activity Recognition Traceability matrix ...................................................................................... 58
6.5 VOICE COMMUNICATIONS MODULE .................................................................................................. 59
6.5.1 Needs identified in the module 5: Voice Communications ............................................................ 59
6.5.2 Requirements of component 5.1: Indoor communication system .................................................. 59
6.5.3 Requirements of component 5.2: Outdoor communication system ............................................... 60
6.5.4 Requirements of component 5.3: Voice Communications client ................................................... 61
6.5.5 Requirements of component 5.4: Voice Communications server .................................................. 62
3D LIVE Consortium Dissemination: Public 4/132
3D LIVE – 3D Live Interactions through Visual Environments Project N. 318483
D2. 2: Report on the needs and requirements of the 3D-Live platform
Date 13/11/2013
6.5.6 Requirements of component 5.5: Evaluation tool ......................................................................... 62
6.5.7 Voice Communications Traceability matrix ................................................................................. 63
6.6 DATA COMPRESSION AND TRANSMISSION .......................................................................................... 64
6.6.1 Needs identified in the module 6: Data Compression and Transmission ..................................... 64
6.6.2 Requirements of component 6.1: Compression ............................................................................. 64
6.6.3 Requirements of component 6.2: Decompression ......................................................................... 65
6.6.4 Requirements of component 6.3: ECC metrics ............................................................................. 66
6.6.5 Requirements of component 6.4: Transmission ............................................................................ 67
6.6.6 Data Compression and Transmission Traceability matrix ........................................................... 68
6.7 EVALUATION MODULE ...................................................................................................................... 69
6.7.1 Needs identified in the module 7: Evaluation ............................................................................... 69
6.7.2 Requirements of component 7.1: AMQP Interface ...................................................................... 71
6.7.3 Requirements of component 7.2: ECC API ................................................................................... 72
6.7.4 Requirements of component 7.3: Experiment Monitoring System (EM) ....................................... 73
6.7.5 Requirements of component 7.4: Experiment Data Management (EDM) .................................... 74
6.7.6 Requirements of component 7.5: ECC Dashboard ...................................................................... 75
6.7.7 Evaluation Traceability matrix ..................................................................................................... 76
7 NEEDS AND REQUIREMENTS FOR THE 3D-LIVE USER COMMUNITIES ............................. 77
7.1 PROFILING OF USERS ......................................................................................................................... 77
7.1.1 User Profile .................................................................................................................................. 77
7.1.2 User Profile definitions ................................................................................................................. 77
7.1.3 Demographic profile ..................................................................................................................... 78
7.2 RECRUITMENT OF USERS .................................................................................................................... 80
7.2.1 Management of the community ..................................................................................................... 80
7.2.2 Users for the Ski use-case ............................................................................................................. 81
7.2.3 Users for the Golf use-case ........................................................................................................... 81
7.2.4 Users for the Jogging use-case ..................................................................................................... 81
8 DISCUSSION AND CONCLUSION ..................................................................................................... 82
8.1 DISCUSSION ....................................................................................................................................... 82
8.2 CONCLUDING REMARKS .................................................................................................................... 83
9 REFERENCES......................................................................................................................................... 84
10 APPENDIX A: JOGGING SCENARIO ................................................................................................ 86
11 APPENDIX B: SKIING SCENARIO .................................................................................................... 99
12 APPENDIX C: GOLFING SCENARIO .............................................................................................. 115
13 APPENDIX D: FOLLOWERS’ SOCIAL PLATFORM SCENARIO .............................................. 130
3D LIVE Consortium Dissemination: Public 5/132
3D LIVE – 3D Live Interactions through Visual Environments Project N. 318483
D2. 2: Report on the needs and requirements of the 3D-Live platform
Date 13/11/2013
1 Executive Summary
The report on the needs and requirements of the 3D -LIVE platform gathers both the
technical specifications of the 3D-LIVE prototype and the user’s needs and requirements of
the users that leaded to the final specifications . In the first version of the deliverable, a
platform has been designed to be proposed to the final 3DLIVE users. It is a set of minimal
components and requirements to guarantee the Tele -Immersive experience. This architecture
is going to evolve thanks to users’ needs and requirements identification, so then the
specifications of the scenarios and the different modules will evolve as well.
Thanks to the input of the WP1 deliverables, a study of the previous work done has been
conducted in order to situate 3D-LIVE among other Augmented Sport platforms. The result
is our platform brings a new kind of experience of Tele-Immersion about more or less
complicated activities using Mixed Reality systems including reconstruction of real humans
and real environments.
Three scenarios have been proposed by the consortium about skiing, jogging and golfing
activities to apply the 3D-LIVE platform. The identification of the needs and requirements
of these scenarios led us to a first description of the specifications of the platform that
presents in different tables the requirements of the technical components used in 3D-LIVE.
Each requirement owns an identifier and is directly linked to the functionalities exposed in
the report on the Conceptual Design of the 3D-LIVE platform (D2.1). To understand those
links, traceability matrices indicate which functionality is concerned by the technical
requirements.
In upcoming versions of this deliverable, a section gathering reports on the user needs and
requirements will be added as the outcomes of the co-creation activities with the users,
improving the design of the platform and the technical requirements of it.
3D LIVE Consortium Dissemination: Public 6/132
3D LIVE – 3D Live Interactions through Visual Environments Project N. 318483
D2. 2: Report on the needs and requirements of the 3D-Live platform
Date 13/11/2013
2 Introduction
2.1 Summary of 3D LIVE Project
The 3D LIVE project aims to develop and experiment a User Driven Mixed Reality and
Immersive (Twilight) platform connected to EXPERIMEDIA facilities (FIRE testbeds) in
order to investigate the Future Internet (FI) bro adband capacity to support Real-Time
immersive situations as well as evaluating both the Quality of Experience (QoE) and Quality
of Services when users are fully immersed into Future Internet (IoS and IoT) based live
(sport) mixed environments. The main objective consists to explore 3D/Media technologies
and Internet of things in real and virtual environments in order to sense and experiment live
situations. The combination of FIRE testbeds and Living Labs would enable both
researchers and users to explore Future Internet capacities to enter the Tele -Immersive
application market and to establish new requirements for Internet technology and
infrastructure. It is expected that combining bo th FI technology pull and Tele-Immersion
market pull would promote and accelerate the creation and adoption of innovative sportive
events based FI Services by user communities (e.g. sport practitioners).
2.2 Partners in 3D LIVE project
Collaborative Engineering, Italy (Project Coordinator)
Centre for Research and Technology Hellas, Informatics and Telematics
Institute, Greece
University of Southampton, IT Innovation, UK
Arts & Metiers ParisTech, France
SportsCurve, Germany
Cyberlightning Ltd, Finland
2.3 Purpose, Intended Audience and Scope
This document is reporting the results of the work achieved in the task T1.2, within the
Workpackage 2 (WP2). This task is dedicated to the exploration of the needs and
requirements of the 3DLive Tele-Immersive Environment.
This deliverable shows a brief reminder on previous work done about Tele -Immersive
Environments and existing Augmented Sport platforms and experiments. Then the three
3DLive use-case scenarios are presented. With the analysis of these scenarios come the
3D LIVE Consortium Dissemination: Public 7/132
3D LIVE – 3D Live Interactions through Visual Environments Project N. 318483
D2. 2: Report on the needs and requirements of the 3D-Live platform
Date 13/11/2013
needs and requirements identified for this platform, and also for the community of users that
will help the consortium in the design process and experime nt the platform.
The intended audience of this deliverable is mainly the 3DLive consortium. This document
is the reference for the different partners at the implementation stage. It will facilitate the
understanding of the assembly of the different module s in the overall system, and give
necessary information on the interfaces between the modules. This document will be
reviewed after each session of experimentations during the Workpackage 4 (WP4).
The final revision will have a different audience and obje ctives, and will bring researchers
some basis to design 3D Tele - Immersive Environments in the context of augmented sport.
2.4 Related 3D LIVE Documents
AD(1). 3D LIVE DoW
AD(2). 3D LIVE D2.1 Report on the Conceptual Design of the 3D -Live Platform
AD(3). 3D LIVE D1.1 Investigating and Formalise an Exper iential Design Process
AD(4). 3D LIVE D1.2 Study and Create the Holistic User Experience Model
2.5 Functional Description of Workpackages
The Workpackages of the 3DLive project group the tasks over the time considering 3
steps: The Concept Modelling, the Exploration and Prototyping and the Experimentation
and Evaluation.
The WP6 and WP5 are continuously active during the entire project as they consist in
management and dissemination.
The WP1 is related to the design of the UX Model & Methodology, correlated to the WP2
that is the design of the 3DLive platform. Concurrently to the Design phase, the WP3 starts
the prototyping of some components of the platform, while the WP4 prepare the experiment
sessions. Once the first prototype is validated, there is an iterative process that consists in
experimenting and evaluating the platform, and then a second design phase is necessary to
3D LIVE Consortium Dissemination: Public 8/132
3D LIVE – 3D Live Interactions through Visual Environments Project N. 318483
D2. 2: Report on the needs and requirements of the 3D-Live platform
Date 13/11/2013
deliver a second improved prototype.
Diagram 1. Structure of the 3DLive Workpackages
2.6 Structure of the Deliverable
This deliverable is structured in the following sections: The section 4 presents the previous
work done on Tele-Immersive Environments, Augmented sports existing platforms and
experiments. The section 5 describes the needs and requirements of scenarios for the three
3DLive use-cases, that are Skiing, Jogging and Golfing. The section 6 gathers the detailed
needs and requirements for each module of the 3DLive platform and the section 7 is related
to the 3DLive user community. The section 8 concludes this document.
3D LIVE Consortium Dissemination: Public 9/132
3D LIVE – 3D Live Interactions through Visual Environments Project N. 318483
D2. 2: Report on the needs and requirements of the 3D-Live platform
Date 13/11/2013
2.7 Discussion on EC Reviewing team remarks
As mentioned in the reviewers’ comments, the table of content and the numbering of
pages were very messy. It has been completely reviewed and updated in order to keep a
consistent formatting along the report. There are no remaining white spaces due to versions
compatibility, the formatting has been controlled by one main author. The executive
summaries of the D2.1 and D2.2 were just summing up the 3D -LIVE project as a whole.
This section has been updated in both the deliverables to properly describe their content
instead.
The methodology to define the needs and requirements was not convincing enough
according to the reviewers’ comments; what we tried to explain in this document is that
technical needs and requirements are often based on partners’ knowledge in their different
fields of expertise, and based on research work. For instance Sound Spatialization is a
standard need to immerse users in a virtual environment; it is even widely used in Virtual
Reality systems or in video games. What we do is virtually reproducing real feedbacks to
fake the users’ senses and brain, and hearing is very important. As a consequence some
paragraphs have been added, but no section describing an overall methodology was written.
The report presents technical solutions rather than user needs because the first
version is only following the « lead-users » methodology. We described there a first
proposal of a framework including more technical needs. With the coming co -creation
activities including end users, a section will be added to present their needs and the
requirements identified thanks to different workshops and tests with them. This will appear
in the last version of this document (and in the D2.1, as it will be impacted as well).
Several requirements were updated and better justified: [1.1.8], [1.1.6], [1.1.9],
[3.1.1], [3.2.1], [3.2.2], [3.3.3], [3.5.5], [4.1.1], [4.2.2], [6.1.1], [6.2.1], [6.4.1], [6.4.3]. Some
of the requirements presented in this document can not be assessed by a quantitative
measurement. We know it and we planned to cover those thanks to questionnaires for
instance. Then all the different metrics or questionnaires data to be measured are reported in
the deliverables of the WP4 based on work done in the WP1 about the assessment of such a
tele immersive environment.
3D LIVE Consortium Dissemination: Public 10/132
