Table Of ContentArtur Lugmayr, Samuli Niiranen, and Seppo Kalli
Digital Interactive TV and Metadata
Springer Science+Business Media, LLC
ONLINE LlBRARY
Engineering
http://www.springer.de/engine/
Artur Lugmayr
Samuli Niiranen
Seppo Kalli
Digital Interactive TV
and Metadata
Future Broadcast Multimedia
With 83 Illustrations
, Springer
Artur Lugmayr
Samuli Niiranen
Seppo Kalli
Digital Media Institute
Tampere University of Technology
FIN-3310l Tampere
Finland
Library of Congress Cataloging-in-Publication Data
Lugmayr, Artur.
Digital interactive TV and metadata: Future broadcast multimedia
Artur Lugmayr, Samuli Niiranen, Seppo Kalli.
p. cm.
Includes bibJiographical references and index.
I. Interactive television. 2. Metadata. 3. Television broadcasting
Technological innovations. I. Niiranen, Samuli. 11. Kalli, Seppo. III. Title.
TK6679.3L84 2004
384.55-dc22 2004045616
Printed on acid-free paper.
ISBN 978-1-4419-1926-7 ISBN 978-1-4757-3953-4 (eBook)
DOI 10.1007/978-1-4757-3953-4
© 2004 Springer Science+Business Media New Y ork
Originally published by Springer-Verlag New York, LLC in 2004
All rights reserved. This work may not be translated or copied in whole or in part without
the written permission of the publisher Springer Science+Business Media, LLC,
except for brief excerpts in connection with
reviews or scholarly analysis. Use in connection with any form of information storage
and retrieval, electronic adaptation, computer software, or by similar or dissimilar meth
odology now known or hereafter developed is forbidden.
The use in this publication of trade names, trademarks, service marks, and similar terms,
even if they are not identified as such, is not to be taken as an expression of opinion as
to whether or not they are subject to proprietary rights.
9 8 7 654 3 2 1
www.springer-ny.com
springeronline.com
To our families, friends and colleagues
Preface
Recent years have brought many changes to the world of mass media. The In
ternet and mobile communications technology have provided consumers with
interactive digital services. Television is catching up with this trend through
the digitalization process. Digital television is a hybrid platform combining
elements from classical analog television and the Internet, providing modern
multimedia services on a familiar platform. In short, digital TV is a gateway
to the world of interactive digital media.
Digital TV brings consumers into the television service arena and offers
them new degrees of freedom. However, as the service and multimedia content
types diversify and the services and their content increase, television is facing
many of the same challenges of complexity and information overflow faced by
other digital media.
Metadata can handle the diverse services and content of digital TV effi.
ciently and in a consumer-friendly way. Metadata means that the data are
accompanied by other data which describe them. As data about data, meta
data can provide an insight into syntactically and semantically complex data
by distilling their essence to a set of simple descriptors. Metadata also helps
to structure and manage information in diverse settings. The use of metadata
in broadcast multimedia should not be restricted to being merely a tool for
coping with the challenges of a complex networked multimedia environment.
Instead, metadata ofTers new opportunities for the development of innovative
services.
The research done by the broadcasting multimedia group at the Digital Me
dia Institute (Institute of Signal Processing, Tampere University of Technol
ogy, Finland) has given us considerable experience and expertise with broad
band multimedia. Our search for novel types of interactive service led to our
applying metadata to digital TV. Metadata assists in bringing existing ser
vices to a new level and creating more advanced types.
Our research has focused on applying selected metadata standards to dig
ital TV. The search for a unified solution for integrating metadata into the
television service space showed MPEG-21 to be a good candidate solution
VIII Preface
for the creation, delivery and consumption of metadata-enabled services. The
digital broadcast item model (DBIM) catalyzes the digital item methodology
of MPEG-21 into a new converging concept for deploying metadata-based ser
vices in digital TV. The idea of the digital broadcast item model (DBIM) goes
back to the year 2001, when the IEEE standard for the learning object model
(LOM) was presented at a conference in Tampere, Finland. LOM introduced
unified metadata structures for e-learning content. The authors realized that
a similar structure was missing from the domain of digital TV. MPEG-21 was
then identified as the natural starting point for the development of a unified
metadata model for broadcast multimedia.
Our subsequent research work has focused on the development of a digital
broadcast model, its accompanying service architecture and the services it can
offer. The research work culminated in the establishment of an MPEG Ad
Hoc group "MPEG-21 in broadcasting" in 2003, chaired by the senior author
of this book, to promote standardization within ISO/IEC.
This book describes how the use of the unified metadata model in digital
broadcasting enhances traditional television service. Starting with a compre
hensive overview of broadcast multimedia and related metadata, architectural
design principles are presented for creating and using the digital TV platform
services with a unified multimedia asset model within a metadata processing
framework.
The digital broadcast item model represents a technical framework and a
set of guidelines for managing services throughout the broadcast life-cyde. In
short, it is a new converging concept for metadata in broadcasting. This is
described in detail with emphasis on new innovative services and pathways
that are likely to emerge over the next few years.
In the following there is a list with known trademarks mentioned in the
book: IEEE ® is a registered trademark of The Institute of Electrical and
Electronics Engineers, Incorporated; NOKIA ® is a registered trademark of
Nokia Corporation; Sun ®, Java ® and all Java-based marks are trademarks
or registered trademarks of Sun Microsystems, Inc. in the United States and
other countries; DVB ® and MHP ® are registered trademarks of the DVB
Project; SMPTE ® is a trademark of the Society of Motion Picture and
Television; W3C ® is a trademark (registered in numerous countries) of the
World Wide Web Consortium and marks of W3C are registered and held by its
host institutions MIT, ERCIM, and Keio; CableLabs ® and OpenCable ® are
trademarks of Cable Television Laboratories, Inc; the Bluetooth ® trademarks
©
are owned by Bluetooth SIG, Inc. Bluetooth SIG, Inc. 2004. ATSC, TV
Anytime, ISO/IEC, EBU and MPEG might be registered trademarks, but a
relevant note on their Web-sites could not be found.
This book was written at the Digital Media Institute (Prof. Hannu Es
kola, Director), Institute of Signal Processing (Prof. Moncef Gabbouj, Head)
of the Tampere University of Technology, Finland. Our institute has provided
a stimulating and open environment for the development of novel research
ideas. We thank all our friends and colleagues for their discussions and com-
Preface IX
panionship. Special credit goes to the members of the project teams of the
broadcasting multimedia group, namely: Heikki Lamminen, Mathew Anurag
Mailaparampil, Florina Tico, Mikko Oksanen, Perttu Rautavirta, Jussi Lyyti
nen, Heikki Mattila and Kirsi Keskiruusi.
Many thanks go to Prof. Frans Mäyrä of the Hypermedia Laboratory,
Tampere University, Finland, for all his discussions about interactive nar
rative media and for his stimulating viewpoints. Credit also go es to Marie
Laure Ryan for many fruitful discussions about interactive narratives. We are
indebted to Ismo Rakkolainen for discussions and for screenshots of his fog
screen. Thanks go to Ville Holopainen for help with editing the numerous
graphics of the book. Thanks also go to Johannes Messner at the depart
ment for scientific computing at the networking department at the Technical
1J\TEX
University of Linz for many years of tips and tricks. We thank our pub
lisher, Springer-Verlag New York, Inc., for their help and patience. Special
thanks go to Margaret Mitchell. We would also like to thank Prof. Irek Defee
and Prof. Reiner Creutzburg for their contributory discussions. Many thanks
go to Hanna-Greta Puurtinen from eTampere for administrative help.
Many thanks also go to MPEG and all its marvelous members. We would
like to say thanks to the MPEG Ad-Hoc group "MPEG-21 in broadcast
ing" members, especially to the co-chairs: Itaru Kaneko (Advanced Research
Institute for Science and EngineeringjRISEjWaseda University, Japan), Ab
dellatif Benjellountouimib (France Telecom, France) and Jong-Nam Kim (Ko
rean Broadcasting System (KBS), Korea). To Prof. Andrew Perkis (NTNU,
Norway) and Jan Bormans (IMEC, Belgium) go many thanks for bringing us
closer to MPEG-21. Finally special thanks go to our families for all their love,
friendship and support. The first author especially would like to thank Riina
Pakarinen for her deep friendship.
The preparation of this book has been supported by a grant from the
NOKIA Foundation.
More information, book errata, software and other novelties can be found
on our Web-page at http://www.digitalbroadcastitern.tv.
Tampere, Artur Lugmayr
March 22, 2004 Samuli Niiranen
Prof. Seppo Kalli
Contents
1 New Paradigms in Broadcast Multimedia. . . . . . . . . . . . . . . . . . 1
1.1 Comparison of Classic Analog and Modern Digital TV ... . . . . 2
1.2 First Thoughts about Metadata in Broadcast Multimedia. . . . . 3
1.3 Basic Definitions ........................................ 4
1.4 Structure of the Book . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
Part I Theory
2 World of Digital Interactive TV ........................... 11
2.1 Broadcast Multimedia .................................... 11
2.1.1 MPEG-2......................................... 11
2.1.2 DVB ............................................. 13
2.1.3 MHP ............................................ 16
2.1.4 Emerging DVB Standardization Efforts .............. 18
2.1.5 ATSC-DASE and Open Cable. . . . . . . . . . . . . . . . . . . . . .. 18
2.1.6 ISDB-BML....................................... 19
2.1. 7 Adoption of the Standards. . . . . . . . . . . . . . . . . . . . . . . . .. 20
2.2 Digital TV Asset Lifecycle ................................ 20
2.3 Examples of Digital TV Value-Added Services .............. 23
2.3.1 Electronic Program Guide (EPG) ................... 23
2.3.2 Information Portal ................................ 23
2.3.3 Pay-per-View (PpV ) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 23
2.3.4 Video-on-Demand (VoD) ........................... 25
2.3.5 Education........................................ 25
2.3.6 Shopping......................................... 25
2.3.7 Games........................................... 25
2.3.8 Standard Internet Services. . . . . . . . . . . . . . . . . . . . . . . . .. 25
2.3.9 Communication ................................... 25
2.3.10 Community Services. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 28
2.3.11 Government . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 28
XII Contents
2.3.12 Health ........................................... 28
2.3.13 Finance and Banking . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 29
3 Metadata Fundamentals and Concepts . . . . . . . . . . . . . . . . . . .. 31
3.1 Digital TV Metadata Lifecycle . . . . . . . . . . . . . . . . . . . . . . . . . . .. 32
3.2 Theoretical Foundations of Metadata ...................... 33
3.2.1 Metadata Tier Model ............................. 34
3.2.2 Theory Behind the W3C Metadata Definition Family . 35
3.2.3 Practical Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 37
3.3 W3C Metadata Families . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 40
3.3.1 Overview of the W3C Metadata Families ............ 41
3.3.2 XML . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 42
3.3.3 XML Schema .................................... 43
3.4 MPEG-7 - Multimedia Content Description Interface. . . . . .. 44
3.4.1 Overview ........................................ 45
3.4.2 MPEG-7 Metadata Definitions ..................... 45
3.4.3 Basic Elements and Schema Tools .................. 48
3.4.4 Annotating Multimedia Assets ..................... 48
3.4.5 Grouping Multimedia Assets: Content Organization ... 49
3.4.6 Managing Conventional Media Archive Information . .. 49
3.4.7 Easy Navigation and Access ........................ 50
3.4.8 Personalization, User Interaction and Consumer Profiles 50
3.4.9 Audio Descriptors ................................ 51
3.4.10 Visual Descriptors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 51
3.4.11 MPEG-7 Systems ................................. 51
3.5 MPEG-21 Packages Multimedia Assets .... . . . . . . . . . . . . . . .. 53
3.5.1 Perception of Multimedia Assets through DIs ........ 55
3.5.2 Digital Item Declaration (DIDL) .................... 56
3.5.3 Digital Item Adaptation. . . . . . . . . . . . . . . . . . . . . . . . . .. 59
3.5.4 Road Ahead for MPEG-21 . . . . . . . . . . . . . . . . . . . . . . . .. 59
3.6 MHP and Metadata. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 60
3.6.1 "Metadata Way" of MHP . . . . . . . . . . . . . . . . . . . . . . . . .. 61
3.6.2 DVB-HTML. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .. 62
3.7 TV-Anytime ........................................... 63
3.7.1 Personal Data Recorder ........................... 64
3.7.2 Content Reference Identifier (CRID) ................ 65
3.7.3 Metadata Process Model. .......................... 66
3.7.4 Metadata Definitions .............................. 66
3.7.5 Broadcast Channel Aspects ........................ 69
3.7.6 Feedback Channel Aspects ......................... 69
3.8 SMPTE Metadata Definitions . . . . . . . . . . . . . . . . . . . . . . . . . . .. 69
3.8.1 SMPTE Metadata Dictionary (Content and Structure) 70
3.8.2 Universal Material Identifier (UMID) . . . . . . . . . . . . . . .. 71
3.8.3 Key-Length-Value (KLV) . . . . . . . . . . . . . . . . . . . . . . . . .. 72
3.9 Advanced Authoring Format (AAF) . . . . . . . . . . . . . . . . . . . . . .. 72
