Table Of ContentHenning Müller
Oscar Alfonso Jimenez del Toro
Allan Hanbury
Georg Langs
Antonio Foncubierta Rodríguez (Eds.)
9
5 Multimodal Retrieval
0
9
S
C in the Medical Domain
N
L
First International Workshop, MRMD 2015
Vienna, Austria, March 29, 2015
Revised Selected Papers
123
Lecture Notes in Computer Science 9059
Commenced Publication in 1973
Founding and Former Series Editors:
Gerhard Goos, Juris Hartmanis, and Jan van Leeuwen
Editorial Board
David Hutchison
Lancaster University, Lancaster, UK
Takeo Kanade
Carnegie Mellon University, Pittsburgh, PA, USA
Josef Kittler
University of Surrey, Guildford, UK
Jon M. Kleinberg
Cornell University, Ithaca, NY, USA
Friedemann Mattern
ETH Zurich, Zürich, Switzerland
John C. Mitchell
Stanford University, Stanford, CA, USA
Moni Naor
Weizmann Institute of Science, Rehovot, Israel
C. Pandu Rangan
Indian Institute of Technology, Madras, India
Bernhard Steffen
TU Dortmund University, Dortmund, Germany
Demetri Terzopoulos
University of California, Los Angeles, CA, USA
Doug Tygar
University of California, Berkeley, CA, USA
Gerhard Weikum
Max Planck Institute for Informatics, Saarbrücken, Germany
More information about this series at http://www.springer.com/series/7409
ü
Henning M ller Oscar Alfonso Jimenez del Toro
(cid:129)
Allan Hanbury Georg Langs
(cid:129)
í
Antonio Foncubierta Rodr guez (Eds.)
Multimodal Retrieval
in the Medical Domain
First International Workshop, MRMD 2015
Vienna, Austria, March 29, 2015
Revised Selected Papers
123
Editors
Henning Müller Georg Langs
University of AppliedSciences Western Medical University of Vienna
Switzerland (HES-SO) Vienna
Sierre Austria
Switzerland
AntonioFoncubierta Rodríguez
Oscar AlfonsoJimenez del Toro ETHZentrum
University of AppliedSciences Western Zürich
Switzerland (HES-SO) Switzerland
Sierre
Switzerland
AllanHanbury
Vienna University of Technology
Vienna
Austria
ISSN 0302-9743 ISSN 1611-3349 (electronic)
Lecture Notesin Computer Science
ISBN 978-3-319-24470-9 ISBN978-3-319-24471-6 (eBook)
DOI 10.1007/978-3-319-24471-6
LibraryofCongressControlNumber:2015950928
LNCSSublibrary:SL3–InformationSystemsandApplications,incl.Internet/Web,andHCI
SpringerChamHeidelbergNewYorkDordrechtLondon
©SpringerInternationalPublishingSwitzerland2015
Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpartofthe
material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation,
broadcasting, reproduction on microfilms or in any other physical way, and transmission or information
storageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilarmethodologynow
knownorhereafterdeveloped.
Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication
doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant
protectivelawsandregulationsandthereforefreeforgeneraluse.
Thepublisher,theauthorsandtheeditorsaresafetoassumethattheadviceandinformationinthisbookare
believedtobetrueandaccurateatthedateofpublication.Neitherthepublishernortheauthorsortheeditors
give a warranty, express or implied, with respect to the material contained herein or for any errors or
omissionsthatmayhavebeenmade.
Printedonacid-freepaper
SpringerInternationalPublishingAGSwitzerlandispartofSpringerScience+BusinessMedia
(www.springer.com)
Preface
The workshop on Multimodal Retrieval in the Medical Domain (MRMD) took place
for the first time on March 29, 2015, in Vienna, Austria in connection with the ECIR
(European Conference on Information Retrieval) conference. The workshop had as its
main goal to bring the medical information analysis and the information retrieval
communities together. The multimodal focus highlighted the importance of data other
than text for information retrieval, in particular images, and usually this is used in
combination with text for the retrieval stage. Further emphasis was on semantic data
analysisandonscalabilityofapproachestowardsbigdatasetsthatareoftendifficultto
obtain in the medical field.
The workshop received 11 paper submissions of which four were accepted as full
papers and three obtained a conditional acceptance. These three papers were then
reviewedagainandwereacceptedasfullpapersintheirrevisedversions.Inadditionto
these seven papers, the proceedings contain one paper of an invited speaker that was
also reviewed, a workshop overview paper, and five papers on the VISCERAL
Retrieval Benchmark. The VISCERAL Retrieval Benchmark was an important part
of the workshop, and of these proceedings, as such evaluation challenges enable us to
compare the algorithms of several research groups on the same data and in the same
scenario. The VISCERAL Retrieval Benchmark is actually the first retrieval bench-
mark that includes 3D medical data and also semantic terms.
Over 25 persons participated in the workshop and the high-quality presentations
sparked many discussions on medical information analysis and the evaluation of the
approaches.
March 2015 Henning Müller
Oscar Alfonso Jiménez Del Toro
Allan Hanbury
Georg Langs
Antonio Foncubierta Rodríguez
Organization
Program Committee
Sameer Antani National Library of Medicine, Bethesda, MD, USA
Jenny Benois-Pineau University of Bordeaux, France
Weidong Cau University of Sydney, Australia
Jean-Pierre Chevallet University Joseph Fourier, Grenoble, France
Gabriela Csurka Xerox Research, France
Dina Demner Fushman National Library of Medicine, Bethesda, MD, USA
Adrien Depeursinge EPFL and HES-SO, Switzerland
Antonio Foncubierta ETHZ, Switzerland
Lorraine Goeuriot University Joseph Fourier, Grenoble, France
Orcun Goksel ETHZ, Switzerland
Allan Hanbury TU Wien, Austria
Oscar Jimenez HES-SO, Sierre, Switzerland
Georg Langs Medical University of Vienna, Austria
Dimitrios Markonis HES-SO, Sierre, Switzerland
Bjoern Menze Technical University of Munich, Germany
Henning Müller HES-SO, Sierre, Switzerland
Angus Roberts University of Shffield, UK
Stefan Schulz University of Graz, Austria
Theodora Tsikrika CERTH, Thessaloniki, Greece
Contents
Overview of the First Workshop of Muldimodal Retrieval in the Medical
Domain (MRMD 2015). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
Henning Müller, Oscar Jiménez–del–Toro, Allan Hanbury,
Georg Langs, and Antonio Foncubierta–Rodríguez
Accepted Papers
Semantic Retrieval of Radiological Images with Relevance Feedback . . . . . . 11
Camille Kurtz, Paul-André Idoux, Avinash Thangali, Florence Cloppet,
Christopher F. Beaulieu, and Daniel L. Rubin
BioASQ: A Challenge on Large-Scale Biomedical Semantic Indexing
and Question Answering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
Georgios Balikas, Anastasia Krithara, Ioannis Partalas,
and George Paliouras
Rewriting Natural Language Queries Using Patterns . . . . . . . . . . . . . . . . . . 40
Lina F. Soualmia, Romain Lelong, Badisse Dahamna,
and Stéfan J. Darmoni
Content-Based Retrieval of Brain Diffusion Magnetic Resonance Image . . . . 54
Siqi Liu, Nur Hadi, Sidong Liu, Sonia Pujol, Ron Kikinis, Fan Zhang,
Dagan Feng, and Weidong Cai
The Application of KAZE Features to the Classification
Echocardiogram Videos. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
Wei Li, Yu Qian, Martin Loomes, and Xiaohong Gao
Multi-modal Indexing and Retrieval Using an LSA-Based Kernel. . . . . . . . . 73
Spyridon Stathopoulos and Theodore Kalamboukis
Semi–supervised Learning for Image Modality Classification . . . . . . . . . . . . 85
Alba García Seco de Herrera, Dimitrios Markonis, Ranveer Joyseeree,
Roger Schaer, Antonio Foncubierta-Rodríguez, and Henning Müller
Annotation of Chest Radiology Reports for Indexing and Retrieval. . . . . . . . 99
Dina Demner-Fushman, Sonya E. Shooshan, Laritza Rodriguez,
Sameer Antani, and George R. Thoma
VIII Contents
VISCERAL Retrieval Benchmark
Overview of the VISCERAL Retrieval Benchmark 2015 . . . . . . . . . . . . . . . 115
Oscar Alfonso Jiménez–del–Toro, Allan Hanbury, Georg Langs,
Antonio Foncubierta–Rodríguez, and Henning Müller
Multimodal Medical Case-Based Retrieval on the Radiology Image
and Report: SNUMedinfo at VISCERAL Retrieval Benchmark. . . . . . . . . . . 124
Sungbin Choi
Medical Case-Based Retrieval of Patient Records Using the RadLex
Hierarchical Lexicon. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129
Assaf B. Spanier and Leo Joskowicz
USYD/HES-SO in the VISCERALRetrieval Benchmark . . . . . . . . . . . . . . . 139
Fan Zhang, Yang Song, Weidong Cai, Adrien Depeursinge,
and Henning Müller
RadLex Terms and Local Texture Featuresfor Multimodal Medical
Case Retrieval . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 144
Oscar Alfonso Jiménez–del–Toro, Pol Cirujeda, Yashin Dicente Cid,
and Henning Müller
Author Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153
Overview of the First Workshop of Muldimodal
Retrieval in the Medical Domain (MRMD 2015)
B
Henning Mu¨ller1,2, Oscar Jim´enez–del–Toro1( ), Allan Hanbury3,
Georg Langs4, and Antonio Foncubierta–Rodr´ıguez5
1 University of Applied Sciences Western Switzerland (HES–SO), Sierre, Switzerland
[email protected]
2 University Hospitals and University of Geneva, Geneva, Switzerland
3 Technical University of Vienna, Vienna, Austria
4 Medical University of Vienna, Vienna, Austria
5 ETHZ Zu¨rich, Zu¨rich, Switzerland
Abstract. TheworkshopMultimodalRetrievalintheMedicalDomain
(MRMD) took place in connection with the European Conference of
InformationRetrieval(ECIR)inVienna,AustriaonMarch29,2015.The
workshopincludedtwoinvitedpresentationsandsevenacceptedscientific
papers. A session on the VISCERAL (VISual Concept Extraction in
RAdioLogy) Retrieval Benchmark, an information retrieval benchmark
combiningsemanticswith3Dimages,wasincludedintheworkshopand
four groups presented their results on the benchmark using the same
database and query topics to produce comparable results. The end of
theworkshopfeaturedadiscussionsessionwiththeinvitedspeakersand
workshoporganizersregardingwhatisnowneededtoadvancelarge–scale
multimodal medical information retrieval.
1 Introduction
The workshop MRMD (Multimodal Retrieval in the Medical Domain) took
place for the first time in March 2015. Its organization was supported by the
VISCERAL1 (Visual Concept Extraction in Radiology) project that organized
several evaluation benchmarks in the medical domain, notably for image seg-
mentation,lesiondetectionandinformationretrieval.Thebenchmarkswererun
in a cloud–based infrastructure with the goal to move the algorithm to the data
rather than the data to the algorithms [5].
Theworkshopreceivedelevenscientificpapersubmissionsofwhichfourwere
acceptedandthreeconditionallyacceptedwithasecondroundreview.Allcondi-
tionallyacceptedpaperswereacceptedafterthereviewcommentswereincluded
intotheresubmissionandthepaperswerere–reviewed.Inadditiontothescien-
tific presentations, two invited speakers presented on closely related topics, one
on semantic data representation and matching for image analysis and the other
invitedspeakeronusingverylargeamountsofimagingdataandrelatedclinical
1 http://visceral.eu/.
(cid:2)c SpringerInternationalPublishingSwitzerland2015
H.Mu¨lleretal.(Eds.):MRMD2015,LNCS9059,pp.1–7,2015.
DOI:10.1007/978-3-319-24471-61
