Treebanks: Building and Using Parsed Corpora

403 Pages·2003·17.24 MB·Text, Speech and Language Technology 20

by  Ann Taylor, Mitchell Marcus, Beatrice Santorini (auth.), Anne Abeillé (eds.)

Treebanks
Text, Speech and Language Technology
VOLUME 20
Series Editors
Nancy Ide, Vassar College, New York
Jean Veronis, Universite de Provence and CNRS, France
Editorial Board
Harald Baayen, Max Planck Institute for Psycholinguistics, The Netherlands
Kenneth W. Church, AT & T Bell Labs, New Jersey, USA
Judith Klavans, Columbia University, New York, USA
David T. Barnard, University of Regina, Canada
Dan Tufis, Romanian Academy of Sciences, Romania
Joaquim Llisterri, Universität Autonoma de Barcelona, Spain
Stig Johansson, University of Oslo, Norway
Joseph Mariani, LIMSI-CNRS, France
The titles published in this series are listed at the end of this volume.
Treebanks
Building and Using Parsed Corpora
Edited by
Anne Abeille
Universite Paris 7, Paris, France
Springer Science+Business Media, LLC
A C.I.P. Catalogue record for this book is available from the Library of Congress.
ISBN 978-1-4020-1335-5 ISBN 978-94-010-0201-1 (eBook)
DOI 10.1007/978-94-010-0201-1
Printed on acid-free paper
All Rights Reserved
© 2003 Springer Science+Business Media New York
Originally published by Kluwer Academic Publishers 2003
Softcover reprint of the hardcover 1st edition 2003
No part of this work may be reproduced, stored in a retrieval system, or transmitted
in any form or by any means, electronic, mechanical, photocopying, microfilming, recording
or otherwise, without written permission from the Publisher, with the exception
of any material supplied specifically for the purpose of being entered
and executed on a computer system, for exclusive use by the purchaser of the work.
Contents
Preface XI
Introduction xiii
AnneAbeilie
I BuildingTreebanks Xv
2 Using treebanks xix
PartI Buildingtreebanks
ENGLISH TREEBANKS
Chapter I
THE PENNTREEBANK: ANOVERVIEW 5
Ann Taylor,Mitchell Marcus, BeatriceSantorini
I Theannotationschemes 6
2 Methodology 16
3 Conclusions 20
Chapter2
THOUGHTS ONTWO DECADES OF DRAWINGTREES 23
GeoffreySampson
I Historical background 23
2 Buildingtreebanks 26
3 Exploitingthe SUSANNETreebank 29
4 Small isbeautiful 33
5 Annotatingaspokencorpus 35
6 Using the CHRISTlNE Corpus 38
7 Conclusion 40
Chapter3
BANK OF ENGLISH ANDBEYOND 43
Timo Jiirvinen
I Introduction 43
2 Annotating200million words 44
3 ENGCG Syntax 52
4 FDG parser 54
5 Conclusion 56
v
VI TREEBANKS
Chapter4
COMPLETING PARSED CORPORA FROM CORRECTION TO EYO- 61
LUTION
Sean Wallis
I Introduction 61
2 Conventionalpost-correction 63
3 A paradigm shift: transversecorrection 65
4 Critique 68
GERMAN TREEBANKS
Chapter5
SYNTACTIC ANNOTATION OF A GERMAN NEWSPAPER CORPUS 73
Thorsten Brants, WojeieehSkut, Hans Uszkoreit
I Introduction 73
2 Treebankdevelopment 74
3 Corpusannotation 77
4 Applications 83
5 Conclusions 83
Appendix: Tagsets 87
Chapter6
ANNOTATION OF ERROR TYPES FOR A GERMAN NEWSGROUP 89
CORPUS
Markus Beeker,Andrew Bredenkamp,BertholdCrysmann, Juditn Klein
I Introduction 89
2 CorpusDescription 90
3 Annotation Strategy 91
4 AnnotationTools 93
5 Evaluation 96
6 First Results 98
7 Conclusion 99
SLAYIC TREEBANKS
Chapter7
THE POT: A 3-LEYEL ANNOTATION SCENARIO 103
AlenaBohmovd, fan Hajic, Eva Hajicovd, BarboraHladkd
I The Prague DependencyTreebank 103
2 MorphologicalLevel 104
3 AnalyticalLevel 106
4 MergingtheMorphologicaland the Analytical SyntacticLevel I14
5 TectogrammaticalLevel 114
6 PDT versions 1.0and 2.0 121
7 Conclusion 122
Appendix 126
Contents VII
Chapter8
AN HPSG-ANNOTATED TEST SUITE FOR POLISH 129
MalgorzataMarciniak,AgnieszkaMykowiecka, AdamPrzepiorkowski, Anna Kupsc
I Aims and design constraints 129
2 Correctnessand complexitymarkers 130
3 Linguistic phenomena 131
4 Annotation schema 136
5 Implementation issues 137
6 Conclusion 143
TREEBANKS FOR ROMANCE LANGUAGES
Chapter9
DEVELOPING A SPANISH TREEBANK 149
AntonioMoreno,SusanaLopez; Fernando Sdnchez; Ralph Grishman
I Introduction 149
2 Data selection 150
3 Annotation scheme 151
4 Tools 157
5 Debuggingand error statistics 158
6 Currentstate and future development 159
Appendix: Sampleoftrees 163
Chapter 10
BUILDING A TREEBANK FOR FRENCH 165
AnneAbeille,LionelClement,Francois Toussenel
I The tagging phase 166
2 The parsing phase 173
3 Currentstate and future work 180
4 Conclusion 181
Appendix 185
Chapter 11
BUILDING THE ITALIAN SYNTACTiC-SEMANTIC TREEBANK 189
Simonetta Montemagni, Francesco Barsotti, Marco Battista,Nicoleua Calzolari, Or
nella Corazzari;AlessandroLenci,AntonioZampolli;Francesca Fanciulli,Maria Mas
setani,Remo Raffaelli, RobertoBasili,Maria TeresaPozienra;DarioSaracino,Fabio
Zanrotto,Nadia Mana, FabioPianesi,RodolfoDelmonte
I Introduction 190
2 ISST architecture 190
3 ISST corpus 191
4 ISST morpho-syntacticannotation 191
5 ISST syntacticannotation 192
6 ISST lexico-semanticannotation 196
7 The multi-level linguisticannotation tool 200
8 ISST evaluation 204
9 Conclusion 206
Appendix 209
VIII TREEBANKS
Chapter 12
AUTOMATED CREATION OF A MEDIEVAL PORTUGUESE TREE 211
BANK
VitorRocio, Mdrio AmadoAlves, J. Gabriel Lopes, Maria Francisca Xavier;Gracia
Vicente
I Introduction 211
2 The parsedcorpusofmedieval portuguesetexts 212
3 Tools and computationalresources 215
4 Evaluation 222
5 Conclusion 224
TREEBANKS FOR OTHER LANGUAGES
Chapter 13
SINICA TREEBANK 231
Keh-Jiann Chen,Chi-ChingLuo,Ming-ChungChang, Feng-YiChen,Chao-Jan Chen,
Chu-Ren Huang,Zhao-Ming Gao
I Introduction 231
2 Design criteria 232
3 Representationof lexico-grammatical information: ICG 233
4 Annotationguideline 235
5 Implementation 239
6 Representational issues: problematiccases and how they are solved 241
7 Currentstatus ofthe sinicatrecbankand future work 243
Appendix: SyntacticCategories 248
Chapter 14
BUILDING A JAPANESE PARSED CORPUS 249
Sadao Kurohashi,Makoto Nagao
I Introduction 249
2 Overviewofthe project 250
3 MorphologicalanalyzerJUMAN 253
4 DependencystructureanalyzerKNP 255
5 Conclusion 259
Chapter 15
BUILDING A TURKISH TREEBANK 261
Kemal Oflazer,Bilge Say, DilekZeynep Hakkani-Tiir, Gokhan Tiir
I Turkish: Morphologyand syntax 262
2 Whatinformationneeds to berepresented? 263
3 The annotation tool 270
4 Somedifficult issues 272
5 Conclusionsand future work 273
Appendix: TurkishMorphologicalFeatures 276
Contents ix
Part II Using treebanks
Chapter 16
ENCODING SYNTACTIC ANNOTATION 281
Nancy Ide,LaurentRomary
I Introduction 281
2 XCES 283
3 Syntacticannotation: currentpractice 284
4 A model forsyntacticannotation 286
5 Using theXCES scheme 291
6 Conclusion 293
EVALUATION WITH TREEBANKS
Chapter 17
PARSER EVALUATION 299
John Carroll,Guido Minnen,TedBriscoe
I Introduction 299
2 Grammaticalrelationannotation 302
3 Corpusannotation 308
4 Parser evaluation 309
5 Discussion 312
6 Summary 313
Chapter 18
DEPENDENCY-BASED EVALUATION OF MINIPAR 317
DekangLin
I Introduction 317
2 Dependency-basedparserevaluation 318
3 Evaluationof miniparwithsusannecorpus 320
4 Selectiveevaluation 323
5 Related work 326
6 Conclusions 328
GRAMMAR INDUCTION WITH TREEBANKS
Chapter 19
EXTRACTING STOCHASTIC GRAMMARS FROM TREEBANKS 333
Rens Bod
I Introduction 333
2 Summaryofdata-orientedparsing 335
3 Simulating stochasticgrammarsbyconstrainingthe subtree set 337
4 Discussionand conclusion 344
x TREEBANKS
Chapter20
STOCHASTIC LEXICALlZED TREE GRAMMARS 351
GiinterNeumann
I Introduction 351
2 Related work 352
3 Grammarextraction 353
4 SLTGfrom treebanks 355
5 SLTGfromHPSG 359
6 Future steps: towards merging SLTGs 362
Chapter21
FROM TREEBANK RESOURCES TO LFG F-STRUCTURES 367
AnetteFrank,Louisa Sadler,lose/vanGenabith, Andy Way
I Introduction 368
2 Methodsforautomatic f-structurc annotation 370
3 TwoExperiments 380
4 Discussion andCurrentResearch 383
5 Summary 385
Appendix: Example of an Automatically Generated F-Structure (Susanne
Corpus) 389
ContributingAuthors 391
Index 398