Table Of ContentMaximum Entropy and Bayesian Methods
Garching, Germany 1998
Fundamental Theories of Physics
An International Book Series on The Fundamental Theories of Physics:
Their Clarification, Development and Application
Editor:
ALWYN VAN DER MERWE, University of Denver, U.S.A.
Editorial Advisory Board:
LAWRENCE P. HORWITZ, Tel-Aviv University, Israel
BRIAN D. JOSEPHSON, University of Cambridge, U.K.
CLIVE KILMISTER, University of London, U.K.
PEKKA J. LAHTI, University of Turku, Finland
GÜNTER LUDWIG, Philipps-Universität, Marburg, Germany
NATHAN ROSEN, Israel Institute of Technology, Israel
ASHER PERES, Israel Institute of Technology, Israel
EDUARD PRUGOVECKI, University of Toronto, Canada
MENDEL SACHS, State University of New York at Buffalo, U.S.A.
ABDUS SALAM, International Centre for Theoretical Physics, Trieste, Italy
HANS-JÜRGEN TREDER, Zentralinstitut für Astrophysik der Akademie der
Wissenschaften, Germany
Volume 105
Maximum Entropy and
Bayesian Methods
Garching, Germany 1998
Proceedings of the 18th International Workshop on
Maximum Entropy and Bayesian Methods of
Statistical Analysis
edited by
Wolfgang von der Linden
Institute for Theoretical Physics,
Technical University of Graz,
Graz., Austria
Volker Dose
Rainer Fischer
and
Roland Preuss
Max Planck Institute for Plasma Physics,
Garching, Germany
~.
,~
SPRINGER-SCIENCE+BUSINESS MEDIA, B.V.
Library of Congress Cataloging-in-Publication Data
Internationa l Workshop on Maximum Entropy and Bayesian Methods of
Statistica l Analysi s (18t h 199 8 : Garching bei München, Germany)
Maximum entrop y and Bayesian methods, Garching, Germany 1998 :
proceedings of the 18th Internationa l Workshop on Maximum Entropy
and Bayesian Methods of Statistica l Analysi s / edite d by Wolfgang
von der Linden .. . [et al.l .
p. cm . — (Fundamental theorie s of physics ; v. 105)
Includes index .
ISBN 978-94-010-5982-4 ISBN 978-94-011-4710-1 (eBook)
DOI 10.1007/978-94-011-4710-1
1. Maximum entrop y method Congresses. 2 . Bayesian statistica l
decision theor y Congresses. 3 . Bayesian statistica l decisio n
theory—Industria l application s Congresses. I . Linden, Wolfgang
von der . II . Title . III . Series.
G370.I575 199 8
530 * . 07' 27—dc21 99-2705 7
ISBN 978-94-010-5982-4
Printed on acid-free paper
All Rights Reserved
© 1999 Springer Science+Business Media Dordrecht
Originally published by Kluwer Academic Publishers in 1999
Softcover reprint of the hardcover 1st edition 1999
No part of the material protected by this copyright notice may be reproduced or
utilized in any form or by any means, electronic or mechanical,
including photocopying, recording or by any information storage and
retrieval system, without written permission from the copyright owner.
DEDICATED TO: EDWIN THOMPSON JAYNES
July 5, 19~~ to April 90, 1998
CONTENTS
PREFACE ....................................................... xi
EDWIN THOMPSON JAYNES
G.L. Bretthorst ............................................. 1
A TRIBUTE TO EDWIN T. JAYNES
M. Thibus ................................................. 11
THE NEAR-IRRELEVANCE OF SAMPLING FREQUENCY
DISTRIBUTIONS
G. Larry Bretthorst ....................................... 21
OUTLIER TOLERANT PARAMETER ESTIMATION
V. Dose and W. von der Linden ........................... 47
UNIVERSALITY, PRIOR INFORMATION AND MAXIMUM
ENTROPY IN FOAMS
N. Rivier, B. Dubertret, T. Aste, and H. Ohlenbusch ....... 57
TEXTURE RECONSTRUCTION IN NOISY IMAGES
M. Walessa and M. Datcu ................................. 65
BAYESIAN 3D X-RAY RECONSTRUCTION FROM
INCOMPLETE NOISY DATA
V. Vengrinovich, Yu. Denkevich, and G.-R. Tillack ......... 73
A BAYESIAN REFLECTION ON SURFACES
David R. Wolf ............................................. 83
QUANTUM ENTROPY REGULARIZATION
R. N. Silver ................................................ 91
BAYESIAN RECONSTRUCTION OF ELECTRON ENERGY
DISTRIBUTIONS FROM EMISSION LINE INTENSITIES
R. Fischer, W. Jacob, W. von der Linden, and V. Dose .... 99
DEPTH PROFILE RECONSTRUCTION FROM
RUTHERFORD BACKSCATTERING DATA
U. v. Toussaint, K. Krieger, R. Fischer, V. Dose .......... 107
vii
viii
BAYESIAN IMAGE SEGMENTATION USING A DYNAMIC
PYRAMIDAL STRUCTURE
H. Rehrauer, K. Seidel, and M. Datcu .................... 115
ADAPTIVE IMAGE RECONSTRUCTION WITH
PREDICTIVE MODELS
V. M. Artemiev, A. O. Naumov, and G.-R. Tillack ........ 123
ARE WE CRUISING A HYPOTHESIS SPACE?
C. C. Rodriguez .......................................... 131
FIDUCIAL INFERENCE
Diemer Salome ........................................... 141
POSTERIOR MOMENTS OF THE CAUCHY DISTRIBUTION
David R. Wolf ............................................ 149
BAYESIAN REASONING VERSUS CONVENTIONAL
STATISTICS IN HIGH ENERGY PHYSICS
G. D'Agostini ............................................ 157
MODEL COMPARISON IN PLASMA ENERGY
CONFINEMENT SCALING
R. Preuss, V. Dose, and W. von der linden ................ 171
STRAIGHT LINES
Do Kester ................................................ 179
BAYESIAN ANALYSIS WITH APPLICATION TO THE
TIMING RESIDUALS OF A PULSAR
Gilles Zalamansky Christian P. Robert .................... 189
BAYESIAN LABELING OF REMOTE SENSING
IMAGE CONTENT
M. SchrOder, K. Seidel, and M. Datcu .................... 199
SOME RECENT DEVELOPMENTS IN BAYESIAN
STATISTICS AND ECONOMETRICS
Arnold Zellner ............................................ 207
CONVERGENT BAYESIAN FORMULATIONS OF BLIND
SOURCE SEPARATION AND ELECTROMAGNETIC
SOURCE ESTIMATION
K. H. Knuth and H. G. Vaughan, jr. ...................... 217
A MAXIMUM ENTROPY APPROACH FOR ESTIMATING
NONLINEAR DYNAMIC MODELS
Amos Golan .............................................. 227
CONTENTS ix
PROBABILITY AND ENTROPY IN QUANTUM THEORY
Ariel Caticha ............................................. 237
UNREAL PROBABILITIES:Partial Truth with Clifford Numbers
C. C. Rodriguez .......................................... 247
YET ANOTHER DERIVATION OF THE PRINCIPLE OF
MAXIMUM ENTROPY
Anthony J .M. Garrett .................................... 271
EFFICIENT ESTIMATION OF MISSING INFORMATION
IN MULTIVALUED SINGLY CONNECTED NETWORKS
USING MAXIMUM ENTROPY
D. Holmes ................................................ 289
OVERVIEW AND BAYESIAN PERSPECTIVE OF
PHASE UNWRAPPING
G. Nico, L. Guerriero, G. Palubinskas, and M. Datcu ..... 301
OPERATION OF THE BAYES INFERENCE ENGINE
K.M. Hanson and G.S. Cunningham ...................... 309
THE PRIOR-PREDICTIVE VALUE
W. von der Linden, R. Preuss, and V. Dose ............... 319
AN UNSUPERVISED CLUSTERING METHOD
BY ENTROPY MINIMIZATION
G. Palubinskas ........................................... 327
APPLICATIONS OF THE MAXIMUM ENTROPY METHOD IN
CRYSTALLOGRAPHY
Martin Schneider and Sander van Smaalen ................ 335
TRACE METAL DETECTION IN NATURAL WATER
A. Taglauer, R. Niessner, W. von der Linden, V. Dose, and E.
Taglauer ....................................................... 341
OSCILLATOR STABILITY ANALYSIS USING A BAYESIAN
APPROACH
Gilles Zalamansky and Francois Vernotte ................. 345
INDEX ........................................................ 353
LIST OF PARTICIPANTS ..................................... 357
PREFACE
In 1978 Edwin T. Jaynes and Myron Tribus initiated a series of workshops to
exchange ideas and recent developments in technical aspects and applications of
Bayesian probability theory. The first workshop was held at the University of
Wyoming in 1981 organized by C.R. Smith and W.T. Grandy. Due to its success,
the workshop was held annually during the last 18 years. Over the years, the
emphasis of the workshop shifted gradually from fundamental concepts of Bayesian
probability theory to increasingly realistic and challenging applications.
The 18th international workshop on Maximum Entropy and Bayesian
Methods was held in Garching / Munich (Germany) (27-31. July 1998). Opening
lectures by G. Larry Bretthorst and by Myron Tribus were dedicated to one of
the pioneers of Bayesian probability theory who died on the 30th of April 1998:
Edwin Thompson Jaynes. Jaynes revealed and advocated the correct meaning of
'probability' as the state of knowledge rather than a physical property. This inter
pretation allowed him to unravel longstanding mysteries and paradoxes. Bayesian
probability theory, "the logic of science" - as E.T. Jaynes called it - provides the
framework to make the best possible scientific inference given all available exper
imental and theoretical information.
We gratefully acknowledge the efforts of Tribus and Bretthorst in commemorating
the outstanding contributions of E.T. Jaynes to the development of probability
theory.
Following the general scope of the annual workshop the talks were mostly informal
presentations of recent development in technical aspects and applications cover
ing a wide variety of research areas, such as physics (high energy physics, plasma
physics, astro-physics, foundation of quantum mechanics), biology, medicine, econo
metrics, urban planing, image reconstruction, communication theory. In most fields
the applications are changing from academic studies to challenging real-world
problems with significant success. The number of participants varied between 60
and 90, a decent number for active discussions during and between the sessions.
More information about the conference can be found on the conference-homepage:
http://www.ipp.mpg.de/OP /maxent98/.
This volume contains a collection of papers presented at the workshop, which tes
tifies the far-reaching applicability and importance of Bayesian probability theory.
According to Larry Bretthorst, E.T. Jaynes had little tolerance for incompetence.
We are convinced that the papers in these proceedings would have found his ap
proval.
Finally, we wish to acknowledge financial support by the Deutsche Physikalische
Gesellschaft and the Max-Planck-Institut fiir Plasmaphysik.
Wolfgang von der Linden Volker Dose, Rainer Fischer, Roland Preuss
Institut fiir Theoretische Physik Max-Planck-Institut fiir Plasmaphysik
Technische Universitiit Graz Garching / Munich
Austria Germany
xi
0
~
0
~
~
~
...-
~ -
0
z
~
~
~
z~
0
0
