Volume 26 (2007)
Volume 16 (1997)
Volume 9 (1990)
Most Downloaded Articles
- Sprache, Grenze, Raum by Auer, Peter
- Second Language Acquisition in Early Childhood by Meisel, Jürgen M.
- Pizzas und Pizzen – die Pluralformen (un)assimilierter Fremdwörter im Deutschen by Wegener, Heide
- Grammatikalisierung von weil als Diskursmarker in der gesprochenen Sprache by Gohl, Christine and Günthner, Susanne
- Verbstellungsvariation in weil-Sätzen: Lexikalische Differenzierung mit grammatischen Folgen by Uhmann, Susanne
Annotation for and Robust Parsing of Discourse Structure on Unrestricted Texts
Citation Information: Zeitschrift für Sprachwissenschaft. Volume 26, Issue 2, Pages 213–239, ISSN (Online) 1613-3706, ISSN (Print) 0721-9067, DOI: 10.1515/ZFS.2007.018, December 2007
- Published Online:
Predicting discourse structure on naturally occurring texts and dialogs is challenging and computationally intensive. Attempts to construct hand-built systems have run into problems both in how to specify the required knowledge and how to perform the necessary computations in an efficient manner. Data-driven approaches have recently been shown to be successful for handling challenging aspects of discourse without using lots of fine-grained semantic detail, but they require annotated material for training. We describe our effort to annotate Segmented Discourse Representation Structures on Wall Street Journal texts, arguing that graph-based representations are necessary for adequately capturing the dependencies found in the data. We then explore two data-driven parsing strategies for recovering discourse structures. We show that the generative PCFG model of Baldridge & Lascarides (2005b) is inherently limited by its inability to incorporate new features when learning from small data sets, and we show how recent developments in dependency parsing and discriminative learning can be utilized to get around this problem and thereby improve parsing accuracy. Results from exploratory experiments on Verbmobil dialogs and our annotated news wire texts are given; these results suggest that these methods do indeed enhance performance and have the potential for significant further improvements by developing richer feature sets.