Jump to ContentJump to Main Navigation

Zeitschrift für Sprachwissenschaft

Managing Editor: Holler, Anke

2 Issues per year

IMPACT FACTOR 2013: 0.286
5-year IMPACT FACTOR: 0.719

SCImago Journal Rank (SJR): 0.135
Source Normalized Impact per Paper (SNIP): 1.645



Annotation for and Robust Parsing of Discourse Structure on Unrestricted Texts

Jason Baldridge1 / Nicholas Asher2 / Julie Hunter3




Citation Information: Zeitschrift für Sprachwissenschaft. Volume 26, Issue 2, Pages 213–239, ISSN (Online) 1613-3706, ISSN (Print) 0721-9067, DOI: 10.1515/ZFS.2007.018, December 2007

Publication History

Published Online:


Predicting discourse structure on naturally occurring texts and dialogs is challenging and computationally intensive. Attempts to construct hand-built systems have run into problems both in how to specify the required knowledge and how to perform the necessary computations in an efficient manner. Data-driven approaches have recently been shown to be successful for handling challenging aspects of discourse without using lots of fine-grained semantic detail, but they require annotated material for training. We describe our effort to annotate Segmented Discourse Representation Structures on Wall Street Journal texts, arguing that graph-based representations are necessary for adequately capturing the dependencies found in the data. We then explore two data-driven parsing strategies for recovering discourse structures. We show that the generative PCFG model of Baldridge & Lascarides (2005b) is inherently limited by its inability to incorporate new features when learning from small data sets, and we show how recent developments in dependency parsing and discriminative learning can be utilized to get around this problem and thereby improve parsing accuracy. Results from exploratory experiments on Verbmobil dialogs and our annotated news wire texts are given; these results suggest that these methods do indeed enhance performance and have the potential for significant further improvements by developing richer feature sets.

Keywords: discourse structure; SDRT; probabilistic parsing; Verbmobil; rhetorical relations; dependency grammar

Comments (0)

Please log in or register to comment.