Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter Mouton November 7, 2014

Multimodal Analysis of Parentheticals in Conversational Speech

  • Manon Lelandais

    Manon Lelandais is a postgraduate student in English Linguistics at the University of Nantes, France. She works on Information Structure in Multimodal Discourse Analysis, with a particular focus on so-called secondary syntactic constructions. Her study is based on video files of spontaneous conversations. In the present paper, she shows that discourse parentheses are more frequently marked as disruptions in prosody, are indeed fully integrated to the discourse flow thanks to participants’ gestures. She is also more generally interested in what type of information is coded in side sequences and what semiotic modes are used by participants to the interaction to actually encode these various information types.

    EMAIL logo
    and Gaëlle Ferré

    Gaëlle Ferré is currently an Associate Professor in English Linguistics at the University of Nantes, France. She mainly teaches English phonetics & phonology, but also Discourse Analysis both at undergraduate and graduate levels. In research, she works primarily in Multimodality in English, in a linguistic-oriented approach, which aims at understanding the organisation of information from the different modalities in spontaneous speech to form a message. The modalities she is particularly interested in are verbal (semantics and discourse organisation/pragmatics), vocal (prosody), and visual (gestures). Her recent research in Multimodality, which is part of a nationally funded project, has led her to work on the annotation of co-verbal gestures, prosody and discourse structure in conversational French.

    EMAIL logo
From the journal Multimodal Communication

Abstract

Based on a video recording of conversational British English, this paper aims at describing the relation between verbal and non-verbal signals in the production process of parentheticals within the framework of Multimodal Discourse Analysis. Parentheticals are described in linguistics as side sequences interrupting linear development. Although their syntactic, prosodic, and discursive characteristics have been deeply analysed, few studies have focused on the articulation of the different communicative modes in their production process. Beyond showing that gesture brings complementary information in regard to prosody, contributing to a composite collateral message, the results allow better delineation and understanding of skip-connecting phenomena as constructing coherence. Changes in the modal configuration throughout the parenthetical sequence suggest modes are dynamic and flexible resources for indexing parentheticals and their particular framing function.

About the authors

Manon Lelandais

Manon Lelandais is a postgraduate student in English Linguistics at the University of Nantes, France. She works on Information Structure in Multimodal Discourse Analysis, with a particular focus on so-called secondary syntactic constructions. Her study is based on video files of spontaneous conversations. In the present paper, she shows that discourse parentheses are more frequently marked as disruptions in prosody, are indeed fully integrated to the discourse flow thanks to participants’ gestures. She is also more generally interested in what type of information is coded in side sequences and what semiotic modes are used by participants to the interaction to actually encode these various information types.

Gaëlle Ferré

Gaëlle Ferré is currently an Associate Professor in English Linguistics at the University of Nantes, France. She mainly teaches English phonetics & phonology, but also Discourse Analysis both at undergraduate and graduate levels. In research, she works primarily in Multimodality in English, in a linguistic-oriented approach, which aims at understanding the organisation of information from the different modalities in spontaneous speech to form a message. The modalities she is particularly interested in are verbal (semantics and discourse organisation/pragmatics), vocal (prosody), and visual (gestures). Her recent research in Multimodality, which is part of a nationally funded project, has led her to work on the annotation of co-verbal gestures, prosody and discourse structure in conversational French.

Acknowledgements

We would like to thank our two participants Alexandra and Rhianna, as well as the staff at the Audio-Visual Centre at the University of Nantes. We are also indebted to two anonymous reviewers for their valuable comments and suggestions on a previous version of this paper.

Appendix: transcription conventions

(h)

Audible inbreath

#

Pause

XXX

Inaudible word (X stands for 1 syllable)

(…)

Vocal activity (laughs, giggles, swallowing, sighs)

*…*

Low intensity

[…]

Illustrated gestural activity

-

Interrupted construction

(A)

Antecedent

(P)

Parenthetical

(R)

Resumption

References

Banik, E. (2008). An integrated architecture for generating parenthetical constructions. In: Proceedings of the 46th Annual Meeting of the Association for Computational Linguistics on Human Language Technologies: Student Research Workshop, 7–12. Columbus, Ohio.10.3115/1564154.1564157Search in Google Scholar

Bernardis, P., and Gentilucci, M. (2006). Speech and gesture share the same communication system. Neuropsychologia, 44(2): 178190.Search in Google Scholar

Bigi, B. (2012). SPPAS: a tool for the phonetic segmentation of speech. In: Proceedings of the International Conference on Language Resources and Evaluation (LREC 2012), May 21–27, 2012, Istanbul, Turkey, 1748–1755.Search in Google Scholar

Blakemore, D. (2009). On the relevance of parentheticals. In: IDP 09, Paris, 9–17.Search in Google Scholar

Boersma, P., and Weenink, D. (2013). Praat: doing phonetics by computer. Accessed January 30. http://www.fon.hum.uva.nl/praat/Search in Google Scholar

Bolden, G. (2009). Implementing delayed actions. In: Conversation Analysis: Comparative Perspectives, J.Sidnell (Ed.), 326353. Cambridge: Cambridge University Press.10.1017/CBO9780511635670.012Search in Google Scholar

Bolinger, D. (1985). Intonation and Its Part: Melody in Spoken English. Stanford, CA: Stanford University Press.10.1515/9781503622906Search in Google Scholar

Brinton, L. J. (2008). The Comment Clause in English: Syntactic Origins and Pragmatic Development. Cambridge: Cambridge University Press.10.1017/CBO9780511551789Search in Google Scholar

Calbris, G. (2008). From left to right… : coverbal gestures and their symbolic use of space. In: Metaphor and Gesture. Gesture Studies Vol. 3, A.Cienki and C.Müller (Eds.), 2753. Amsterdam; Philadelphia, PA: John Benjamins.10.1075/gs.3.05calSearch in Google Scholar

Calbris, G. (2011). Elements of Meaning in Gesture. Gesture Studies Vol. 5. Amsterdam; Philadelphia, PA: John Benjamins.10.1075/gs.5Search in Google Scholar

Clark, H. H. (1996). Using Language. Cambridge: Cambridge University Press.10.1017/CBO9780511620539Search in Google Scholar

Clark, H. H., and Fox Tree, J. E. (2002). Using “Uh” and “Um” in spontaneous speaking. Cognition, 84(1): 73111.Search in Google Scholar

Clark, H. H., and Krych, M. A. (2004). Speaking while monitoring addressees for understanding. Journal of Memory and Language, 50(1): 6281.Search in Google Scholar

Coulthard, M., and Brazil, D. (1979). Exchange Structure. Discourse Analysis Monograph No. 5. English Language Research, University of Birmingham edition. Birmingham: University of Birmingham.Search in Google Scholar

Crystal, D. (1969). Prosodic Systems and Intonation in English. Cambridge: Cambridge University Press.Search in Google Scholar

Debaisieux, J.-M., and Martin, P. (2010). Les Parenthèses: Étude Macrosyntaxique et Prosodique Sur Corpus. In: La Parataxe: Tome 2, M. J.Béguelin, M.Avanzi, and G.Corminboeuf (Eds.), 307337. Bern: Peter Lang.Search in Google Scholar

Dehé, N. (2009). Clausal parentheticals, intonational phrasing, and prosodic theory. Journal of Linguistics, 45(3): 569615.Search in Google Scholar

Delomier, D., and Morel, M- A. (1986). Caractéristiques Intonatives et Syntaxiques Des Incises. DRLAV, 34–35: 141160.Search in Google Scholar

Deppermann, A. (2013). Turn-design at turn-beginnings: multimodal resources to deal with tasks of turn-construction in German. Journal of Pragmatics, 46(1): 91121.Search in Google Scholar

Duvallon, O., and Routarinne, S. (2005). Parenthesis as a resource in the grammar of conversation. In: Syntax and Lexis in Conversation: Studies on the Use of Linguistic Resources in Talk-in-Interaction, A.Hakulinen and M.Selting (Eds.), 4574. Amsterdam; Philadelphia, PA: John Benjamins.10.1075/sidag.17.05duvSearch in Google Scholar

Ekman, P., and Friesen, W. V. (1969). The repertoire of nonverbal behavior: categories, origins, usage, and coding. Semiotica, 1(1): 4998.Search in Google Scholar

Enfield, N. J., Kita, S., and J. P.de Ruiter. (2007). Primary and secondary pragmatic functions of pointing gestures. Journal of Pragmatics, 39(10): 17221741.Search in Google Scholar

Ferré, G. (2014). A multimodal approach to markedness in spoken French. Speech Communication: Special Issue on Gesture and Speech in Interaction, 57: 268282.Search in Google Scholar

Fox, B. A. (1987). Interactional reconstruction in real-time language processing. Cognitive Science, 11(3): 365387.Search in Google Scholar

Fox, B. A., and Thompson, S. A. (2009). On formulating reference: an interactional approach to relative clauses in English conversation. Papers in Pragmatics, 4(1): 183196.Search in Google Scholar

Goffman, E. (1981). Forms of Talk. Philadelphia, PA: University of Pennsylvania Press.Search in Google Scholar

Goodwin, C. (1981). Conversational Organization: Interaction between Speakers and Hearers. New York: Academic Press.Search in Google Scholar

Goodwin, C. (2012). The co-operative, transformative organization of human action and knowledge. Journal of Pragmatics, 46(1): 823.Search in Google Scholar

Halliday, M. A. K. (1967). Intonation and Grammar in British English. The Hague: Mouton.10.1515/9783111357447Search in Google Scholar

Halliday, M. A. K., and Hasan, R. (1976). Cohesion in English. London: Longman.Search in Google Scholar

Hirschberg, J., and Grosz, B. (1992). Intonational features of local and global discourse structure. In: Proceedings of the Workshop on Speech and Natural Language, February 1992, Harriman, NY, 441–446.10.3115/1075527.1075632Search in Google Scholar

Hirschberg, J., and Pierrehumbert, J. (1986). The intonational structuring of discourse. In: Proceedings of the 24th Annual Meeting on Association for Computational Linguistics, 25–29 August, 1986, Bonn, Germany, 136–144.10.3115/981131.981152Search in Google Scholar

Hirst, D. J. (2007). A Praat Plugin for Momel and INTSINT with improved algorithms for modelling and coding intonation. In: Proceedings of the XVIth International Conference of Phonetic Sciences, 6–10 August, 2007, Saarbrücken, Germany, 1233–1236.Search in Google Scholar

Kendon, A. (1972). Some relationships between body motion and speech. In: Studies in Dyadic Communication, A. W.Siegman and B.Pope (Eds.), 177210. New York: Pergamon.10.1016/B978-0-08-015867-9.50013-7Search in Google Scholar

Kendon, A. (2004). Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press.Search in Google Scholar

Kita, S., Van GijnI., and Van der Hulst, H. (1998). Movement phases in signs and co-speech gestures, and their transcription by human coders. Gesture and Sign Language in Human-Computer Interaction, 1371: 2335.Search in Google Scholar

Lascarides, A., and Stone, M. (2009). Discourse coherence and gesture interpretation. Gesture9(2): 147180.Search in Google Scholar

Laursen, L. (2005). Towards an embodied grammar: gesture in tying practices constructing obvious cohesion. In: Interacting Bodies: Online Proceedings of the 2nd ISGS Conference, 15–18 June, 2005, Lyon.Search in Google Scholar

Lee, Y. (2007). On the role of intonation and pauses in the interpretation of English parenthetical adverbs. The Linguistic Association of Korea Journal, 15: 85107.Search in Google Scholar

Local, J. (1992). Continuing and restarting. In: The Contextualization of Language, P.Auer and A.Di Luzio (Eds.), 273296. Amsterdam; Philadelphia, PA: John Benjamins.10.1075/pbns.22.18locSearch in Google Scholar

Local, J. (2007). Phonetic detail and the organisation of talk-in-interaction. In: Proceedings of the 16th ICPhS, 6–10 August, 2007, Saarbrücken, Germany.Search in Google Scholar

Mazeland, H. (2007). Parenthetical sequences. Journal of Pragmatics, 39(10): 18161869.Search in Google Scholar

McCawley, James D. (1982). Parentheticals and discontinuous constituent structure. Linguistic Inquiry, 13(1): 91106.Search in Google Scholar

McNeill, D. (1992). Hand and Mind: What Gestures Reveal about Thought. Chicago: University of Chicago Press.Search in Google Scholar

McNeill, D. (2005). Gesture and Thought. Chicago: University of Chicago Press.10.7208/chicago/9780226514642.001.0001Search in Google Scholar

Mondada, L. (2004). Temporalité, Séquentialité et Multimodalité Au Fondement de L’organisation de L’interaction: Le Pointage Comme Pratique de Prise de Tour. Cahiers de Linguistique Française, 26: 169192.Search in Google Scholar

Mondada, L., and Zay, F. (1999). Parenthèses et Processus de Configuration Thématique: Vers Une Redéfinition de La Notion de Topic. In: Pragmatics in 1998: Selected Papers from the 6th International Pragmatics Conference, 2. Antwerp, 396–411.Search in Google Scholar

Morel, M.-A., and Danon-Boileau, L. (1998). Grammaire de l’intonation. Paris: Editions Ophrys.Search in Google Scholar

Norris, S. (2004). Analyzing Multimodal Interaction: A Methodological Framework. New York; London: Routledge.10.4324/9780203379493Search in Google Scholar

Norris, S. (2011). Three hierarchical positions of deictic gesture in relation to spoken language: A multimodal interaction analysis. Visual Communication, 10(2): 129147.Search in Google Scholar

Payà, M. (2003). Prosody and pragmatics in parenthetical insertions in Catalan. Catalan Journal of Linguistics, 2: 207227.Search in Google Scholar

Quirk, R., Greenbaum, S., Leech, G., and Svartvik, J. (1985). A Comprehensive Grammar of the English Language. London: Longman.Search in Google Scholar

Reichman, R. (1978). Conversational coherency. Cognitive Science2(4): 283327.Search in Google Scholar

Rodrigues, I. G. (2005). Verbal and Nonverbal Signals in Face-to-Face Interaction: A Theoretical Framework for a Holistic Micro-Analysis: The Example of a Parenthesis. Lyon: Interacting Bodies, 120.Search in Google Scholar

Sacks, H. (1995). Lectures on Conversation. Vols. I and II. Oxford: Blackwell.10.1002/9781444328301Search in Google Scholar

Schegloff, E. A. (1984). On some gestures’ relation to talk. In: Structures of Social Action, J. M. Atkinson and J. Heritage (Eds.), 266298. Cambridge: Cambridge University Press.Search in Google Scholar

Selkirk, E. O. (1984). Phonology and Syntax: The Relation between Sound and Structure. Cambridge, MA: MIT Press.Search in Google Scholar

Sloetjes, H., and Wittenburg, P. (2008). Annotation by category: ELAN and ISO DCR. In: Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC 2008). http://www.lat-mpi.eu/tools/elan/Search in Google Scholar

Tannen, D. (1993). Framing in Discourse. New York; Oxford: Oxford University Press.Search in Google Scholar

Wells, J. C. (2006). English Intonation PB and Audio CD: An Introduction. Cambridge: Cambridge University Press.Search in Google Scholar

Wichmann, A. (2000). Intonation in Text and Discourse. London: Longman.Search in Google Scholar

Wichmann, A. (2001). Spoken parentheticals. Gothenburg Studies in English, 81: 177193.Search in Google Scholar

Published Online: 2014-11-7
Published in Print: 2014-11-1

©2014 by De Gruyter Mouton

Downloaded on 8.12.2023 from https://www.degruyter.com/document/doi/10.1515/mc-2014-0008/html
Scroll to top button