A multimodal approach to investigating temporality expression in L2: What does gesture analysis reveal?

  • 1 Université Toulouse Jean Jaurès, Toulouse, France
Inès Saddour

Abstract

Research on temporality expression has had a prolific history within second language acquisition (SLA) research and has provided a clear picture of temporal and aspectual (henceforth Tem) markers and their order of emergence and development in L2 acquisition. However, most of the studies have only examined speech and neglected the gestural modality. This study is an attempt to fill this gap and contribute to the relatively recent investigation of L2 gestures; examining with a combinative approach Tem devices in speech and the gestures produced concomitantly with those linguistic markers in longitudinal video-recorded narratives produced by four low-proficiency tutored French second language (L2) learners. Our results suggest that speech and gesture form an interconnected system and that gestures play a function in dealing with the abstract domain of temporal reference in early SLA. Analyses reveal that L2 learners do not gesture randomly when expressing Tem values. Their gestures co-occurring with different types of Tem linguistic devices are generally different in proportion, duration and type. Gestures are more frequent in non-finite uninflected verbal contexts. Additionally, they are often iconic and last longer on average than those produced simultaneously with verbal morphology or with adverbials. Differences in gesture rate, duration and nature in the different marking contexts and over the data collection period of 5 months suggest that gesturing may help to reduce the cognitive load brought about by the complexity of morphological marking, and may therefore be used strategically to handle hesitant Tem devices in speech in early SLA.

  • Alibali, Martha W., Sotaro Kita & Amanda J. Young. 2000. Gesture and the process of speech production: We think, therefore we gesture. Language and Cognitive Processes 15(6). 593–613.

    • Crossref
    • Export Citation
  • Bartning, Inge. 2009. The advanced learner variety: 10 years later. In Emmanuelle Labeau & Florence Myles (eds.), The Advanced Learner Variety : The case of French, 11–40. Germany: Peter Lang.

  • Bartning, Inge & Suzanne Schlyter. 2004. Itinéraires acquisitionnels et stades de développement en français L2. French Language Studies 14. 281–299.

    • Crossref
    • Export Citation
  • Bhadwaj, Mangat, Rainer Dietrich & Colette Noyau (eds.). 1988. Second Language Acquisition by Adult Immigrants : Temporality. Strasbourg: European Science Foundation.

  • Butterworth, Brian & Uri Hadar. 1989. Gesture, speech, and computational stages: A reply to McNeill. Psychological Review 96(1). 168–174.

    • Crossref
    • Export Citation
  • Butterworth, Brian & Uri Hadar. 1997. Iconic gestures, imagery and word retrieval in speech. Semiotica 115. 147–172.

  • Dietrich, Rainer, Wolfgang Klein & Colette Noyau. 1995. The Acquisition of Temporality in a Second Language. Philadelphia: Benjamins.

  • Duncan, Susan D. 2002. Gesture, verb aspect, and the nature of iconic imagery in natural discourse. Gesture 2(2). 183–206.

    • Crossref
    • Export Citation
  • Goldin-Meadow, Susan, Howard Nusbaum, Spencer D. Kelly & Susan Wagner. 2001. Explaining math: Gesturing lightens the load. American Psychological Society 12(6). 516–522.

  • Gullberg, Marianne. 1998. Gesture as a communication strategy in second language discourse : A study of learners of French and Swedish. Lund: Lund University Press.

  • Gullberg, Marianne. 1999. Communication strategies, gestures and grammar. Acquisition et Interaction en Langue Etrangère 2. 61–71.

  • Gullberg, Marianne. 2005. L’expression orale et gestuelle de la cohésion dans le discours de locuteurs langue 2 débutants. Acquisition et interaction en langue étrangère 23. 153–172.

  • Gullberg, Marianne. 2006. Handling discourse: Gestures, reference tracking, and communication strategies in early L2. Language Learning 56(1). 155–196.

    • Crossref
    • Export Citation
  • Gullberg, Marianne. 2009. Gestures and the development of semantic representations in first and second language acquisition. Language Interaction and Acquisition 1. 117–139.

  • Gullberg, Marianne. 2014. Gestures and second language acquisition. In Cornelia Müller, Alan J. Cienki, Ellen Fricke, Silvia H. Ladewig, David McNeill & Jana Bressem (eds.), Body - language - communication : An International Handbook on Multimodality in Human Interaction, 1868–1875. Berlin, Boston: De Gruyter Mouton.

  • Gullberg, Marianne & Steven McCafferty. 2008. Introduction to gesture and SLA: Towards an integrated approach. Studies in Second Language Acquisition 30. 133–146.

  • Kendon, Adam. 2000. Language and gesture: Unity or duality. In David McNeill (ed.), Language and Gesture, 47–63. Cambridge: Cambridge University Press.

  • Kendon, Adam. 2004. Gesture : Visible Action as Utterance. Cambridge: Cambridge University Press.

  • Kita, Sotaro. 2000. How representational gestures help speaking. In David McNeill (ed.), Language and Gesture, 162–185. Cambridge: Cambridge University Press.

  • Kita, Sotaro & Asli Özyürek. 2003. What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language 48. 16–32.

    • Crossref
    • Export Citation
  • Klein, Wolfgang. 1994. Time in Language. London: Routledge.

  • Klein, Wolfgang & Clive Perdue. 1997. The basic variety (or: Could not languages be much simpler?). Second Language Research 13(4). 301–347.

    • Crossref
    • Export Citation
  • Lausberg, Hedda & Han Sloetjes. 2009. Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, Instruments, & Computers 41(3). 841–849. doi:.

    • Crossref
    • Export Citation
  • Matlock, Teenie, David Sparks, Justin L. Matthews, Jeremy Hunter & Stephanie Huette. 2012. Smashing new results on aspectual framing: How people talk about car accidents. Studies in Language 36(3). 700–721.

  • McNeill, David. 1992. Hand and mind: What the hands reveal about thought. Chicago: University of Chicago Press.

  • McNeill, David. 2005. Gesture and Thought. USA: The University of Chicago Press.

  • McNeill, David & Susan D. Duncan. 2000. Growth points in thinking-for-speaking. In David McNeill (ed.), Language and Gesture, 141–161. Cambridge: Cambridge University.

  • Noyau, Colette. 1990. The development of means for temporality in the guided acquisition of L2: Cross-linguistic perspectives. In Hans. W. Dechert (ed.), Current Trends in European Second Language Acquisition Perspectives, 143–170. Clevedon: Multilingual Matters.

  • Ruiter, Jan-Peter de. 2000. The production of gesture and speech. In David McNeill (ed.), Language and Gesture, 284–311. Cambridge: Cambridge University Press.

  • Stam, Gale. 2012. Gestes et recherche lexicale en langue seconde. In Robert Vion, Alain Giacomi & Claude Vargas (eds.), La Lorporalité du langage : Multimodalité, Discours et Ecriture. Aix-en-Provence: Presses Universitaires de Provence.

Purchase article
Get instant unlimited access to the article.
$42.00
Log in
Already have access? Please log in.


Journal + Issues

IRAL is devoted to problems of general and applied linguistics in their various forms. Its focus of interest lies in areas of research which concern first- and second-language acquisition (including sign language and gestural systems). Contributions cover topics such as naturalistic and instructed language learning, language loss, bilingualism, language contact, language for specific purposes, language technology and mother-tongue education.

Search