Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter Mouton October 11, 2021

Engagement and constructiveness in online news comments in English and Russian

  • Radoslava Trnavac

    Radoslava Trnavac is Assistant Professor at HSE University, Russia. Her main research interests include the study of evaluation, relational and referential types of coherence, and intercultural pragmatics. She is currently working at the intersection of discourse analysis and corpus linguistics. This paper is an output of a research project implemented as part of the Basic Research Program at the National Research University Higher School of Economics (HSE University).

    ORCID logo
    and Maite Taboada

    Maite Taboada is Full Professor in the Department of Linguistics at Simon Fraser University, Canada. Her research is interdisciplinary, combining discourse analysis and computational linguistics. In discourse analysis, she studies the mechanisms for coherence in discourse. In computational linguistics, she develops methods and algorithms to process discourse structure for different applications.

    ORCID logo EMAIL logo
From the journal Text & Talk

Abstract

We investigate the relationship between Engagement and constructiveness in online news comments by analyzing the frequency and type of Engagement expressions in a corpus of English and Russian comments, following the Appraisal framework. The comments in question, 10,000 words in each language, were posted in response to opinion articles in the Canadian newspaper The Globe and Mail and the Russian online news channel RT. In the context of online news comments, users generally characterize constructive comments as posts that tend to create a civil dialogue through remarks that are relevant to the article and do not provoke an emotional response. Through quantitative and qualitative analyses, we conclude that the language of constructive comments is more explicitly subjective in both languages. The main difference in the use of Engagement expressions in constructive and non-constructive comments lies along the lines of certainty/uncertainty and reliability/unreliability. As for cross-linguistic differences, it seems that English constructive comments place emphasis on the reliability of a commenter’s knowledge, while Russian constructive comments employ more modals of necessity, which have a prescriptive function.


Corresponding author: Maite Taboada, Department of Linguistics, Simon Fraser University, Burnaby, BC, V5A 1S6, Canada, E-mail:

About the authors

Radoslava Trnavac

Radoslava Trnavac is Assistant Professor at HSE University, Russia. Her main research interests include the study of evaluation, relational and referential types of coherence, and intercultural pragmatics. She is currently working at the intersection of discourse analysis and corpus linguistics. This paper is an output of a research project implemented as part of the Basic Research Program at the National Research University Higher School of Economics (HSE University).

Maite Taboada

Maite Taboada is Full Professor in the Department of Linguistics at Simon Fraser University, Canada. Her research is interdisciplinary, combining discourse analysis and computational linguistics. In discourse analysis, she studies the mechanisms for coherence in discourse. In computational linguistics, she develops methods and algorithms to process discourse structure for different applications.

References

Androutsopoulos, Jannis. 2011. Language change and digital media: A review of conceptions and evidence. In Nikolas Coupland & Tore Kristiansen (eds.), Standard languages and language standards in a changing Europe, 145–161. Oslo: Novus Press.Search in Google Scholar

Bakhtin, Mikhail. 1981. The dialogic imagination (translated by C. Emerson & M. Holquist). Austin: University of Texas Press.Search in Google Scholar

Baron, Naomi S. 2002. Alphabet to email: How written English evolved and where it’s heading. London: Routledge.10.4324/9780203194317Search in Google Scholar

Biber, Douglas & Jesse Egbert. 2018. Register variation online. Cambridge: Cambridge University Press.10.1017/9781316388228Search in Google Scholar

Biber, Douglas & Edward Finegan. 1989. Styles of stance in English: Lexical and grammatical marking of evidentiality and affect. Text 9(1). 93–124. https://doi.org/10.1515/text.1.1989.9.1.93.Search in Google Scholar

Chafe, Wallace & Johanna Nichols. 1986. Evidentiality: The linguistic coding of epistemology. Norwood: Ablex.Search in Google Scholar

Cheng, Justin, Michael Bernstein, Cristian Danescu-Niculescu-Mizil & Jure Leskovec. 2017. Anyone can become a troll: Causes of trolling behavior in online discussions. Paper presented at ACM [Association for computing machinery] conference on computer supported cooperative work and social computing (CSCW), 1217–1230. Portland, Oregon, USA.10.1145/2998181.2998213Search in Google Scholar

Coe, Kevin, Kate Kenski & Stephen A. Rains. 2014. Online and uncivil? Patterns and determinants of incivility in newspaper website comments. Journal of Communication 64(4). 658–679. https://doi.org/10.1111/jcom.12104.Search in Google Scholar

Demata, Massimiliano, Dermot Heaney & Susan C. Herring. 2018. Language and discourse of social media. New challenges, new approaches [Special issue]. Altre Modernità. I–X.Search in Google Scholar

Diakopoulos, Nicholas. 2015. Picking the NYT Picks: Editorial criteria and automation in the curation of online news comments. Paper presented at International Symposium on Online Journalism (ISOJ) 6(1). 147–166. Austin.Search in Google Scholar

Đorđević, Jasmina. 2020. The sociocognitive dimension of hate speech in reader’s comments on Serbian news websites. Discourse, Context & Media 33. 1–9. https://doi.org/10.1016/s2211-6958(20)30004-0.Search in Google Scholar

Ehret, Katharina & Maite Taboada. 2020. Are online news comments like face-to-face conversation? A multi-dimensional analysis of an emerging register. Register Studies 2(1). 1–36. https://doi.org/10.1075/rs.19012.ehr.Search in Google Scholar

Fišer, Darja & Philippa Smith (eds.). 2020. The dark side of digital platforms: Linguistic investigations of socially unacceptable online discourse practices (Translation Studies and Applied Linguistics). Ljubljana: University Press, Faculty of Arts.Search in Google Scholar

Fuoli, Matteo. 2012. Assessing social responsibility: A quantitative analysis of Appraisal in BP’s and Ikea’s social reports. Discourse & Communication 6(1). 55–81. https://doi.org/10.1177/1750481311427788.Search in Google Scholar

Fuoli, Matteo. 2017. Building a trustworthy corporate identity: A corpus-based analysis of stance in annual and corporate social responsibility reports. Applied Linguistics 39(6). 846–885. https://doi.org/10.1093/applin/amw058.Search in Google Scholar

Fuoli, Matteo. 2018. A step-wise method for annotating appraisal. Functions of Language 25(2). 229–258. https://doi.org/10.1075/fol.15016.fuo.Search in Google Scholar

Fuoli, Matteo & Charlotte Hommerberg. 2015. Optimizing transparency, reliability and replicability: Annotation principles and inter-coder agreement in the quantification of evaluative expressions. Corpora 10(3). 315–349. https://doi.org/10.3366/cor.2015.0080.Search in Google Scholar

Halliday, Michael Alexander Kirkwood & Christian Matthiessen. 2014. Halliday’s introduction to functional grammar, 4th edn. New York: Routledge.10.4324/9780203783771Search in Google Scholar

Hardaker, Claire. 2015. ‘I refuse to respond to this obvious troll’: An overview of responses to (perceived) trolling. Corpora 10(2). 201–229. https://doi.org/10.3366/cor.2015.0074.Search in Google Scholar

Hengeveld, Kees. 1989. Layers and operators. Journal of Linguistics 25(1). 127–157. https://doi.org/10.1017/s0022226700012123.Search in Google Scholar

Hoye, Leo. 1997. Adverbs and modality in English. London: Longman.Search in Google Scholar

Hyland, Ken. 1996. Talking to the academy: Forms of hedging in science research articles. Applied Linguistics 17(4). 433–454. https://doi.org/10.1093/applin/17.4.433.Search in Google Scholar

Jenks, Christopher J. 2019. Talking trolls into existence: On the floor management of trolling in online forums. Journal of Pragmatics 143. 54–64. https://doi.org/10.1016/j.pragma.2019.02.006.Search in Google Scholar

Kärkkäinen, Elise. 2003. Epistemic stance in English conversation: A description of its interactional functions, with a focus on “I think”. Amsterdam & Philadelphia: John Benjamins.10.1075/pbns.115Search in Google Scholar

Kolhatkar, Varada, Nithum Thain & Jeffrey Sorensen, Lucas Dixon & Maite Taboada. 2021. Classifying constructive comments. First Monday, to appear.Search in Google Scholar

Kolhatkar, Varada & Maite Taboada. 2017a. Constructiveness in news comments. Paper presented at 1st Abusive Language Online Workshop (ALW), 55th Annual Meeting of the Association for Computational Linguistics (ACL), 11–17. Vancouver.10.18653/v1/W17-3002Search in Google Scholar

Kolhatkar, Varada & Maite Taboada. 2017b. Using the New York Times Picks to identify constructive comments. Paper presented at Natural Language Processing Meets Journalism Workshop, Conference on Empirical Methods in Natural Language Processing (EMNLP), 100–105. Copenhagen.10.18653/v1/W17-4218Search in Google Scholar

Kolhatkar, Varada, Hanhan Wu, Luca Cavasso, Emilie Francis, Kavan Shukla & Maite Taboada. 2020. The SFU opinion and comments corpus: A corpus for the analysis of online news comments. Corpus Pragmatics 4. 155–190. https://doi.org/10.1007/s41701-019-00065-w.Search in Google Scholar

Lange, Patricia. 2014. Commenting on YouTube rants: Perceptions of inappropriateness or civic engagement? Journal of Pragmatics 73. 53–65. https://doi.org/10.1016/j.pragma.2014.07.004.Search in Google Scholar

Langlotz, Andreas & Miriam Locher. 2012. Ways of communicating emotional stance in online disagreements. Journal of Pragmatics 44(12). 1591–1606. https://doi.org/10.1016/j.pragma.2012.04.002.Search in Google Scholar

Manosevitch, Idit. 2011. User generated content in the Israeli online journalism landscape. Israel Affairs 17(3). 422–444. https://doi.org/10.1080/13537121.2011.584670.Search in Google Scholar

Martin, James R. 2000. Beyond exchange: Appraisal systems in English. In Susan Hunston & Geoff Thompson (eds.), Evaluation in text: Authorial stance and the construction of discourse, 142–175. Oxford: Oxford University Press.Search in Google Scholar

Martin, James R. 2003. Negotiating heteroglossia: Social perspectives on evaluation. Text 23(2). 171–181.Search in Google Scholar

Martin, James R. & Peter R. R. White. 2005. The Language of evaluation. New York: Palgrave.10.1057/9780230511910Search in Google Scholar

Napoles, Courtney, Joel Tetreault, Enrica Rosato, Brian Provenzale & Aasish Pappu. 2017. Finding good conversations online: The Yahoo news annotated comments corpus. Paper presented at the 11th Linguistic Annotation Workshop, 13–23. Valencia.10.18653/v1/W17-0802Search in Google Scholar

Nuyts, Jan. 2005. The modal confusion: On terminology and the concepts behind it. In Alex Klinge & Henrik H. Müller (eds.), Modality: Studies in form and function. London: Equinox.Search in Google Scholar

Nuyts, Jan & Johan van der Auwera (eds.). 2016. The Oxford handbook of modality and mood. Oxford: Oxford University Press.10.1093/oxfordhb/9780199591435.013.4Search in Google Scholar

O’Donnell, Michael J. 2008. Demonstration of the UAM corpus tool for text and image annotation. Conference: ACL 2008, Paper presented at the 46th Annual Meeting of the Association for Computational Linguistics (ACL), June 15–20, 2008. Columbus, Ohio, USA, Demo Papers.10.3115/1564144.1564148Search in Google Scholar

Palmer, Frank R. 1986. Mood and modality. Cambridge: Cambridge University Press.Search in Google Scholar

Papacharissi, Zizi. 2014. Affective publics: Sentiment, technology, and politics. Oxford: Oxford University Press.10.1093/acprof:oso/9780199999736.001.0001Search in Google Scholar

Põldvere, Nele, Matteo Fuoli & Carita Paradis. 2016. A study of dialogic expansion and contraction in spoken discourse using corpus and experimental techniques. Corpora 11(2). 191–225. https://doi.org/10.3366/cor.2016.0092.Search in Google Scholar

Quirk, Randolph, Sydney Greenbaum & Geoffrey Leech. 1985. A comprehensive grammar of the English language. London: Longman.Search in Google Scholar

Reagle, Joseph M. 2015. Reading the comments: Likers, haters, and manipulators at the bottom of the web. Cambridge: MIT Press.10.7551/mitpress/10116.001.0001Search in Google Scholar

Rowe, Ian. 2015. Civility 2.0: A comparative analysis of incivility in online political discussion. Information, Communication & Society 18(2). 121–138. https://doi.org/10.1080/1369118x.2014.940365.Search in Google Scholar

Scheibman, Joanne. 2002. Point of view and grammar: Structural patterns of subjectivity in American English conversation. Amsterdam: John Benjamins.10.1075/sidag.11Search in Google Scholar

Taboada, Maite & Marta Carretero. 2012. Contrastive analysis of evaluation in text: Key issues in the design of an annotation system for attitude applicable to consumer review in English and Spanish. Linguistics and the Human Sciences 6(1–3). 275–295. https://doi.org/10.1558/lhs.v6i1-3.275.Search in Google Scholar

Taboada, Maite, Radoslava Trnavac & Cliff Goddard. 2017. On being negative. Corpus Pragmatics 1(1). 57–76. https://doi.org/10.1007/s41701-017-0006-y.Search in Google Scholar

Thompson, Sandra A. 2002. “Object complements” and conversation: Towards a realistic account. Studies in Language 26(1). 125–164. https://doi.org/10.1075/sl.26.1.05tho.Search in Google Scholar

Thompson, Sandra A. & Anthony Mulac. 1991. A quantitative perspective on the grammaticalization of epistemic parentheticals in English. In Elizabeth C. Traugott & Bernd Heine (eds.), Approaches to grammaticalization, 313–339. Amsterdam & Philadelphia: John Benjamins.10.1075/tsl.19.2.16thoSearch in Google Scholar

Traugott, Elizabeth C. 2010. (Inter)subjectivity and (inter)subjectification: A reassessment. In Kristin Davidse, Lieven Vandelanotte & Cuyckens Hubert (eds.), Subjectification, intersubjectification and grammaticalization, 29–71. Berlin & New York: Mouton de Gruyter.10.1515/9783110226102.1.29Search in Google Scholar

Trnavac, Radoslava & Maite Taboada. 2012. The contribution of nonveridical rhetorical relations to evaluation in discourse. Language Sciences 34(3). 301–318. https://doi.org/10.1016/j.langsci.2011.10.005.Search in Google Scholar

Tsui, Amy. 1991. The pragmatic functions of ‘I don’t know’. Text 11. 807–822. https://doi.org/10.1515/text.1.1991.11.4.607.Search in Google Scholar

Ullmann, Stefanie & Marcus Tomalin. 2020. Quarantining online hate speech: Technical and ethical perspectives. Ethics and Information Technology 22. 69–80. https://doi.org/10.1007/s10676-019-09516-z.Search in Google Scholar

Weizman, Elda & Gonen Dori-Hacohen. 2017. On-line commenting on opinion editorials: A cross-cultural examination of face work in the Washington Post (USA) and NRG (Israel). Discourse, Context & Media 19. 39–48. https://doi.org/10.1016/j.dcm.2017.02.001.Search in Google Scholar

Received: 2020-09-25
Accepted: 2021-09-21
Published Online: 2021-10-11
Published in Print: 2023-03-28

© 2021 Walter de Gruyter GmbH, Berlin/Boston

Downloaded on 2.4.2023 from https://www.degruyter.com/document/doi/10.1515/text-2020-0171/html
Scroll to top button