Visual semiotics and automatic analysis of images from the Cultural Analytics Lab: How can quantitative and qualitative analysis be combined?

and Maria Giulia DonderoORCID iD: https://orcid.org/0000-0003-2320-8130

Abstract

In this article we explore the relationship between semiotic analysis of images and quantitative analysis of vast image corpora, in particular the work produced by Lev Manovich and the Cultural Analytics Lab, called “Media Visualization.” Media Visualization has been chosen as corpus because of its metavisual operation (images are visualized and analyzed by images) and its innovating way of conceiving analysis: by visual instruments. In this paper semiotics is used as an approach to Media Visualization and taken as an object of study as well, especially visual semiotics. In this sense, a comparison between visual semiotics (close reading of small corpora) and quantitative analyses of images (distant reading of vast collections) are conducted from a semiotic point of view. Post-Greimassian semiotics guides this study with respect to the issue of the image-within-an-image and metavisual visualization; Peircean semiotics is employed to explain and develop the notion of diagram.

  • Basso Fossali, P. & M. G. Dondero. 2011. Sémiotique de la photographie. Limoges: Pulim.

  • Batt, N. 2004. L’expérience diagrammatique: Un nouveau régime de pensée. Théorie, Littérature, Enseignement 22. 5–28.

  • Chauviré, C. 2008. L’œil mathématique: Essai sur la philosophie mathématique de Peirce. Paris: Vrin.

  • Dondero, M. G. 2012. Diagrammatic experiment in mathematics and in works of art. In K. Haworth, J. Hogue & L. G. Sbrocchi (eds.), The semiotics of worldviews (Semiotics 2011), 297–307. Ottawa: Legas.

  • Dondero, M. G. 2016a. Using images to analyze images: Semiotics meets cultural analytics. In E. Reyes-García, P. Châtel-Innocenti & K. Zreik (eds.), Archiving and questioning immateriality, 91–107. Paris: Europia.

  • Dondero, M. G. 2016b. L’énonciation énoncée dans l’image. In M. Colas-Blaise, L. Perrin & G. M. Tore (eds.), L’énonciation aujourd’hui: Un concept clé des sciences du langage, 343–369. Limoges: Lambert Lucas.

  • Dondero, M. G. 2017. The semiotics of design in media visualization: Mereology and observation strategies. Information Design Journal 23(2). 208–218.

  • Dondero, M. G. & J. Fontanille. 2014. The semiotic challenge of scientific images: A test case for visual meaning. Ottawa: Legas.

  • Festi, G. 2019. Infographics between figures and figurative language: A semiotic investigation of data visualization. Signata 10. 1–17.

  • Floch, J.-M. 1985. Petites mythologies de l’œil et de l’esprit: Pour une sémiotique plastique. Paris & Amsterdam: Hadès/Benjamins.

  • Floch, J.-M. 1986. Les formes de l’empreinte: Brandt, Cartier-Bresson, Doisneau, Stieglitz, Strandt. Périgueux: Fanlac.

  • Giardino, V. & M. Piazza. 2008. Senza parole: Ragionare con le immagini. Milan: Bompiani.

  • Greimas, A. J. 1984. Sémiotique figurative et sémiotique plastique. Actes Sémiotiques 60. 5–24.

  • Latour, B. 1999. Pandora’s hope: An essay on the reality of science studies. Cambridge, MA: Harvard University Press.

  • Manovich, L. 2001. The language of new media. Cambridge MA: MIT Press.

  • Manovich, L. 2011. Style space: How to compare image sets and follow their evolution. http://manovich.net/content/04-projects/073-style-space/70_article_2011.pdf (accessed 17 June 2019).

  • Manovich, L. 2013. Museum without walls, art history without names: Methods and concepts for media visualization. In C. Vernallis, A. Herzog & J. Richardson (eds.), The Oxford handbook of sound and image in digital media. New York: Oxford University Press.

  • Manovich, L. 2015. Data science and digital art history. International Journal for Digital Art History 1. 13–35.

  • Manovich, L. 2017. The science of culture? Social computing, digital humanities and cultural analytics. In M. T. Schäfer & K. van Es (eds.), The datafied society: Studying culture through data, 55–68. Amsterdam: Amsterdam University Press.

  • Manovich, L. & J. Douglass. 2009. Visualizing temporal patterns in visual media. http://softwarestudies.com/cultural_analytics/visualizing_temporal_patterns.pdf (accessed 17 June 2019).

  • Manovich, L., A. Tifentale, M. Yazdani & J. Chow. 2014. The exceptional and the everyday: 144 hours in Kiev. In Proceedings of the 2014 IEEE international conference on big data, 72–79.

  • Nixon, M. S. & A. S. Aguado. 2012. Feature extraction & image processing for computer vision. Oxford: Elsevier.

  • Stjernfelt, F. 2007. Diagrammatology: An investigation on the borderlines of phenomenology, ontology, and semiotics (Synthesis Library 336). Dortrecht: Springer Netherlands.

  • Stoichita, V. 1997. The self-aware image: An insight into early modern meta-painting. Cambridge & New York: Cambridge University Press.

  • Warburg, A. 2000. Der bilderatlas Mnemosyne, A. Warnke & C. Brink (eds.). Berlin: Akademie Verlag.

Purchase article
Get instant unlimited access to the article.
$42.00
Price including VAT
Log in
Already have access? Please log in.


Journal + Issues

The official journal of the International Association for Semiotic Studies, founded in 1969 as one of the first scholarly journals in the field, Semiotica features articles reporting results of research in all branches of semiotic studies, in-depth reviews of selected current literature in the field, and occasional guest editorials and reports. The journal also publishes occasional Special Issues devoted to topics of particular interest.

Search