Jump to ContentJump to Main Navigation


Journal of the International Association for Semiotic Studies / Revue de l'Association Internationale de Sémiotique

Editor-in-Chief: Danesi, Marcel

5 Issues per year

SCImago Journal Rank (SJR): 0.235
Source Normalized Impact per Paper (SNIP): 0.761

ERIH category 2011: INT2



From trash to treasure: Learning about brain images through multimodality

Morana Alač

Citation Information: Semiotica. Volume 2005, Issue 156, Pages 177–202, ISSN (Online) 1613-3692, ISSN (Print) 0037-1998, DOI: 10.1515/semi.2005.2005.156.177, August 2005

Publication History

Published Online:


Cognitive Neuroscientists use functional magnetic resonance imaging (fMRI) technology to generate digital images of the human brain. An fMRI image, as a final product of the scientific work, does not document movements and sounds that were present when such an image was recorded. Yet, a focus on actual moments of scientific practice reveals that such forgotten elements of practice can play important roles in understanding and knowledge acquisition. The multimodal interaction among scientists and digital screens shows how movements of the experimental subject and the scanner noise are performed to make images meaningful. Moreover, it suggests that the phenomena whose detection is crucial for a scientific reading of the brain images, such as motion artifacts, become visible as a result of coordination of various semiotic modalities (i.e., images, talk, body movements, gesture, etc.).

Comments (0)

Please log in or register to comment.