Skip to content
Licensed Unlicensed Requires Authentication Published by De Gruyter Mouton October 4, 2016

Pow, Punch, Pika, and Chu: The Structure of Sound Effects in Genres of American Comics and Japanese Manga

Nimish K. Pratha, Natalie Avunjian and Neil Cohn
From the journal Multimodal Communication

Abstract

As multimodal works, comics are characterized as much by their use of language as by the style of their images. Sound effects in particular are exemplary of comics’ language-use, and we explored this facet of comics by analyzing a corpus of books from genres in the United States (mainstream and independent) and Japan (shonen/boys’ and shojo/girls’). We found variation between genres and between cultures across several properties of the content and presentation of sound effects. Foremost, significant differences arose between the lexical categories of sound effects (ex. onomatopoetic: Pow! vs. descriptive: Punch!) between genres within both culture’s works. Additionally, genres in Japanese manga vary in the scripts used to write sound effects in Japanese (hiragana vs. katakana). We argue that, in English, a similar function is communicated through the presence or absence of textual font stylization. Altogether, these aspects of variation mark sound effects as important carriers of multimodal information, and provide distinctions by which genres and cultures of comics can be distinguished.

Appendix: Works analyzed

American mainstream

Cho, Frank. (2005). Shanna, the She-Devil. Marvel. Issue 1.

Conway, G., Andru, R., & Giordano, D. (1976). The Battle of the Century: Superman vs. The Amazing Spiderman. DC Comics and Marvel. Prologue.

Heinberg, Alan & Cheung, Jim. (2005). Young Avengers. Marvel. Issue 1.

Hine, David & Gaydos, Michael. (2005). Daredevil: Redemption. Marvel. Issue 1.

Hine, David & Yardin, David. (2004). District X. Marvel. Issue 3.

Loeb, J., Lee, J., & Williams, S. (2002). Batman: Hush, Volume 1. DC Comics. Chapter 1.

Miller, F., Varley, L., & Jaunson, K. (1986). Batman: The Dark Knight Returns. DC Comics. Chapter 1.

Moore, A., Bolland, B., & Higgins, J. (1988). Batman: The Killing Joke. DC Comics.

Taylor, T., Redondo, B., & Hugonnard-Bert, J. (2014). Injustice: Gods Among Us: Year Two. DC Comics. Issue 1.

Vaughan, Brian, et al. (2001). Ultimate X-Men. Marvel. Issue 50.

American independent

Adkins, Leuwin & Shelton, Gilbert. (1972). Jesus Comics No. 3. Rip Off Press. Craddock’s Crusade.

Boivin, Jacques. (1988). The Complete Fluffhead. Phantasy Press. Fluffhead.

Cannon, Kevin. (2009). Far Arden. Top Shelf. Chapter 1.

Chevat, Richie & Ewing, Dean. (1982). The Ronnie Rat Show. Ink Works. Sleep Wid Da Fishes.

Deitch, Kim. (1978). Banzai! Kitchen Sink Enterprises. Noodles’ Punctured Romance.

Greenwood, Warren & Von Sholly, Pete. (1973). Zero, No. 1. Greenwood Organization. Shadows Over Happy Times, or Broccoli Unchained.

Griffin, Rick. (1968). ZAP, No. 2. Apex Novelties. Hike.

Nicholson, Jeff. (1986). Ultra Klutz, No. 4. Onward Comics. Chapter 5.

Sim, Dave. (1987). Cerebrus, Volume 1. Aardvark-Vanaheim. The Flame Jewel.

Todd, Mort & Clowes, Dan’l. (1987). Twist, No. 1. Kitchen Sink Enterprises. Shelter Skelter.

Japanese Shonen

Amano, Akira. (2012). Katekyo Hitman Reborn. Shueisha. Chapter 382.

Hideaki, Sorachi. (2013). Gintama. Shueisha. Chapter 448.

Kishimoto, Masashi. (2012). Naruto. Shueisha. Chapter 583.

Kubo, Tite. (2012). Bleach. Shueisha. Chapter 490.

Mashima, Hiro. (2014). Fairy Tail. Kodansha. Chapter 385.

Nanatsuki, Kyouichi & Yang, Kyung-Il. (2013). Area D. Shogakukan. Chapter 38.

Shimabukuro, Mitsutoshi. (2014). Toriko. Shueisha. Chapter 266.

Togashi, Yoshihiro. (2014). Hunter x Hunter. Shueisha. Chapter 342.

Yagi, Norihiro. (2012). Claymore. Shueisha. Chapter 132.

Yoshiki, Tanaka & Arakawa, Hiromu. (2014). The Heroic Legend of Arslan. Kodansha. Chapter 9.

Japanese Shojo

Aoyama, Haruno. (2011). Kawaikunai I. Shueisha. Chapter 1.

Fujii, Aya. (2014). Warui Hito. Shueisha. Chapter 1.

Hashiba, Mao. (2014). Hoshi no Ko. Shueisha. Chapter 1.

Meguro, Amu. (2012). Honey. Shueisha. Chapter 1.

Robiko. (2008). Tonari no Kaibutsu-kun. Kodansha. Chapter 1.

Saori. (2014). Warui Otoko. Shueisha. Chapter 1.

Shiina, Karuho. (2005). Kimi ni Todoke. Shueisha. Chapter 0.

Shiro, Ayane. (2013). Charlotte. Shueisha. Chapter 1.

Taamo. (2011). Taiyou no Ie. Kodansha. Chapter 1.

Yanai, Wakana. (2014). Mofuku no Angel. Shueisha. Chapter 1.

References

Akita, K. (2009). A grammar of sound-symbolic words in Japanese: theoretical approaches to iconic and lexical properties of mimetics. Doctoral Dissertation, Kobe University.Search in Google Scholar

Allen, K., and Ingulsrud, J. E. (2005). Reading manga: Patterns of personal literacies among adolescents. Language and Education, 19:265–280.10.1080/09500780508668681Search in Google Scholar

Baldwin, R. S., and Cody, J. M. (1978). Psycholinguistic approaches to a theory of punctuation. Journal of Literacy Research, 10(4):363–375.10.1080/10862967809547290Search in Google Scholar

Blackwell, N. L., Perlman, M., and Tree, J. E. F. (2015). Quotation as a multimodal construction. Journal of Pragmatics, 81:1–7.10.1016/j.pragma.2015.03.004Search in Google Scholar

Bredin, H. (1996). Onomatopoeia as a figure and a linguistic principle. New Literary History, 27:555–569.10.1353/nlh.1996.0031Search in Google Scholar

Brenner, R. E. (2007). Understanding Manga and Anime. Westport, CT: Libraries Unlimited.Search in Google Scholar

Cao, Y., Lau, R. W. H., and Chan, A. B. (2014). Look over here: Attention-directing composition of manga elements. ACM Transactions on Graphics, 33:1–11.10.1145/2601097.2601183Search in Google Scholar

Catricalà, M., and Guidi, A. (2015). Onomatopoeias: A new perspective around space, image schemas and phoneme clusters. Cognitive Processing, 16:175–178.10.1007/s10339-015-0693-xSearch in Google Scholar

Cohn, N. (2013a). Beyond speech balloons and thought bubbles: The integration of text and image. Semiotica, 2013:35–63.10.1515/sem-2013-0079Search in Google Scholar

Cohn, N. (2013b). The Visual Language of Comics: Introduction to the Structure and Cognition of Sequential Images. London, UK: Bloomsbury.Search in Google Scholar

Cohn, N. (2016). A multimodal parallel architecture: A cognitive framework for multimodal interactions. Cognition, 146:304–323.10.1016/j.cognition.2015.10.007Search in Google Scholar

Cohn, N., and Ehly, S. (2016). The vocabulary of manga: Visual morphology in dialects of Japanese visual language. Journal of Pragmatics, 92:17–29.10.1016/j.pragma.2015.11.008Search in Google Scholar

Cohn, N., Taylor-Weiner, A., and Grossman, S. (2012). Framing attention in Japanese and American comics: Cross-cultural differences in attentional structure. Frontiers in Psychology – Cultural Psychology, 3:1–12.10.3389/fpsyg.2012.00349Search in Google Scholar

Coulmas, F. (1989). The Writing Systems of the World. Malden, MA: Blackwell Publishers Inc.Search in Google Scholar

Drummond-Mathews, A. (2010). What boys will be: A study of Shōnen manga. In: Manga: An Anthology of Global and Cultural Perspectives, T. Johnson-Woods (Ed.). New York: Continuum Books.Search in Google Scholar

Duncan, R., and Smith, M. J. (2009). The Power of Comics. New York: Continuum Books.Search in Google Scholar

Flyxe, M. (2002). Translation of Japanese onomatopoeia into Swedish (with focus on lexicalization). Africa & Asia, 2:54–73.Search in Google Scholar

Forceville, C. (2013). Creative visual duality in comics balloons. In: The Agile Mind, T. Veale, K. Feyaerts, and C. Forceville (Eds.). Berlin: Mouton de Gruyter.Search in Google Scholar

Forceville, C., Veale, T., and Feyaerts, K. (2010). Balloonics: The visuals of balloons in comics. In: The Rise and Reason of Comics and Graphic Literature: Critical Essays on the Form, J. Goggin, and D. Hassler-Forest (Eds.). Jefferson: McFarland & Company Inc.Search in Google Scholar

Forster, I., Borgwaldt, S. R., and Neef, M. (2012). Form follows function: Interjections and onomatopoetica in comics. Writing Systems Research, 4:122–139.10.1080/17586801.2012.751348Search in Google Scholar

Gravett, P. (2004). Manga: Sixty Years of Japanese Comics. New York, NY: HarperCollins.Search in Google Scholar

Griffin, J. K. (1998). A brief glossary of comic book terminology. Serials Review, 24:71–76.10.1080/00987913.1998.10764431Search in Google Scholar

Groensteen, T. (2007). The System of Comics. Jackson: University of Mississippi Press.Search in Google Scholar

Guynes, S. A. (2014). Four-color sound: A Peircean semiotics of comic book onomatopoeia. The Public Journal of Semiotics, 6:58–72.10.37693/pjos.2014.6.11916Search in Google Scholar

Hamano, S. (1998). The Sound-Symbolic System of Japanese. Stanford: CSLI Publications.Search in Google Scholar

Hatfield, C. (2005). Alternative Comics: An Emerging Literature. Jackson, MS: Univ. Press of Mississippi.Search in Google Scholar

Hill, G. E. (1943a). The vocabulary of comic strips. Journal of Educational Psychology, 34:77.10.1037/h0061956Search in Google Scholar

Hill, G. E. (1943b). Word distortions in comic strips. The Elementary School Journal, 43:520–525.10.1086/458218Search in Google Scholar

Inose, H. (2007). Translating Japanese onomatopoeia and mimetic words. Translation Research Projects, Anthony, Pym. Alexander, Perekrestenko (eds.), 1:97–116.Search in Google Scholar

Inoue, M. (2002). Gender, language, and modernity: Toward an effective history of Japanese women’s language. American Ethnologist, 29:392–422.10.1525/ae.2002.29.2.392Search in Google Scholar

Ito, K. (2005). A history of manga in the context of Japanese culture and society. Journal of Popular Culture, 38:456–575.10.1111/j.0022-3840.2005.00123.xSearch in Google Scholar

Iwahara, A., Hatta, T., and Maehara, A. (2003). The effects of a sense of compatibility between type of script and word in written Japanese. Reading and Writing, 16:377–397.10.1023/A:1023668804595Search in Google Scholar

Jüngst, H. E. (2004). Japanese comics in Germany. Perspectives: Studies in Translatology, 12:83–105.10.1080/0907676X.2004.9961493Search in Google Scholar

Kadooka, K.-I. (2005). On the degree of lexicalization in English onomatopoeia from a historical perspective. The Ryukoku Journal of Humanities and Sciences, 27:1–13.Search in Google Scholar

Klock, G. (2002). How to Read Superhero Comics and Why. New York, NY: A&C Black.Search in Google Scholar

Kovanen, S., and Aizawa, K. (2015). A layered method for determining manga text bubble reading order. Image Processing (ICIP), 2015 IEEE International Conference on, 27–30 September 2015, 4283–4287.10.1109/ICIP.2015.7351614Search in Google Scholar

Kurlander, D., Skelly, T., and Salesin, D. (1996). Comic chat. Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, ACM, 225–236.10.1145/237170.237260Search in Google Scholar

Manfredi, M., Cohn, N., and Kutas, M. (submitted). When a hit sounds like a kiss: An electrophysiological exploration of semantic processing in visual narrative.10.1016/j.bandl.2017.02.001Search in Google Scholar

Mazur, D., and Danner, A. (2014). Comics: A Global History, 1968 to the Present. London: Thames & Hudson.Search in Google Scholar

Nakazawa, J. (2016). Manga literacy and manga comprehension in Japanese children. In: The Visual Narrative Reader, N. Cohn (Ed.). London: Bloomsbury.Search in Google Scholar

Natsume, F. (2003). Japanese Manga: Its Expression and Popularity. ABD, 34(1):3–5.Search in Google Scholar

Nunberg, G. (1990). The Linguistics of Punctuation (No. 18). Stanford: Center for the Study of Language (CSLI).Search in Google Scholar

Petersen, R. S. (2009). The acoustics of manga. A Comics Studies Reader, 163–171.Search in Google Scholar

Piekos, N. (2009). Comics Grammar and Traditions. Blambot: Comic Fonts and Lettering (http://www.blambot.com) [Online]. Available: http://www.blambot.com/grammar.shtml (Accessed 3/23/09).Search in Google Scholar

Prough, J. (2010). Shojo manga in Japan and abroad. In: Manga: An Anthology of Global and Cultural Perspectives, T. Johnson-Woods (Ed.). New York: Continuum.Search in Google Scholar

Robertson, W. (2015). Orthography, foreigners, and fluency: Indexicality and script selection in Japanese manga. Japanese Studies, 35:205–222.10.1080/10371397.2015.1080594Search in Google Scholar

Schodt, F. L. (1983). Manga! Manga! The World of Japanese Comics. New York: Kodansha America Inc.Search in Google Scholar

Sell, C. (2011). Manga translation and interculture. Mechademia, 6:93–108.10.1353/mec.2011.0002Search in Google Scholar

Smith (Shibamoto), J. S. (1996). Japanese writing. In: The World’s Writing Systems, P.T. Daniels, and W. Bright (Eds.). Oxford, UK: Oxford University Press.Search in Google Scholar

Smith, J. S., and Schmidt, D. L. (1996). Variability in written Japanese: Towards a sociolinguistics of script choice. Visible Language, 30:46–71.Search in Google Scholar

Takashima, M. (2002). The development of young children’s understanding of representation using thought-bubbles. The Japanese Journal of Developmental Psychology, 13:136–146.Search in Google Scholar

Tsuchimochi, G. H. (1991). Education reform under the American occupation (3): Report of the United States education mission to japan and the reform of the Japanese language. Hirosaki University Repository for Academic Resources.Search in Google Scholar

Walker, M. (1980). The Lexicon of Comicana. Port Chester, NY: Comicana, Inc.Search in Google Scholar

Wellman, H. M., Hollander, M., and Schult, C. A. (1996). Young children’s understanding of thought bubbles and thoughts. Child Development, 67:768–788.10.2307/1131860Search in Google Scholar

Witek, J. (2012). Comics modes: caricature and illustration in the crumb family’s dirty laundry. In: Critical Approaches to Comics: Theories and Methods, M.J. Smith, and R. Duncan (Eds.). New York, NY: Routledge.Search in Google Scholar

Yannicopoulou, A. (2004). Visual aspects of written texts: preschoolers view comics. L1 – Educational Studies in Language and Literature, 4:169–181.10.1007/s10674-004-1024-9Search in Google Scholar

Zanettin, F. (2008). Comics in Translation. Manchester: St. Jerome Pub.Search in Google Scholar

Published Online: 2016-10-4
Published in Print: 2016-12-1

©2016 by De Gruyter Mouton

Scroll Up Arrow