14
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Linguistic typology of motion events in visual narratives

      research-article
      ,
      Cognitive Semiotics
      De Gruyter
      comics, linguistic relativity, linguistic typology, motion events, visual language

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Languages use different strategies to encode motion. Some use particles or “satellites” to describe a path of motion (Satellite-framed or S-languages like English), while others typically use the main verb to convey the path information (Verb-framed or V-languages like French). We here ask: might this linguistic variation lead to differences in the way paths are depicted in visual narratives like comics? We analyzed a corpus of 85 comics originally created by speakers of S-languages (comics from the United States, China, Germany) and V-languages (France, Japan, Korea) for both their depictions of path segments (source, route, and goal) and the visual cues signaling these paths and manner information (e.g., motion lines and postures). Panels from S-languages depicted more path segments overall, especially routes, than those from V-languages, but panels from V-languages more often isolated path segments into their own panels. Additionally, comics from S-languages depicted more motion cues than those from V-languages, and this linguistic typology also interacted with panel framing. Despite these differences across typological groups, analysis of individual countries’ comics showed more nuanced variation than a simple S–V dichotomy. These findings suggest a possible influence of spoken language structure on depicting motion events in visual narratives and their sequencing.

          Related collections

          Most cited references37

          • Record: found
          • Abstract: not found
          • Article: not found

          What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking

            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Motion streaks provide a spatial code for motion direction.

            Although many neurons in the primary visual cortex (V1) of primates are direction selective, they provide ambiguous information about the direction of motion of a stimulus. There is evidence that one of the ways in which the visual system resolves this ambiguity is by computing, from the responses of V1 neurons, velocity components in two or more spatial orientations and then combining these velocity components. Here I consider another potential neural mechanism for determining motion direction. When a localized image feature moves fast enough, it should become smeared in space owing to temporal integration in the visual system, creating a spatial signal-a 'motion streak'-oriented in the direction of the motion. The orientation masking and adaptation experiments reported here show that these spatial signals for motion direction exist in the human visual system for feature speeds above about 1 feature width per 100 ms. Computer simulations show that this psychophysical finding is consistent with the known response properties of V1 neurons, and that these spatial signals, when appropriately processed, are sufficient to determine motion direction in natural images.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Activation in Human MT/MST by Static Images with Implied Motion

              A still photograph of an object in motion may convey dynamic information about the position of the object immediately before and after the photograph was taken (implied motion). Medial temporal/medial superior temporal cortex (MT/MST) is one of the main brain regions engaged in the perceptual analysis of visual motion. In two experiments we examined whether MT/MST is also involved in representing implied motion from static images. We found stronger functional magnetic resonance imaging (fMRI) activation within MT/MST during viewing of static photographs with implied motion compared to viewing of photographs without implied motion. These results suggest that brain regions involved in the visual analysis of motion are also engaged in processing implied dynamic information from static images.
                Bookmark

                Author and article information

                Contributors
                Journal
                Cogn Semiot
                Cogn Semiot
                cogsem
                cogsem
                Cognitive Semiotics
                De Gruyter
                1662-1425
                2235-2066
                17 October 2022
                November 2022
                : 15
                : 2
                : 197-222
                Affiliations
                deptDepartment of Communication and Cognition , universityTilburg School of Humanities and Digital Sciences, Tilburg University , Tilburg, The Netherlands
                Author notes
                Corresponding author: Irmak Hacımusaoğlu, deptDepartment of Communication and Cognition , universityTilburg School of Humanities and Digital Sciences, Tilburg University , Tilburg, The Netherlands, E-mail: I.Hacimusaoglu@ 123456tilburguniversity.edu , Twitter: cogirmak
                Article
                cogsem-2022-2013
                10.1515/cogsem-2022-2013
                9767167
                36590029
                8057e23f-8819-4aa3-a76c-4b119bfcc7e2
                © 2022 the author(s), published by De Gruyter, Berlin/Boston

                This work is licensed under the Creative Commons Attribution 4.0 International License.

                History
                Page count
                Figures: 08, Tables: 01, References: 37, Pages: 26
                Funding
                Funded by: European Research Council
                Award ID: 850975
                Categories
                Article

                comics,linguistic relativity,linguistic typology,motion events,visual language

                Comments

                Comment on this article