Multimodality

The multimodal genres of writing are based on the idea that modes work in different ways, with different outcomes, to create various vehicles for communication. By layering or combining modes, an author can make meaning and communicate through mixed modes what a single mode cannot on its own. Essentially, modes “cooperate” to communicate the author’s intent as they interweave meanings captured by each.

 

A beach littered with trash.
Image 1.5 “Polluted Beach on the Red Sea in Sharm el-Naga, Port Safaga, Egypt” (Credit:Vberger from Wikimedia Commons used according to Public Domain.)

For example, think of a public service announcement about environmental conservation. A writer can create a linguistic text about the dangers of plastic pollution in oceans and support the ideas with knowledge of or expertise in the subject. Yet words alone may not communicate the message forcefully, particularly if the audience consists of people who have never considered the impact of pollution on the oceans. That writer, then, might combine the text with images of massive amounts of human-generated plastic waste littering a shoreline, thus strengthening the argument and enhancing meaning by touching on audience emotions. By using images to convey some of the message, the writer layers modes. The picture alone does not tell the whole story, but when combined with informational text, it enhances the viewer’s understanding of the issue.  The addition of various types of media can enhance the impact of a composition and thus increase the reader’s understanding of an issue. Modes, therefore, can be combined in various ways to communicate a rhetorical idea effectively, creating a powerful multimodal approach toward meaning.


Audience Awareness

As with any type of composition, knowing your audience (the readers and viewers for whom you are creating) will help you determine what information to include and what genre, mode(s), or media in which to present it. Consider your audience when choosing a composition’s tone (attitude toward the audience or subject), substance, and language. Considering the audience is critical not only in traditional academic writing but also in nearly any genre or mode you choose. Ask yourself these questions when analyzing your audience’s awareness:

  • What (and how much) does the audience already know about the topic? The amount of background information needed can influence what genre, modes, and media types you include and how you use them. You don’t want to bore an audience with information that is common knowledge or overwhelm an audience with information they know nothing about.
  • What is the audience’s viewpoint on the subject? Are you creating for a skeptical audience or one that largely agrees with your rhetorical arguments?
  • How do you relate to your audience? Do you share cultural understanding, or are you presenting information or beliefs that will be unfamiliar? This information will help you shape the message, tone, and structure of the composition.

Understanding your audience allows you to choose rhetorical devices that create contextually responsive compositions through multiple modes.


Cultural Lens

It is important to address audience diversity in all types of composition, but the unique aspects of multimodal composition present particular opportunities and challenges. First, when you compose, you do so through your own cultural filter, formed from your experiences, gender, education, and other factors. Multimodal composition opens up the ability to develop your cultural filter through various methods. Think about images of your lived experiences, videos capturing cultural events, or even gestures in live performances. Also, consider the diversity of your audience members and how that affects the content choices you make during composition. Avoiding ethnocentrism—the assumption that the customs, values, and beliefs of your culture are superior to others—is an important consideration when addressing your audience, as is using bias-free language, especially regarding ethnicity, gender, and ability.


Effective Writing

Experimenting with modes and media is not an excuse for poorly developed writing that lacks focus, organization, thought, purpose, or attention to mechanics. Although multimodal compositions offer the flexibility of expression, the content must still be presented in well-crafted, organized, and purposeful ways that reflect the author’s purpose and the audience’s needs.

  • A well-crafted composition should reflect the author’s use of literary devices to convey meaning, use of relevant connections, and acknowledgment of grammar and writing conventions.
  • To be organized, a composition should reflect the author’s use of effective transitions and a logical structure appropriate to the chosen mode.
  • To be purposeful, a composition should show that the author addresses the needs of the audience, uses rhetorical devices that advance the argument, and offers an insightful understanding of the topic.

Organization of multimodal compositions refers to the sequence of message elements. You must decide which ideas require attention, how much and in what order, and which modalities create maximum impact on readers. While many types of formal and academic writing follow a prescribed format, or at least the general outline of one, the exciting and sometimes overwhelming features of multimodal possibilities open the door to any number of acceptable formats. Some of these are prescribed, and others more open ended; your job will inevitably be to determine when to follow a template and when to create something new. As the composer, you seek to structure media in ways that will enable the reader or audience to derive meaning. Even small changes in media, rhetorical appeal, and organization can alter the ways in which the audience participates in the construction of meaning.

Within a medium—for example, a video—you might include images, audio, and text. By shifting the organization, placement, and interaction among the modes, you change the structure of the video and, therefore, create a variety of meanings. Now, imagine you use that same structure of images, audio, and text but change the medium to a slideshow. The impact on the audience will likely change with the change in medium.

Consider the infamous opening scene of the horror movie The Shining (1980). The primary medium, video, shows a car driving through a mountainous setting, the serene-looking Saint Mary Lake with its Wild Goose Island. After audio is added, music featuring ominous-sounding horns, however, the meaning of the multimodal composition changes, creating an emphasis on drama and danger.

Landscape scene from Glacier National Perk depicting a lake with a small island surrounded by tall granite mountains with trees in the foreground.
Image 1.6 St. Mary Lake (Credit:  “The upper end of St. Mary Lake and Wild Goose Island, Glacier National Park, Montana. Photo taken from Going-to-the-Sun Road” by Ken Thomas from Wikimedia Commons used according to CC0 1.0.)

 

Key Terms and Characteristics of Multimodal Texts

  • Alignment: the way in which elements such as text features, images, and particularly text are placed on a page. Text can be aligned at the left, center, or right. Alignment contributes to organization and how media transitions within a text.
  • Audience: readers or viewers of the composition.
  • Channel: a medium used to communicate a message. Often-used channels include websites, blogs, social media, print, audio, and video-hosting sites.
  • Complementary: describes content that is different across two or more modes, both of which are necessary for understanding. Often audio and visual modes are complementary, with one making the other more meaningful.
  • Emphasis: the elements in media that are most significant or pronounced. The emphasis choices have a major impact on the overall meaning of the text.
  • Focus: a clear purpose for composition, also called the central idea, main point, or guiding principle. Focus should include the specific audience the composer is trying to influence.
  • Layering: combining modes in a single composition
  • Layout: the organization of elements on a page, including text, images, shapes, and overall composition. Layout applies primarily to the visual mode.
  • Media: the means and channels of reaching an audience (for example, image, website, song). A medium (singular form of media) can contain multiple modes.
  • Mode: the method of communication (linguistic, visual, audio, or spatial means of creating meaning). Media can incorporate more than one mode.
  • Organization: the pattern of arrangement that allows a reader to understand text or images in a composition. Organization may be textual, visual, or spatial.
  • Proximity: the relationship between objects in space, specifically how close to or far from one another they are. Proximity can show a relationship between elements and is often important in layout.
  • Purpose: an author’s reason for writing a text, including the reasoning that accounts for which modes of presentation to use. Composers of multimodal texts may seek to persuade, inform, or entertain the audience.
  • Repetition: a unifying feature, such as a pattern used more than once, in the way in which elements (text features, typeface, color, etc.) are used on a page. Repetition often indicates emphasis or a particular theme. Repetitions and patterns can help focus a composition, explore a theme, and emphasize important points.
  • Supplementary: describes content that is different in two or more modes, where a composer uses one mode to convey primary understanding and the other(s) to support or extend understanding. Supplementary content should not be thought of as “extra,” for its purpose is to expand on the primary media.
  • Text: written words. In multimodal composition, text can refer to a piece of communication as a whole, incorporating written words, images, sounds, and movement.
  • Tone: the composer’s attitude toward the subject and/or the audience.
  • Transitions: words, phrases, or audiovisual elements that help readers make connections between ideas in a multimodal text, including connections from sentence to sentence, paragraph to paragraph, and mode to mode. Transitions show relationships between ideas and help effectively organize a composition.

LICENSE AND ATTRIBUTION

Adapted from Michelle Bachelor Robinson and Maria Jerskey’s “18.3: Glance at Genre: Genre, Audience, Purpose, Organization” of Writing Guide with Handbook, 2021, used according to  CC by 4.0.

License

Icon for the Creative Commons Attribution 4.0 International License

UNM Core Writing OER Collection Copyright © 2023 by University of New Mexico is licensed under a Creative Commons Attribution 4.0 International License, except where otherwise noted.

Share This Book