Class overview and anatomy of a multimedia story

Tue, Jan 22, 2019

Buy HTML & CSS book

This class will recommend you to follow closely with the following HTML & CSS book. This book will be a good investment in your learning of web development, and will serve as a good reference guide for many years to come.

HTML and CSS book

Purchase options on the HTML & CSS Website

This book is also sold as a bundle with a JavaScript and jQuery book. This is also a recommended purchase for those who want to further their knowledge of jQuery.

Making sure your text editor is up to date

Brackets.io logo

In this course we will be using Brackets.io for all of the coding and previewing of documents. Please make sure your program is up to date.

Review last year’s projects

Here is a link to last year’s projects from this class. Some are password protected based on the student’s request (embargoed for publication or other reason). Contact the instructor for access.

Against All Odds Chinese students studying in America grapple with isolation and depression.

Legalizing Death A look at California legislation to legalize drug-assisted death for the terminally ill.

Death of Community Hospital The closing of a community hospital in San Pablo, and the ripple effect it will cause.

Privilege Project An experimental conversation-format interactive piece that places two strangers across from each other to discuss the concept of privilege.

Long Shore Port workers in Oakland are bound to lease agreements for little pay, and have few options to switch jobs.

LGBT Refugee An LGBT refugee from Uganda avoids the death penalty and immigrates to the U.S., but encounters a whole new set of challenges.

Long Shore A lesbian couple, who wishes to have a child that has genetic makeup from both parents, looks to the brother of one pair to serve as a sperm donor.

Looking at examples of News Packages

On this site, I’ve created a page amassing a large number of online news packages for students to analyze. There are over 1000 news packages listed on this site. As we go through the different approaches to displaying multimedia stories, it’s important to spend a significant amount of time looking at these examples to dissect and understand their nature. Most importantly, you should consider the following:

  • What is the first immediate impression of the overall design?
  • How effective is the information hierarchy, understanding what the story is about immediately, and does it engage you to dive in deeper?
  • does the story design aid in pulling you further into the story, or does it exist for its own sake?
  • do the media forms (i.e. video, photo, graphics, text) fit the various story components and tell those parts of the story well?
  • are the various story components the appropriate length given the medium used to consume the story?

Techniques for telling digital longform stories

Telling a longform story requires careful attention to the reader’s train of thought and how they are consuming the story. Given that the medium of the Web (the devices that are used to consume stories) are distracting, it becomes important to use multimedia in a way that keeps the attention span of the reader.

In general, the goals are:

  1. Use multimedia in a way that is cohesive to the overall narrative. Videos, photos, and graphics shouldn’t be redundant to text.
  2. Understand how multimedia connects with the content around it. Does it distract from the narrative? What is the cognitive load of a piece of multimedia? Does it interrupt the flow? If so, is that OK?
  3. Don’t create flashy design effects for their own sake. Every design decision should have a purpose. It’s OK for design to be “cool,” but use the cool factor in a way that better communicates the story. (e.g. Autoplaying background videos, scrolling curtain effects, or animation.)
  4. Ledes and introductory text of the package becomes crucial, because most continuous stories require a commitment from the user. Tease users with good explanatory introductions so they know what they are going to get.

“Chunkifying” content

A technique used in lots of continuous pieces is to break text apart into smaller chunks that grasp the user’s attention. It’s a bit like holding a user’s hand and leading them through the story.

Game of Shark and Minnow

In this South China Sea Piece by the New York Times, content is broken into smaller chunks at various points in the narrative. These pieces of content help reinforce the multimedia with descriptions of what’s happening.

The Guardian's Firestorm

In this piece Firestorm by The Guardian, a documentary filmmaker, longform magazine writer, and multimedia producer teamed up to tell the story of a family’s harrowing escape from a bushfire in Tasmania. Much of the piece is separated into smaller chunks.

Multimedia “Interrupters”

Another term has been adopted in the multimedia storytelling industry to describe when a piece of multimedia “interrupts” the narrative flow of a piece. While this sounds like a bad thing, it’s often done intentionally.

Careful consideration should be made as to when a piece of multimedia breaks the text apart, or when it’s placed off to the side of the text, where it becomes a more optional element.

Multimedia off to the side
Example of multimedia off to the side of a story.
The factors to consider in making this decision:
  • Is the multimedia critical the story, and at that point in the narrative?
  • What is the learning curve of an informational graphic? If it takes too long to decipher beyond a glance, perhaps it should be considered more of a sidebar.
  • Multimedia often makes good chapter breaks or segues for introducing the next section of a story.
  • Breaking up a narrative with a video is often a forceful indication that the viewer needs to watch it. You shouldn’t break the text if you think it’s optional, because the viewer will be left thinking they missed something.
New York Times Snow Fall
In the New York Time's Snow Fall piece, some multimedia was optional, some was intentionally interrupting.

Design techniques

Web producers employ several design techniques when building these packages. Most have usefulness, but some are often gratuitous or exist for their own sake.

Scrollytelling

Scrollytelling is a term that relates to animations that play as the user scrolls. This is often an effective method for engaging readers, because it offers simulation as they interact with the piece and makes the process of scrolling enjoyable. But the caveat is that most scrollytelling pieces require movement, and are often antithetical to longer text stories which are read at a much slower pace.

American Nile by National Geographic
In National Geographic's American Nile piece video and photos animate while you scroll, but someone actually reading the piece might find it distracting.
New York Times Easter Island
The New York Times did this scrollytelling piece on the erosion of Easter Island.
Space Race by the BBC
In this Space Race piece by the BBC, animation is tied to scrolling so that you can travel on a journey as you scroll through the piece.
Space Race by the BBC
In this mobile health piece, a playful animation is tied to the scrolling mechanism
  • Good for: scannable content, chunkified content.
  • Bad for: longer text stories.
Curtain Effect

A curtain effect is when part of the page seems to reveal another section of the page. This effect is often useful for indicating breaks in a piece, or a transition to another section of the copy. It should be considered a hard interruption, and give the sense of unveiling a piece of content.

Multimedia off to the side
In The Long, Strange Trip of Dock Ellis, multiple uses of the curtain effect unveil new parts of the story, often with a quote or photo.

Many times it’s used as purely an aesthetic device, perhaps gratuitously and unnecessarily.

  • Good for: creating very strong interruptions for transition, unveiling new content.
  • Bad for: times when it doesn’t serve a purpose, or it’s used gratuitously and unnecessarily.
Auto-playing Background videos

Another element seen in many continuous stories are silent auto-playing background videos. These can really make static images come alive and add some dynamism to the piece.

They usually come in two forms:

  1. Aesthetic: Simple repeating imagery that sets a scene or offers a piece of movement.
  2. Illustrative: A situation when it shows something happening. In this case it’s similar to an animated GIF. This is a quick way to show an action without the user having to commit to a video.

In the first case, the types of background videos that work best are ones that are short and have some type of subtle movement. They generally work create a scene setters, and help create a more dynamic feel that differs from the frozen moment of a still photo.

In the second case, the action should be quick or users might get confused about whether the video should be watched or just glanced at.

The Shirt on your back Guardian
The Shirt on Your Back Guardian project uses many auto-playing background videos to set the scene of where things are.
  • Good for: setting scenes, creating dynamism to a piece aesthetically.
  • Bad for: when it’s distracting, overused, too long, or should be a playable video instead.
Mobile Formatted Stories

Consumers are more likely to consume stories on their mobile device before anything else. When designing a news package, it is essential to make sure it functions on mobile.

But going further, many producers are designing packages specifically for mobile first, adding features and design considerations that don’t show up or work on desktop web. Some of these conventions are:

  • swiping to switch content
  • revealing content on scroll
  • slide-out “drawer” menus that appear when a button is pressed
  • large buttons that are easily pressed with a finger

Here are some examples of mobile-formatted news packages:

Long live group chat from Outline
From The Outline. This employs some of the best mobile design conventions for animating the feel of receiving alerts late at night. While the package holds up well on desktop, it plays especially well on mobile.
Science of Hummingbirds
From National Geographic, each page has a section that allows the user to play with animations.
Lynching in America
From the Equal Justice Initiative, the entire package is structured around swiping and paging, design conventions that are awkward on a desktop computer with a mouse.
City At War by Red Cross
From the international Committee of the Red Cross, animations play at each point of the story to illustrate concepts described in the text.
Washington Post Eclipse Package
Washington Post Eclipse package takes advantage of features to swipe the earth graphic to see where future eclipses will occur. This is clumsy on desktop.