How do people negotiate reading in a temporal medium? To what extent do they switch between reading and viewing modes, and how does an imposed pacing affect their interpretation and appreciation of the works? Our research questions also focus on the overlapping of cinema and digital art, exploring notions of media-specificity in the reading process.
Experiment 1: Understanding Text and/as Image in Experimental Film
Nine co-researchers were presented with an extract of the film Zorns Lemma (1970) by Hollis Frampton. The hour-long film is divided into three sections, each of which deals with different aspects of spoken and written language and the interrelationship between text and image. The main section is a 45-minute sequence which presents, at a rate of one-word-per-second, a series of written signs from in and around Manhattan – billboards, shop fronts, graffiti etc, the first letter of the word corresponding to a sequential progression through the alphabet. Gradually, the signs are replaced with images of action – rolling waves, a main painting a wall, steam rising, a mincemeat grinder – until all the letters are replaced. The film therefore illustrates a tight structure based on the Roman alphabet, and the audience is involved in a constant guessing-game about the nature of this structure. Viewing also oscillates between reading (text) and watching (images).
We wanted to explore a number of questions:
- How do viewers make sense of the work? What connections do they make between the words and the images and which schemata do they use for understanding the structures in the film?
- What images/words are retained? Is there a correlation between the words remembered and the letters to which they correspond? Is there a correlation between images remembered and the letters/words that they replace?
- Do viewers find the structure of the film confusing, distracting, frustrating or boring? To what extent is this due to the combined use of text and image?
- Reading speed: does the one-word-per-second rate of presentation seem too fast or too slow for facilitating comprehension whilst retaining interest?
After viewing a 20-minute extract of the main section of the film the co-researchers were given a simple questionnaire and were then asked a series of explorative questions about their experience.
Experiment 2: Exploring Reading Speed
This experiment initially emerged in response to the psychological study of sequential reading – a method called rapid serial visual presentation (RSVP) – in which words are presented one-by-one on a computer screen. The idea behind this method was that by removing the ocularmotor movements that occur in the reading of spatially distributed texts reading speed is substantially increased. Some studies have found that certain readers can comprehend texts at speeds of 3,000 words per minute, or 50 words per second. Internet artists Young Hae Chang Heavy Industries have created a series of works programmed in Flash software that use a similar technique of presentation. The short 'films' or 'poems' usually narrate a story through a sequential presentation of words or phrases that flash onto the screen at breakneck speed.
We were interested in three main questions:
- To what extent does the speed at which the words are presented affect the viewer’s ability to read and comprehend the text?
- How do different speeds of presentation affect their aesthetic judgement of the works?
- How do the fragmented nature of the text, the lack of control and the speed affects viewer’s evaluative judgements?
To explore these questions we used a six-minute piece entitled DAKOTA, one of YHCHI's most famous works The co-researchers were divided into three control groups. The first group saw the original version; the second group watched a slowed down version (50% of the original speed); the third group interacted with a self-paced version, which presented each of the words/sentences as a Powerpoint slide. None of the works included sound. The CRs were then given a short evaluative questionnaire and a word unscrambling task.
What did we find?
- As a whole, despite the difficulty of the work, participants worked to create patterns and structures as a way of grasping the meaning. They formed different hypotheses as the structure of the film developed. The use of the alphabet seemed to be a guiding factor, with most CRs initially attempting to find some correlation between the letter and the image that came to replace it.
- There is a strong correlation between the images that were most often recalled and the letters they replaced. These tended to be towards the end of the alphabet and at the beginning of the image replacement sequence.
- Participants tended to lose interest in the film after a short time. This was largely related to the element of repetition. Feelings of boredom were frequently reported even though most people referred to an active form of hypothesis making in the search for meaning.
Greene, Roland. ‘From Dante to the Post-Concrete: An Interview with Augusto de Campos’, The Harvard Library Bulletin 3.2 (Summer 1992).