Nicholas J Wade1. 1. School of Psychology, University of Dundee, Dundee DD1 4HN, Scotland; e-mail: n.j.wade@dundee.ac.uk.
Abstract
Pictorial images are icons as well as eye-cons: they provide distillations of objects or ideas into simpler shapes. They create the impression of representing that which cannot be presented. Even at the level of the photograph, the links between icon and object are tenuous. The dimensions of depth and motion are missing from icons, and these alone introduce all manner of potential ambiguities. The history of art can be considered as exploring the missing link between icon and object. Eye-cons can also be illusions-tricks of vision so that what is seen does not necessarily correspond to what is physically presented. Pictorial images can be spatialised or stylised; spatialised images generally share some of the projective characteristics of the object represented. Written words are also icons, but they do not resemble the objects they represent-they are stylised or conventional. Icons as stylised words and spatialised images were set in delightful opposition by René Magritte in a series of pipe paintings, and this theme is here alluded to. Most of visual science is now concerned with icons-two-dimensional displays on computer monitors. Is vision now the science of eye-cons?
Pictorial images are icons as well as eye-cons: they provide distillations of objects or ideas into simpler shapes. They create the impression of representing that which cannot be presented. Even at the level of the photograph, the links between icon and object are tenuous. The dimensions of depth and motion are missing from icons, and these alone introduce all manner of potential ambiguities. The history of art can be considered as exploring the missing link between icon and object. Eye-cons can also be illusions-tricks of vision so that what is seen does not necessarily correspond to what is physically presented. Pictorial images can be spatialised or stylised; spatialised images generally share some of the projective characteristics of the object represented. Written words are also icons, but they do not resemble the objects they represent-they are stylised or conventional. Icons as stylised words and spatialised images were set in delightful opposition by René Magritte in a series of pipe paintings, and this theme is here alluded to. Most of visual science is now concerned with icons-two-dimensional displays on computer monitors. Is vision now the science of eye-cons?
Observations provide the bedrock of perception. Records of observations precede records of their verbal descriptions; that is, the products of art precede those of writing. Relatively little is known about the origins of visual art. Examples of marks made on tools and cave walls have been dated to many thousands of years ago, but we do not know when such activities began. Writing had its origins around 5,000 years ago. The adoption of experimental methods to record observations is a development of recent centuries. What we consider to be art involves the distillation of specific observations into spatialised representations (what we call pictures) or of categories of observations into stylised representations (typically written words). Both pictorial images and written words are spatially extended, and both can be considered as icons. The term icon now has several connotations, but it derives from the Greek word eikon meaning likeness or image. It is in this sense that it will be used here so that an icon can be equated with a pictorial image.Perception has evolved to make and maintain adaptive contact with the environment. Through the action of the senses an organism seeks sustenance, shelter, and sex in order to survive and reproduce. The senses of all species have become adapted to the demands of their survival and reproduction, and there is a great variety in the ways in which senses have evolved. In addition, the human senses are linked to an intricately organised brain, which has evolved to extract more than the elements of material sustenance. It furnishes us with intellectual sustenance, too, and extracts from the patterns of sensory stimulation links to language and thought. Humans not only use their senses but they also muse about them. Paradoxically, much of this musing has concerned minor errors of perception (referred to here as eye contricks) rather than the constancies of what we perceive. Despite the long history of recording perceptions, attention continues to be directed to eye contricks—the small deviations from constancy that we call illusions. Constancy and illusion can be considered as existing on a continuum from veridical perception (reflected as a Brunswik ration of 1) to complete illusion (as in some instances of induced motion, when the physically moving parts are seen as stationary and the stationary parts as moving in the opposite direction). Most of our perception involves constancy or minor deviations from it; these latter we call illusions (or eye contricks). Artists have developed an array of eye contricks in order to achieve their ends—conveying an allusion to the objects or classes of object they represent. It will be argued that visual scientists now share this concern with artists. They examine representations of objects (usually pictorial representations of them) rather than the objects themselves: they are engaged in intricate manipulations of eye contricks which might not further our understanding of object perception.The concepts of image and icon have thrived on their vagueness, and so attempts have been made to refine them (see Wade 1990). An icon corresponds to a pictorial image: it is spatially extended and can share some of the projective characteristics of the object represented. Thus a photograph of a pipe is an icon or spatialised image because it corresponds to a projection of the three-dimensional object onto a two-dimensional surface. It also represents a specific pipe viewed from a particular direction. The word PIPE is similarly an icon or stylised image, but it refers to a category of objects rather than to specific exemplars. Like all pictorial images, icons are eye-cons: they provide a distillation of a complex object or idea into a simple pictorial shape. They create the impression of representing that which cannot be veridically presented. Despite the cliché that the camera never lies, the links between icon and object are tenuous in photographs. The dimensions of distance or depth as well as motion are missing from the pictorial image or icon, and this alone introduces all manner of potential ambiguities. Wagemans et al (2011), Koenderink et al (2011), and van Doorn et al (2011) discuss the apparent depth in pictorial images and the ways in which they can be measured. The history of art can be considered as an exploration of the missing link between icon and object: the many pictorial tricks applied by artists allude to the dimensions that icons and pictorial images do not contain—depth and motion. Eye-cons (as in Figure 1) can be more honest—they can reflect tricks of vision so that what is seen does not necessarily correspond to what is presented.
We all make icons (pictorial images) constantly, though we rarely think of them in this way—we can all write although most of our writing is now done indirectly via a computer keyboard. Accordingly, pictorial images can be either stylised, like the letters of our written language, or spatialised, like drawings, paintings, and photographs. Figure 2 conflates these two types of icons by presenting the words in both conventional and idiosyncratic scripts: conventional uppercase letters spell the words IMAGE repetitively in the top half and WORD in the bottom half. However, these conventional letter shapes are enclosed within idiosyncratic and incomplete script for WORD at the top and IMAGE at the bottom; only parts of the complete letters are presented, and they are joined by an equally idiosyncratic AND. The handmade words are more difficult to read as a consequence, unlike the conventional printed letter shapes. Moreover, the colours themselves play parts in the perceptual puzzle: the red is physically equivalent throughout, as is the blue, but they do not appear so. Owing to colour assimilation, the red looks darker in the upper half than in the lower, and the blue looks lighter in the lower than the upper half.
Eye contricks are much more than visual illusions, although they can operate at this level. Because icons and pictorial images generally seem to convey their meaning with such immediacy, we rarely stop to ponder the paradoxes they pose. If they are so important, we should understand more about the way we see them and the processes that are involved in making them. Pictorial representations, like those captured by a camera, are traditionally referred to as creating illusions of objects in three-dimensional space, but this is less than accurate because it betrays a misunderstanding of what is meant by the term illusion. Such pictures are visual allusions rather than visual illusions. The distinction is more fundamental than a single letter, and it can be illustrated in Figure 5. The words VISUAL ILLUSIONS are dimly defined by the green and yellow outlines and the slight difference in colour and contrast to the background. Throughout the figure there are red vertical lines; they are parallel to one another, but they probably look tilted one way and then the other. This is an example of an illusion.
Pictorial images are icons which provide allusions to objects, and some of the eye contricks that can be played with the transition from three to two dimensions. Indeed, this is grist to the artistic mill: icons incorporate ambiguities and impossibilities that are rarely or never present in objects. Are icons so central to understanding perception? What is the relationship between perception of pictorial images and of the objects they portray? Will understanding icons facilitate our interpretations of vision, or vice versa? And how do those peculiar eye-cons, geometrical optical illusions, relate to other forms of pictorial representation? It could well be argued that the study of vision will not be furthered by the examination of such oddities.Magritte was not alone in generating subtle eye contricks: others on the surrealist scene were sowing similar seeds. For example, Salvador Dali (1904–89) and Marcel Duchamp (1887–1968) drew upon the emerging experimental research on vision to further their artistic ends. Dali not only amplified ambiguities in many of his early paintings but also presented more subtle variations on the digitised images of Abraham Lincoln, constructed by Harmon and Julesz (1973)—see http://www.michaelbach.de/ot/fcs_mosaic/. Duchamp's rotoreliefs, produced at around the same time as Magritte's pipe pictures, followed rapidly on the heels of Musatti's (1924) experiments with the stereokinetic effect, where simple circular patterns appeared in depth when rotated—see http://lite.bu.edu/vision-flash10/applets/Depth/Benussi/Rotorelief.html and http://www.opprints.co.uk/stereokinetic-3-4-6.php. Other kinetic works by Duchamp were based on visual persistence. His Rotary Glass consisted of propellers of glass on which arcs were painted: when they were rotated rapidly they created the impression of circles (see Wade 1978). Between both these artists, and influencing them artistically, was Pablo Picasso (1881–1973). The development of cubism represented an attempt to embrace the other missing dimension in icons—time—by capturing views of the same subject at different moments of movement. All three artists are shown in Figure 10. On the left Dali's trademark moustache encloses contours alluding to ambiguous depths from which his third eye peers. In the centre Picasso can be seen within cubist depictions of his name PABLO PICASSO, and Duchamp's profile is part of a pattern that, if rotated, would appear like a cone in depth.
To question the appropriateness of icons as the stimuli for vision is more subversive than it might at first appear. Are not our ideas of the retinal image also iconic? We have certainly progressed in our physiological knowledge since Wundt; indeed, there are now physiological interpretations of illusions. But have our ideas about the nature of the retinal image advanced also? Visual phenomena provide the bedrock for science and art. Both disciplines revel in the license allowed by iconic manipulation. Natural vision is binocular and dynamic, yielding the perception of depth and motion. Icons are flat and static, but, when modified and presented via a computer, they can present us with perceptual paradoxes. The deeper puzzle is whether visual science is being conned by icons. Is it being seduced by the simplicity of image manipulation and losing sight of the functions that vision serves? Is vision now the science of eye-cons?
Authors: Johan Wagemans; Joeri De Winter; Hans Op de Beeck; Annemie Ploeger; Tom Beckers; Peter Vanroose Journal: Perception Date: 2008 Impact factor: 1.490