Uncanny valley

src: ichef.bbci.co.uk

In aesthetics, the uncanny valley is a hypothesized relationship between the degree of an object's resemblance to a human being and the emotional response to such an object. The concept of the uncanny valley suggests humanoid objects which appear almost, but not exactly, like real human beings elicit uncanny, or strangely familiar, feelings of eeriness and revulsion in observers. Valley denotes a dip in the human observer's affinity for the replica, a relation that otherwise increases with the replica's human likeness.

Examples can be found in robotics, 3D computer animations, and lifelike dolls among others. With the increasing prevalence of virtual reality, augmented reality, and photorealistic computer animation, the 'valley' has been cited in the popular press in reaction to the verisimilitude of the creation as it approaches indistinguishability from reality. The uncanny valley hypothesis predicts an entity appearing almost human risks eliciting cold, eerie feelings in viewers.

Video Uncanny valley

Etymology

The concept was identified by the robotics professor Masahiro Mori as Bukimi no Tani Gensh? (???????) in 1970. The term was first translated as uncanny valley in the 1978 book Robots: Fact, Fiction, and Prediction, written by Jasia Reichardt, thus forging an unintended link to Ernst Jentsch's concept of the uncanny, introduced in a 1906 essay entitled "On the Psychology of the Uncanny." Jentsch's conception was elaborated by Sigmund Freud in a 1919 essay entitled "The Uncanny" ("Das Unheimliche").

Maps Uncanny valley

Hypothesis

Mori's original hypothesis states that as the appearance of a robot is made more human, some observers' emotional response to the robot becomes increasingly positive and empathetic, until it reaches a point beyond which the response quickly becomes strong revulsion. However, as the robot's appearance continues to become less distinguishable from a human being, the emotional response becomes positive once again and approaches human-to-human empathy levels.

This area of repulsive response aroused by a robot with appearance and motion between a "barely human" and "fully human" entity is the uncanny valley. The name captures the idea that an almost human-looking robot seems overly "strange" to some human beings, produces a feeling of uncanniness, and thus fails to evoke the empathic response required for productive human-robot interaction.

src: jonathanjoly.files.wordpress.com

Theoretical basis

A number of theories have been proposed to explain the cognitive mechanism underlying the phenomenon:

• Mate selection. Automatic, stimulus-driven appraisals of uncanny stimuli elicit aversion by activating an evolved cognitive mechanism for the avoidance of selecting mates with low fertility, poor hormonal health, or ineffective immune systems based on visible features of the face and body that are predictive of those traits.
• Mortality salience. Viewing an "uncanny" robot elicits an innate fear of death and culturally-supported defenses for coping with death's inevitability.... [P]artially disassembled androids...play on subconscious fears of reduction, replacement, and annihilation: (1) A mechanism with a human façade and a mechanical interior plays on our subconscious fear that we are all just soulless machines. (2) Androids in various states of mutilation, decapitation, or disassembly are reminiscent of a battlefield after a conflict and, as such, serve as a reminder of our mortality. (3) Since most androids are copies of actual people, they are doppelgängers and may elicit a fear of being replaced, on the job, in a relationship, and so on. (4) The jerkiness of an android's movements could be unsettling because it elicits a fear of losing bodily control."
• Pathogen avoidance. Uncanny stimuli may activate a cognitive mechanism that originally evolved to motivate the avoidance of potential sources of pathogens by eliciting a disgust response. "The more human an organism looks, the stronger the aversion to its defects, because (1) defects indicate disease, (2) more human-looking organisms are more closely related to human beings genetically, and (3) the probability of contracting disease-causing bacteria, viruses, and other parasites increases with genetic similarity." The visual anomalies of androids, robots, and other animated human characters cause reactions of alarm and revulsion, similar to corpses and visibly diseased individuals.
• Sorites paradoxes. Stimuli with human and nonhuman traits undermine our sense of human identity by linking qualitatively different categories, human and nonhuman, by a quantitative metric, degree of human likeness.
• Violation of human norms. The uncanny valley may "be symptomatic of entities that elicit a model of a human other but do not measure up to it". If an entity looks sufficiently nonhuman, its human characteristics are noticeable, generating empathy. However, if the entity looks almost human, it elicits our model of a human other and its detailed normative expectations. The nonhuman characteristics are noticeable, giving the human viewer a sense of strangeness. In other words, a robot stuck inside the uncanny valley is no longer judged by the standards of a robot doing a passable job at pretending to be human, but is instead judged by the standards of a human doing a terrible job at acting like a normal person. This has been linked to perceptual uncertainty and the theory of predictive coding.
• Religious definition of human identity. The existence of artificial but humanlike entities is viewed by some as a threat to the concept of human identity. An example can be found in the theoretical framework of psychiatrist Irvin Yalom. Yalom explains that humans construct psychological defenses in order to avoid existential anxiety stemming from death. One of these defenses is specialness, the irrational belief that aging and death as central premises of life apply to all others but oneself. The experience of the very humanlike "living" robot can be so rich and compelling that it challenges humans' notions of "specialness" and existential defenses, eliciting existential anxiety. In folklore, the creation of human-like, but soulless, beings is often shown to be unwise, as with the golem in Judaism, whose absence of human empathy and spirit can lead to disaster, however good the intentions of its creator.
• Conflicting perceptual cues. The negative effect associated with uncanny stimuli is produced by the activation of conflicting cognitive representations. Perceptual tension occurs when an individual perceives conflicting cues to category membership, such as when a humanoid figure moves like a robot, or has other visible robot features. This cognitive conflict is experienced as psychological discomfort (i.e., "eeriness"), much like the discomfort that is experienced with cognitive dissonance. Several studies support this possibility. Mathur and Reichling found that the time subjects took to gauge a robot face's human- or mechanical-resemblance peaked for faces deepest in the uncanny valley, suggesting that perceptually classifying these faces as "human" or "robot" posed a greater cognitive challenge. However, they found that while perceptual confusion coincided with the uncanny valley, it did not mediate the effect of the uncanny valley on subjects' social and emotional reactions--suggesting that perceptual confusion may not be the mechanism behind the uncanny valley effect. Burleigh and colleagues demonstrated that faces at the midpoint between human and non-human stimuli produced a level of reported eeriness that diverged from an otherwise linear model relating human-likeness to affect. Yamada et al. found that cognitive difficulty was associated with negative affect at the midpoint of a morphed continuum (e.g., a series of stimuli morphing between a cartoon dog and a real dog). Ferrey et al. demonstrated that the midpoint between images on a continuum anchored by two stimulus categories produced a maximum of negative affect, and found this with both human and non-human entities. Schoenherr and Burleigh provide examples from history and culture that evidence an aversion to hybrid entities, such as the aversion to genetically modified organisms ("Frankenfoods") and transgender individuals. Finally, Moore developed a Bayesian mathematical model that provides a quantitative account of perceptual conflict. There has been some debate as to the precise mechanisms that are responsible. It has been argued that the effect is driven by categorization difficulty, perceptual mismatch, frequency-based sensitization, and inhibitory devaluation.
• Threat to humans' distinctiveness and identity. Negative reactions toward very humanlike robots can be related to the challenge that this kind of robot leads to the categorical human - non-human distinction. Kaplan stated that these new machines challenge human uniqueness, pushing for a redefinition of humanness. MacDorman and Entenzari investigated the distinction of human and robots as an individual trait that can predict sensitivity to the uncanny valley phenomenon. Ferrari, Paladino and Jetten found that the increase of anthropomorphic appearance of a robot leads to an enhancement of threat to the human distinctiveness and identity. The more a robot resembles a real person, the more it represents a challenge to our social identity as human beings.

Research

A series of studies experimentally investigated whether uncanny valley effects exist for static images of robot faces. Mathur MB & Reichling DB used two complementary sets of stimuli spanning the range from very mechanical to very human-like: first, a sample of 80 objectively chosen robot face images from Internet searches, and second, a morphometrically and graphically controlled 6-face series set of faces. They asked subjects to explicitly rate the likability of each face. To measure trust toward each face, subjects completed a one-shot investment game to indirectly measure how much money they were willing to "wager" on a robot's trustworthiness. Both stimulus sets showed a robust uncanny valley effect on explicitly-rated likability and a more context-dependent uncanny valley on implicitly-rated trust. Their exploratory analysis of one proposed mechanism for the uncanny valley, perceptual confusion at a category boundary, found that category confusion occurs in the uncanny valley but does not mediate the effect on social and emotional responses.

One study conducted in 2009 examined the evolutionary mechanism behind the aversion associated with the uncanny valley. A group of five monkeys were shown three images: two different 3D monkey faces (realistic, unrealistic), and a real photo of a monkey's face. The monkeys' eye-gaze was used as a proxy for preference or aversion. Since the realistic 3D monkey face was looked at less than either the real photo, or the unrealistic 3D monkey face, this was interpreted as an indication that the monkey participants found the realistic 3D face aversive, or otherwise preferred the other two images. As one would expect with the uncanny valley, more realism can lead to less positive reactions, and this study demonstrated that neither human-specific cognitive processes, nor human culture explain the uncanny valley. In other words, this aversive reaction to realism can be said to be evolutionary in origin.

As of 2011, researchers at University of California, San Diego and California Institute for Telecommunications and Information Technology are measuring human brain activations related to the uncanny valley. In one study using fMRI, a group of cognitive scientists and roboticists found the biggest differences in brain responses for uncanny robots in parietal cortex, on both sides of the brain, specifically in the areas that connect the part of the brain's visual cortex that processes bodily movements with the section of the motor cortex thought to contain mirror neurons. The researchers say they saw, in essence, evidence of mismatch or perceptual conflict. The brain "lit up" when the human-like appearance of the android and its robotic motion "didn't compute". Ay?e P?nar Sayg?n, an assistant professor from UCSD, says "The brain doesn't seem selectively tuned to either biological appearance or biological motion per se. What it seems to be doing is looking for its expectations to be met - for appearance and motion to be congruent."

Viewer perception of facial expression and speech and the uncanny valley in realistic, human-like characters intended for video games and film is being investigated by Tinwell et al., 2011. Consideration is also given by Tinwell et al. (2010) as to how the uncanny may be exaggerated for antipathetic characters in survival horror games. Building on the body of work already undertaken in android science, this research intends to build a conceptual framework of the uncanny valley using 3D characters generated in a real-time gaming engine. The goal is to analyze how cross-modal factors of facial expression and speech can exaggerate the uncanny. Tinwell et al., 2011 have also introduced the notion of an unscalable uncanny wall that suggests that a viewer's discernment for detecting imperfections in realism will keep pace with new technologies in simulating realism. A summary of Angela Tinwell's research on the uncanny valley, psychological reasons behind the uncanny valley and how designers may overcome the uncanny in human-like virtual characters is provided in her book, The Uncanny Valley in Games and Animation by CRC Press.

src: i.ytimg.com

Design principles

A number of design principles have been proposed for avoiding the uncanny valley:

• Design elements should match in human realism. A robot may look uncanny when human and nonhuman elements are mixed. For example, both a robot with a synthetic voice or a human being with a human voice have been found to be less eerie than a robot with a human voice or a human being with a synthetic voice. For a robot to give a more positive impression, its degree of human realism in appearance should also match its degree of human realism in behavior. If an animated character looks more human than its movement, this gives a negative impression. Human neuroimaging studies also indicate matching appearance and motion kinematics are important.
• Reducing conflict and uncertainty by matching appearance, behavior, and ability. In terms of performance, if a robot looks too appliance-like, people expect little from it; if it looks too human, people expect too much from it. A highly human-like appearance leads to an expectation that certain behaviors are present, such as humanlike motion dynamics. This likely operates at a sub-conscious level and may have a biological basis. Neuroscientists have noted "when the brain's expectations are not met, the brain...generates a 'prediction error'. As human-like artificial agents become more commonplace, perhaps our perceptual systems will be re-tuned to accommodate these new social partners. Or perhaps, we will decide "it is not a good idea to make [robots] so clearly in our image after all."
• Human facial proportions and photorealistic texture should only be used together. A photorealistic human texture demands human facial proportions, or the computer generated character can fall into the uncanny valley. Abnormal facial proportions, including those typically used by artists to enhance attractiveness (e.g., larger eyes), can look eerie with a photorealistic human texture. Avoiding a photorealistic texture can permit more leeway.

src: i0.wp.com

Criticism

A number of criticisms have been raised concerning whether the uncanny valley exists as a unified phenomenon amenable to scientific scrutiny:

• Good design can lift human-looking entities out of the valley. David Hanson has criticized Mori's hypothesis that entities approaching human appearance will necessarily be evaluated negatively. He has shown that the uncanny valley that Karl MacDorman and Hiroshi Ishiguro generated - by having participants rate photographs that morphed from humanoid robots to android robots to human beings - could be flattened out by adding neotenous, cartoonish features to the entities that had formerly fallen into the valley. This approach uses the fact that humans find characteristics appealing that are reminiscent of the young of our own (as well as many other) species, as used in cartoons.
• The uncanny appears at any degree of human likeness. Hanson has also pointed out that uncanny entities may appear anywhere in a spectrum ranging from the abstract (e.g., MIT's robot Lazlo) to the perfectly human (e.g., cosmetically atypical people). Capgras syndrome is a relatively rare condition in which the sufferer believes that people (or, in some cases, things) have been replaced with duplicates. These duplicates are rationally accepted as identical in physical properties, but the irrational belief is held that the "true" entity has been replaced with something else. Some sufferers of Capgras syndrome claim that the duplicate is a robot. Ellis and Lewis argue that the syndrome arises from an intact system for overt recognition coupled with a damaged system for covert recognition, which leads to conflict over an individual being identifiable but not familiar in any emotional sense. This supports the view that the uncanny valley could arise due to issues of categorical perception that are particular to the way the brain processes information.
• The uncanny valley is a heterogeneous group of phenomena. Phenomena labeled as being in the uncanny valley can be diverse, involve different sense modalities, and have multiple, possibly overlapping causes, which can range from evolved or learned circuits for early face perception to culturally-shared psychological constructs. People's cultural backgrounds may have a considerable influence on how androids are perceived with respect to the uncanny valley.
• The uncanny valley may be generational. Younger generations, more used to CGI, robots, and such, may be less likely to be affected by this hypothesized issue.

src: i.ytimg.com

Similar effects

An effect similar to the uncanny valley was noted by Charles Darwin in 1839:

The expression of this [Trigonocephalus] snake's face was hideous and fierce; the pupil consisted of a vertical slit in a mottled and coppery iris; the jaws were broad at the base, and the nose terminated in a triangular projection. I do not think I ever saw anything more ugly, excepting, perhaps, some of the vampire bats. I imagine this repulsive aspect originates from the features being placed in positions, with respect to each other, somewhat proportional to the human face; and thus we obtain a scale of hideousness.

A similar "uncanny valley" effect could, according to the ethical-futurist writer Jamais Cascio, show up when humans begin modifying themselves with transhuman enhancements (cf. body modification), which aim to improve the abilities of the human body beyond what would normally be possible, be it eyesight, muscle strength, or cognition. So long as these enhancements remain within a perceived norm of human behavior, a negative reaction is unlikely, but once individuals supplant normal human variety, revulsion can be expected. However, according to this theory, once such technologies gain further distance from human norms, "transhuman" individuals would cease to be judged on human levels and instead be regarded as separate entities altogether (this point is what has been dubbed "posthuman"), and it is here that acceptance would rise once again out of the uncanny valley. Another example comes from "pageant retouching" photos, especially of children, which some find disturbingly doll-like.

Due to rapid advancements in the areas of artificial intelligence and affective computing, cognitive scientists have also suggested the possibility of an "Uncanny Valley of Mind". Accordingly, people might experience strong feelings of aversion if they encounter highly advanced, emotion-sensitive technology. Among the possible explanations for this phenomenon, both a perceived loss of human uniqueness and expectations of immediate physical harm are discussed by contemporary research.

src: i0.kym-cdn.com

In computer animation and special effects

A number of films that use computer-generated imagery to show characters have been described by reviewers as giving a feeling of revulsion or "creepiness" as a result of the characters looking too realistic. Examples include the following:

• According to roboticist Dario Floreano, the baby character Billy in Pixar's groundbreaking 1988 animated short film Tin Toy provoked negative audience reactions, which first led the film industry to take the concept of the uncanny valley seriously.
• The 2001 film Final Fantasy: The Spirits Within, the first photorealistic computer-animated feature film, provoked negative reactions from some viewers due to its near-realistic yet imperfect visual depictions of human characters. The Guardian critic Peter Bradshaw stated that while the film's animation is brilliant, the "solemnly realist human faces look shriekingly phoney precisely because they're almost there but not quite". Rolling Stone critic Peter Travers wrote of the film, "At first it's fun to watch the characters, [...] But then you notice a coldness in the eyes, a mechanical quality in the movements".
• Several reviewers of the 2004 animated film The Polar Express called its animation eerie. CNN.com reviewer Paul Clinton wrote, "Those human characters in the film come across as downright... well, creepy. So The Polar Express is at best disconcerting, and at worst, a wee bit horrifying". The term "eerie" was used by reviewers Kurt Loder and Manohla Dargis, among others. Newsday reviewer John Anderson called the film's characters "creepy" and "dead-eyed", and wrote that "The Polar Express is a zombie train". Animation director Ward Jenkins wrote an online analysis describing how changes to the Polar Express characters' appearance, especially to their eyes and eyebrows, could have avoided what he considered a feeling of deadness in their faces.
• In a review of the 2007 animated film Beowulf, New York Times technology writer David Gallagher wrote that the film failed the uncanny valley test, stating that the film's villain, the monster Grendel, was "only slightly scarier" than the "closeups of our hero Beowulf's face... allowing viewers to admire every hair in his 3-D digital stubble".
• Some reviewers of the 2009 animated film A Christmas Carol criticized its animation as creepy. Joe Neumaier of the New York Daily News said of the film, "The motion-capture does no favors to co-stars [Gary] Oldman, Colin Firth and Robin Wright Penn, since, as in 'Polar Express,' the animated eyes never seem to focus. And for all the photorealism, when characters get wiggly-limbed and bouncy as in standard Disney cartoons, it's off-putting". Mary Elizabeth Williams of Salon.com wrote of the film, "In the center of the action is Jim Carrey -- or at least a dead-eyed, doll-like version of Carrey".
• In the 2010 live-action film The Last Airbender, the character Appa, the flying bison, has been called "uncanny". Geekosystem's Susana Polo found the character "really quite creepy", noting "that prey animals (like bison) have eyes on the sides of their heads, and so moving them to the front without changing rest of the facial structure tips us right into the uncanny valley".
• The 2010 live-action film Tron: Legacy features a computer-generated young version of actor Jeff Bridges (as a young Kevin Flynn and Clu), which reviewers have criticized as creepy. Vic Holtreman of Screen Rant wrote, "Finally we get to the CGI recreation of Jeff Bridges as a young man. Have we finally gotten past the 'uncanny valley' (where the mind/eye discerns that something is just not quite 'real')? Sadly, no. As long as young Kevin Flynn wasn't talking, the face looked great - but as soon as he spoke, the creepy factor pops up. He looked like he had a face full of Botox [...] One could argue that Clu was a computer program and should have been 'stiff' compared to a human, but even in the opening scene of the film where we see the real-world young Kevin Flynn, the same effect is present". Manohla Dargis of The New York Times wrote that the appearance of young Kevin was "a simulacrum that here looks like an animated death mask". Amy Biancolli of the Houston Chronicle wrote, "Regarding Bridges' digital de-aging: It's creepy. It's a little less creepy on Clu's face (he's not human, anyway) than on Kevin's in a scene from 1989, but on either of them it has the waxen look of storefront mannequins - or over-Botoxed socialites".
• The 2011 animated film Mars Needs Moms was widely criticized for being creepy and unnatural because of its style of animation. The film was among the biggest box office bombs in history, which may have been due in part to audience revulsion. (Mars Needs Moms was produced by Robert Zemeckis's production company, ImageMovers, which had previously produced The Polar Express, Beowulf, and A Christmas Carol.)
• Reviewers had mixed opinions regarding whether the 2011 animated film The Adventures of Tintin: The Secret of the Unicorn was affected by the uncanny valley. Daniel D. Snyder of The Atlantic wrote, "Instead of trying to bring to life Herge's beautiful artwork, Spielberg and co. have opted to bring the movie into the 3D era using trendy motion-capture technique to recreate Tintin and his friends. Tintin's original face, while barebones, never suffered for a lack of expression. It's now outfitted with an alien and unfamiliar visage, his plastic skin dotted with pores and subtle wrinkles." He added, "In bringing them to life, Spielberg has made the characters dead.". N.B. of The Economist called elements of the animation "grotesque", writing, "Tintin, Captain Haddock and the others exist in settings that are almost photo-realistic, and nearly all of their features are those of flesh-and-blood people. And yet they still have the sausage fingers and distended noses of comic-strip characters. It's not so much 'The Secret of the Unicorn' as 'The Invasion of the Body Snatchers'". However, other reviewers felt that the film avoided the uncanny valley despite its animated characters' realism. Critic Dana Stevens of Slate wrote, "With the possible exception of the title character, the animated cast of Tintin narrowly escapes entrapment in the so-called 'uncanny valley'". Wired magazine editor Kevin Kelly wrote of the film, "we have passed beyond the uncanny valley into the plains of hyperreality".
• The 2015 live-action film Terminator Genisys contains a scene featuring a computer-generated young version of actor Arnold Schwarzenegger (as a young T-800 Terminator), which some reviewers thought was affected by the uncanny valley. Eric Mungenast of the East Valley Tribune wrote of the film, "One notable technological problem stems from the attempt to make old Schwarzenegger look young again with some digital manipulation -- it definitely doesn't cross over the uncanny valley". Writer and reviewer Simon Prior wrote of the film, "Even the 'Synthespian' version of Arnie isn't as horrific as you might expect, although it's still clear that CGI hasn't yet conquered the Uncanny Valley issue". (The film's predecessor, 2009's Terminator Salvation, also has a scene with a CG young Schwarzenegger that provoked similar reactions from some viewers, but unlike in the newer film, this earlier version does not speak.)
• The 2016 live-action film Rogue One features the CGI likenesses of the deceased Peter Cushing and a young Carrie Fisher "reprising" their respective roles of Grand Moff Tarkin and Princess Leia. Graeme McMillan of The Hollywood Reporter wrote, "The Tarkin that appears in Rogue One is a mix of CGI and live-action, and it... doesn't work. -- In fact, for a special effect that's still stuck in the depths of the uncanny valley, it's surprising just how much of the movie Tarkin appears in, quietly undermining every scene he's in by somehow seeming less real than the various inhuman aliens in the movie." Kelly Lawler of USA Today wrote, "the Leia cameo is so jarring as to take the audience completely out of the film at its most emotional moment. Leia's appearance was meant to help the film end on a hopeful note [...] but instead it ends on a weird and unsettling one".

src: 4.bp.blogspot.com

In fiction

The fear, arising at contemplation of the "person" having small aberrations, and strengthening of impression because of its movement were noticed in 1818 by Mary Shelley in the novel Frankenstein; or, The Modern Prometheus:

How to describe my feelings at this awful show, how to represent unfortunate, created by me with such incredible work? And meanwhile its members were proportional, and I picked up for it beautiful lines. Beautiful -- My God great! Yellow skin too hardly fitted his muscles and veins; hair were black, shiny and long, and teeth white as pearls; but that their contrast with the watery eyes almost indistinguishable on color from eye-sockets, with dry skin and a narrow cut of a black mouth was more terrible. [...] It was impossible to look at it without shudder. No mummy restored to life could be more awful than this monster. I saw the creation unfinished; it was ugly even then; but when his joints and muscles started moving, something turned out more terrible, than all fictions of Dante.

In the 2008 30 Rock episode "Succession", Frank Rossitano explains the uncanny valley concept, using a graph and Star Wars examples, to try to convince Tracy Jordan that his dream of creating a pornographic video game is impossible. He also references the computer-animated film The Polar Express.

src: i.ytimg.com

See also

src: s3.amazonaws.com

References

src: i1.wp.com

Bibliography

src: contently.com

External links

• Miklósi, Ádám and Korondi, Péter and Matellán, Vicente and Gácsi, Márta Ethorobotics: A New Approach to Human-Robot Relationship. Frontiers in Psychology, 2017, 8, p. 958
• Your Brain on Androids UCSD news release about human brain and the uncanny valley.

Views on the Uncanny Valley

• The Uncanny Valley - Dave Bryant
• Almost too human and lifelike for comfort - research journal for an uncanny valley PhD project
• Relation between motion and appearance is communication between androids and humans
• Wired article: "Why is this man smiling?", June 2002.
• The Uncanny valley - a visual explanation of the hypothesis with the application in gaming.

Source of the article : Wikipedia