Tag: gesture

Talk to the Virtual Hands

A new paper in PlosOne has used new fancy research methods to look at whether humans are more capable of describing a word using just spoken communication, or whether the use of gesture also helps. This research is pertinent to the field of language evolution because it might help us understand if spoken language co-evolved with gesture as well as helping us understand how language is processed in the brain.

This new study builds on previous research in this area by using avatars in a virtual reality setting. Participants were either in control of the movements of their avatar, or not.

The study found that participants were much more successful in communicating concepts when the speaker was able to use their own gestures when explaining a concept using spoken language. The body language of the listener also impacted success at the task, showing the need for nonverbal feedback from the listener.

It’s worth noting that the primary purpose of this research wasn’t to find if gesture is helpful in communication (though that is certainly interesting and worthwhile) but rather whether using virtual reality is fruitful in these kinds of experiments.

The press release discusses some of the problems with using avatars:

The researchers note that there are limitations to nonverbal communication in virtual reality environments. First, they found that participants move much less in a virtual environment than they do in the “real world.” They also found that the perspective of the camera in the virtual environment affected the results.

Lead author, Dr. Trevor Dodds maintains, “this research demonstrates that virtual reality technology can help us gain a greater understanding of the role of body gestures in communication. We show that body gestures carry extra information when communicating the meaning of words. Additionally, with virtual reality technology we have learned that body gestures from both the speaker and listener contribute to the successful communication of the meaning of words.  These findings are also important for the development of virtual environments, with applications including medical training, urban planning, entertainment and telecommunication.”

The work was led by Dr. Trevor Dodds at the Max Planck Institute for Biological Cybernetics in Germany.

References
 Dodds TJ, Mohler BJ, Bu¨ lthoff HH (2011) Talk to the Virtual Hands: Self-Animated Avatars Improve Communication in Head-Mounted Display Virtual Environments. PLoS ONE 6(10): e25759. doi:10.1371/journal.pone.0025759

The Gestural Repertoire of the Wild Chimpanzee

In the past many studies have been done on the linguistic abilities of trained apes using artifical languages, but what about in the wild?

Catherine Hobaiter and Richard W. Byrne at the University of St. Andrews have carried out a new study looking at the intentional gestures of chimpanzees in the wild.

Whilst it is generall agreed that gestural communication in great apes as seen in the wild is intentional and elaborate and flexible the authors outline that there is still a lot of controversy with regards to interpretation of the system and how the apes acquire it. These questions are hard to untangle when studied in the captive settings of a zoo.

The study presents a systematic analysis of the gestures made by a population of chimpanzees in the wild. 4,397 cases of intentional gesture were recorded in Budongo, Uganda.

These recordings were used to identify 66 gesture types. These gestures were seen to differ between individuals and also between age classes. Regardless of these differences no gesture was used only by one individual. I worried when I first read this as sometime studies identify intentional gestures by using the criteria that the gestures were used in the same context a certain number of times, however, within this study the criteria for intention gesture was as follows:

Audience checking: The signaller shows signs of beingaware of the potential recipients and their state ofattention, e.g. turning to look at the recipient beforegesturing.

Response waiting: The signaler pauses at the end of thecommunication and maintains some visual contact.

Persistence: The production of further gestures, afterresponse waiting and in the absence of a response that in other cases is taken as satisfactory. (In certain circumstances, such persistence might be impossible, for example where an adult carries an infant away; these cases are marked as unable to persist, rather than nopersistence.)

The authors argue that these gestures are not acquired by ‘ontogenetic ritualization’, which is when actions which are performed to reach some goal become ritualised to the point that they can be anticipated from an intial gesture sequence. The authors carried out detailed analyses of two gestures to show that the action elements which the gestures were made up from did not match those of the original actions.

This lack of ontogenetic ritualisation may be down to these gestures being species-typical, or typical across all the great apes. Comparisons made with the recorded gestured of gorillas and orangutans show that chimpanzee overlap with at least 24 gestures which are recorded in all three species. Dr Hobaiter is cited as saying on the BBC story that:

“the gestures that apes use (and maybe some human gestures too) are derived from ancient shared ancestry of all the great ape species alive today.”

The gestures were also able to be used flexibly across contexts and were able to adjust to the audience, for example the chimps were shown giving silent gestures when their audience was attentive and used contact in their gestures when the audience was inattentive.

The paper includes extensive analysis of repertoire size across age groups, contexts each gesture type was used in as well as things like hand position and shape during gestures.

This is the first study of its type using a wild population of chimpanzees. It shows highly intentional use of a species-typical repertoire which seems surprising and certainly contributes evidence relating to the evolution of intentional communication.

Reference

Catherine Hobaiter and Richard W. Byrne (2011) The gestural repertoire of the wild chimpanzee. ANIMAL COGNITION. DOI: 10.1007/s10071-011-0409-2