I Know What You're Thinking

by Damon Gambuto     Department: Health & Life Sciences

So we had trouble settling on a name for the segment Face Reader.  The software being demonstrated in the segment is called Mind Reader.  Why not name it 'Mind Reader' you ask.  Or should I say, why not name it 'Mind Reader' I ask on your behalf. 

As I remember the conversation going, the basic argument from people with names other than Damon: the software isn't really reading anyone's mind, but rather reading the expressions on their faces.  Hmm.  Okay.  Mind Reader still tickles my magazine-pun-titling predilections, but - hey - I'm a team player.  Face Reader it is.  But let's delve into this idea of what mind reading is and what it means in our lives.

First off, let's get clear on what we mean when we say mind reading.  What we don't mean is the endearing, chubby police officer on Heroes who can hear people's thoughts. What we do mean is what psychologists mean.  In psychology empathic accuracy or mind-reading describes a person's ability to attribute mental states to others from behavior and to use that knowledge to guide his or her actions and predict the actions of those others.  That is to say, mind reading is basically living in the social world.   It's what we do all day everyday when interacting with the people around us.  To not do it would be socially crippling.  To not be able to do it is at the core of Autism Spectrum Disorders.

Rosalind Picard and her colleague Rana el Kaliouby work with students who have Asberger's Syndrome (part of that autism spectrum).  Asberger's is often referred to as "The Geek Syndrome" because many with the condition operate with same gifts and deficiencies of the kids who get that moniker in grade school (I may or may not be referring to myself).  You can learn about the notion that many of history's great minds might have had the disorder here [hotlink to our article please]. 

One interesting tidbit about Picard and Kaliouby's work that we didn't cover in the segment is that they didn't start out trying to make a device that would help people.  What they were trying to develop was a device that would help computers.  The initial research was geared toward developing a more sensate computer.  The thinking goes: a computer that can read your mind could ease your anxiety and frustration when interacting with a machine.  Remember "Clippy" Microsoft's incessantly cheery paperclip?  No?  Count yourself among the lucky.  Clippy was a cartoon character that looked like a paperclip and popped up on your screen as your Microsoft Office Assistant when you did things like write the word "dear" at the beginning of a document.  As I recall the interaction went something like this:

Clippy: It looks like you are writing a letter.
Damon: No.
Clippy: Are you sure you're not writing a letter?
Damon: Go away.
Clippy: If you are writing a letter I can be of help.
Damon: Die! Die! Die! $%#ing Microsoft!

See how anxiety reducing that was.  Well, Microsoft eventually got my message.  (At least the one about Clippy.)  They put him to rest in 2001.

R.I.P. Clippy 1997-2001

Picard thought Clippy's happy attitude was often more annoying than helpful too.  While Clippy could be chipper, he couldn't give a frustrated user what he or she was looking for. . . a little sensitivity.   Picard imagines a world in which your computer can sense your emotions and tailor its interface to them.  A truly functional facial recognition software would allow computers to respond immediately and appropriately to your emotions and level of interest.  Picard and el Kaliouby began their research in hopes of changing the way computers will interact with humans in the future.   As they delved into the application of the technology they realized that what they had created could change the way humans interact with humans. . .  in the present.

Whether this research will result in a learning device and/or a workable mind reading machine similar to their Emotion Sensing Prosthesis (ESP) is unknown for the moment.  What is clear is that the early work with the students has led to genuine advancement in their research.

In time, we may no longer have to worry about our colleagues, friends, and even our computers not realizing that they are frustrating, scaring or just boring us.  Using their ESP. . . they'd already know.

Tags: Asperger's Syndrome, autism, behind the scenes, clippy

+ Add Comment