conuly: (Default)
conuly ([personal profile] conuly) wrote2005-01-29 08:39 pm

Stolen from [profile] prezzey

An article about a blind painter (and the implications of this.)


Senses special: The art of seeing without sight

* 29 January 2005
* From New Scientist Print Edition. Subscribe and get 4 free issues.
* Alison Motluk

IT IS an odd sight. A middle-aged man, fully reclined, drawing pictures of hammers and mugs and animal figurines on a special clipboard, which is balanced precariously on a pillow atop his ample stomach.

A half-dozen people buzz around him. One adjusts a towel under his neck to make him more comfortable, another wields a stopwatch and chants instructions to start doing this or stop doing that, and yet another translates everything into Turkish. A small group convenes in a corner to assess the proceedings. A few of us just stand around watching, and trying not to get in the way. The elaborate ritual is a practice run for an upcoming brain scan and the researchers want to get everything just right. Meanwhile, the man at the centre of all this attention, a blind painter, cracks jokes that keep everyone tittering.

The painter is Esref Armagan. And he is here in Boston to see if a peek inside his brain can explain how a man who has never seen can paint pictures that the sighted easily recognise - and even admire. He paints houses and mountains and lakes and faces and butterflies, but he's never seen any of these things. He depicts colour, shadow and perspective, but it is not clear how he could have witnessed these things either. How does he do it?

Because if Armagan can represent images in the same way a sighted person can, it raises big questions not only about how our brains construct mental images, but also about the role those images play in seeing. Do we build up mental images using just our eyes or do other senses contribute too? How much can congenitally blind people really understand about space and the layout of objects within it? How much "seeing" does a blind person actually do?

Armagan was born 51 years ago in one of Istanbul's poorer neighbourhoods. One of his eyes failed to develop beyond a rudimentary bud, the other is stunted and scarred. It is impossible to know if he had some vision as an infant, but he certainly never saw normally and his brain detects no light now. Few of the children in his neighbourhood were formally educated, and like them, he spent his early years playing in the streets. But Armagan's blindness isolated him, and to pass the time, he turned to drawing. At first he just scratched in the dirt. But by age 6 he was using pencil and paper. At 18 he started painting with his fingers, first on paper, then on canvas with oils. At age 42 he discovered fast-drying acrylics.

His paintings are disarmingly realistic. And his skills are formidable. "I have tested blind people for decades," says John Kennedy, a psychologist at the University of Toronto, "and I have never seen a performance like his." Kennedy's first opportunity to meet and test Armagan in person was during a visit to New York last May, for a forum organised by a group called Art Education for the Blind. Armagan, who is something of a celebrity in Turkey, has become used to touring with his canvases to the Czech Republic, China, Italy and the Netherlands. What made this visit different was the interest shown by scientists - both Kennedy and a team from Boston.

Kennedy put Armagan through a battery of tests. For instance, he presented him with solid objects that he could feel - a cube, a cone and a ball all in a row (dubbed the "three mountains task") - and asked him to draw them. He then asked him to draw them as though he was perched elsewhere at the table, across from himself, then to his right and left and hovering overhead. Kennedy asked him to draw two rows of glasses, stretching off into the distance. Representing this kind of perspective is tough even for a sighted person. And when he asked him to draw a cube, and then to rotate it to the left, and then further to the left, Armagan drew a scene with all three cubes. Astonishingly, he drew it in three-point perspective - showing a perfect grasp of how horizontal and vertical lines converge at imaginary points in the distance. "My breath was taken away," Kennedy says.

Kennedy has spent much of his career exploring art from the perspective of blind people. He has shown that people who are congenitally blind understand outline drawings when they feel them just as seeing people do. They understand and can draw in three dimensions. In fact, blind children develop the ability to draw, he has found, much as sighted children do - but all too few blind children ever get the opportunity to explore this ability. Even knowledge about perspective, he has come to believe, is acquired in similar ways for both. "Where a sighted person looks out, a blind person reaches out, and they will discover the same things," says Kennedy. "The geometry of direction is common to vision and touch."
Lines and one-liners

It is the night before the Boston team's first brain scan. Armagan is sitting at a long table at an inn, entertaining everyone with one-liners, trying to explain how he does his artwork. Alvaro Pascual-Leone, the Harvard neurologist who invited him here, and Amir Amedi, his colleague, are challenging him with more and more complex tasks. Draw a road leading away, says Pascual-Leone, with poles on either side and with a source of light underneath. Armagan smiles confidently.

He uses a special rubberised tablet, called a "Sewell raised line drawing kit". This device allows him to draw lines that rise off his paper as tiny puckers, so that he can detect them with his fingertips. And so he draws the road and the poles: one hand holding the pencil, the other tracing along behind, like surrogate eyes, "observing" the image as it is being laid down. A minute or so later, the picture is done. Pascual-Leone and Amedi shake their heads in wonder.

So, we ask, how do you know how long these poles should be as they recede? I was taught, he says. Not by any formal teacher, but by casual comments by friends and acquaintances. How do you know about shadows? He learned that too. He confides that for a long time he figured that if an object was red, its shadow would be red too. "But I was told it wasn't," he says. But how do you know about red? He knows that there's an important visual quality to seen objects called "colour" and that it varies from object to object. He's memorised what has what colour and even which ones clash.
Scanning the mind's eye

Next day, and the time has come for Armagan to get into the scanner. The Harvard scientists are collaborating with scanning experts at Boston University. In addition to taking a structural snapshot of Armagan's brain and establishing if it can perceive any light (they confirmed it cannot), this morning's experiment will have him doing some odd sequences of tasks. He'll have a set number of seconds to feel an object, imagine it and draw it. But he has also been asked to scribble, pretend to feel an object and recall a list of objects that he learned days earlier.

Pascual-Leone and Amedi want to see what Armagan's brain can tell them about neural plasticity. Both scientists have evidence that in the absence of vision, the "visual" cortex - the part of the brain that makes sense of the information coming from our eyes - does not lie idle. Pascual-Leone has found that proficient Braille readers recruit this area for touch. Amedi, along with Ehud Zohary at the Hebrew University in Jerusalem, found that the area is also activated in verbal memory tasks.

When Amedi analysed the results, however, he found that Armagan's visual cortex lit up during the drawing task, but hardly at all for the verbal recall. Amedi was startled by this. "To get such extraordinary plasticity for [drawing] and zero for verbal memory and language - it was such a strong result," he says. He suspects that, to a certain extent, how the unused visual areas are deployed depends on who you are and what you need from your brain.

Even more intriguing was the way in which drawing activated Armagan's visual cortex. It is now well established that when sighted people try to imagine things - faces, scenes, colours, items they've just looked at - they engage the same parts of their visual cortex that they use to see, only to a much lesser degree. Creating these mental images is a lot like seeing, only less powerful. When Armagan imagined items he had touched, parts of his visual cortex, too, were mildly activated. But when he drew, his visual cortex lit up as though he was seeing. In fact, says Pascual-Leone, a naive viewer of his scan might assume Armagan really could see.

That result cracks open another big nut: what is "seeing" exactly? Even without the ability to detect light, Armagan is coming incredibly close to it, admits Pascual-Leone. We can't know what is actually being generated in his brain. "But whatever that thing in his mind is, he is able to transfer it to paper so that I unequivocally know it's the same object he just felt," says Pascual-Leone.

In his own life, too, Armagan seems to have a remarkable grasp of space. He seldom gets lost, says his manager Joan Eroncel. He has an uncanny sense of a room's dimensions. He once drew the layout of an apartment he had only visited briefly, she says, and remembered it perfectly nine years later.

We normally think of seeing as the taking in of objective reality through our eyes. But is it? How much of what we think of as seeing really comes from without, and how much from within? The visual cortex may have a much more important role than we realise in creating expectations for what we are about to see, says Pascual-Leone. "Seeing is only possible when you know what you're going to see," he says. Perhaps in Armagan the expectation part is operational, but there is simply no data coming in visually.

Conventional wisdom suggests that a person can't have a "mind's eye" without ever having had vision. But Pascual-Leone thinks Armagan must have one. The researcher has long argued that you could arrive at the same mental picture via different senses. In fact he thinks we all do this all the time, integrating all the sensations of an object into our mental picture of it. "When we see a cup," he says, "we're also feeling with our mind's hand. Seeing is as much touching as it is seeing." But because vision is so overwhelming, we are unaware of that, he says. But in Armagan, significantly, that is not the case.

I sit across from the source of all this mystery and I ask him about the birds he loves to paint. They are brightly coloured and exotic and I wonder aloud how he knows how to depict them. He tells me about how he used to own a parakeet shop. "They come to your hand," he says. "You can easily touch them." He pauses and smiles and says: "I love being surrounded by beauty."
rachelkachel: (Default)

[personal profile] rachelkachel 2005-01-29 05:47 pm (UTC)(link)
That's fascinating.

[identity profile] wakasplat.livejournal.com 2005-01-29 06:04 pm (UTC)(link)
I've often thought of the way I think as how a blind person sees in their mind — in my case not visual but extremely spatial. Which is why I'm not all that surprised by this.
adiva_calandia: (Default)

[personal profile] adiva_calandia 2005-01-29 06:34 pm (UTC)(link)
That is extraordinarily cool.

There was an interesting article in a New Yorker a few years back about blindness -- I don't remember many of the details -- but it was talking about one man who went blind relatively late in life. He lost much of his visual sense. He could no longer imagine the shape of the number 3, for example, unless he traced it with his hand.

Now I really want to see some of this man's paintings. I wonder if he's ever done portraits. . . .

[identity profile] leora.livejournal.com 2005-01-29 07:11 pm (UTC)(link)
I'm legally blind but almost as sighted as you can be while still being legally blind. 20/200 in the left eye. Not much depth perception though, as the right eye is far worse. Went blind in my 20s. I've noticed since then that the visual quality of my dreams has decreased. Plus, sometimes in dreams I specifically xan't see things because of my vision problems; they're too far away now, too blurry. That could be adapting psychologically, but even when the dreams include no blindness-anxiety, they seem to be adapting to my new lessened vision.

I also am forgetting what it was like to see far better than I can. Vision seems to be a particularly tricky thing. It seems like unless you have active anomalies like floaters, you adjust to whatever vision you have so it feels totally normal. It feels like the amount of vision any person would have. It feels natural. I think this is part of why so many people I know vividly remember their first pair of glasses. But likewise, you adjust too smoothly. I think this is why driver's don't always realize when their visual abilities have become too poor. There's something in the brain that just goes - this is the way it is, don't even realize it's a big thing.

Sudden changes are always noticeable, but slow ones, I fear, are frighteningly easy to miss.

But basically, my point is that I'm not surprised that a sighted person gone blind could forget vision.
adiva_calandia: (Default)

[personal profile] adiva_calandia 2005-01-29 08:05 pm (UTC)(link)
Neither am I. It just really stuck with me, that the only way he could remember visual things was by physicalizing them.

You mention that the visual quality of your dreams has decreased. Can you describe how you experience dreams now? Or is it something a sighted person can't understand?

[identity profile] leora.livejournal.com 2005-01-29 08:40 pm (UTC)(link)
This is almost too simple to explain. It'd help if you wear glasses. It's just all poorer quality. I can't see something clearly unless I am closer. Like, I can see a sign and make out there are words on it, but not read what the words are. Just like used to be the case, but now the sign can be closer for me to still be unable to read it. And this carries over into dreams. It'd be like dreams where you're not wearing your glasses and the world looked that way.

The dreams are visual still (most of them, I've had rare non-visual dreams before I ever had serious vision problems). I just can't see the dream stuff as well, and there's no reason for that, other than my brain adjusting to this as the normal level of vision.

As to the peripheral vision, it seems most people don't know it's black and white. It's just one of those facts I learned really early and take for granted. My father was a doctor and I studied psychology from a fairly young age, and I just knew cones control central vision and are color vision. The peripheral vision is created by the rods, which have no color perception, but they have better night vision.

You can prove it to yourself, or try, if you can keep your head still and try really hard to not move your eyes. Then you bring objects toward your head from behind slowly, to just where you can tell they are there. But it's really hard, and usually you'll need assistance, because the impulse to move your head and eyes toward what you want to look at is so strong. I've never really pulled it off, which is why I leaped on the ability to do it when the central vision was gone and all I had to do was close the left eye and then I couldn't cheat.

It's still hard to try to look at something without turning the central vision to it, which works even more poorly when you have no central vision. :) I didn't have total central vision loss long enough to see if those impulses would change.
adiva_calandia: (Default)

[personal profile] adiva_calandia 2005-01-29 10:38 pm (UTC)(link)
I do wear glasses, actually -- I'm not sure what my sight is without them, but I know it's a heckuva lot worse than most people my age. I don't think I've ever had dreams where I'm not wearing my glasses, but I can visualize it. Thanks! This is all really interesting.

[identity profile] leora.livejournal.com 2005-01-29 07:17 pm (UTC)(link)
Oh, on kind of arelated note... when full vision isn't lost, part of the problem is that what you see is only partly related to what you see. I know I see more than I can, because my brain will happily fill in its best guess without telling me. It does this for everyone, but it's something I've had to deal with far more, because when its best guess is wrong, I may be the one getting hurt.

This seems to be a part of why even though peripheral vision has no color reception, people see things in color in the periphery. I got to test this to a fuller extent than most when my right retina detached, neatly leaving me with no central vision and only peripheral vision. I was disturbed by seeing color, as I knew that there should only be rods active. So, I tested myself on an object whose color I wasn't sure of - a soda can of unknown type. It looked red. But nope, it was green. I had been best-guessing it was coke, but it was mountain dew. After I had convinced myself that I actually couldn't see color, I started to see things more in black and white. Very, very weird.

Alas, I can't run any more tests of that nature as I had my retina reattached. But quite fascinating and worth doing if you ever lose a retina anyway.
adiva_calandia: (Default)

[personal profile] adiva_calandia 2005-01-29 08:13 pm (UTC)(link)
I had no idea peripheral was in black and white! I'm trying to test that now, and you're right -- my brain refuses to acknowledge any lack of color. Huh. You learn something new every day. :)

[identity profile] lakidaa.livejournal.com 2005-01-30 11:35 am (UTC)(link)
part of me is still shriekging from when I read about retinas being detached, but that IS a neat fact.

neet.

[identity profile] leora.livejournal.com 2005-01-30 12:31 pm (UTC)(link)
The funny thing is, retinal detachments don't usually cause much vision loss, if you get medical care on time. If you follow the following rules, it will probably never be a problem for you even if it happens:

Any sudden injury that leads to vision issues, get checked ASAP.
If you start seeing flashing lights, weird floating blind spots, or floaters that you don't recognize, get an eye exam.

The eye exam in both cases must include pupil dilation.

Do that, and in almost all cases, you'll be fine. Put it off for a few months because you think you're just having more migraines than usual or there's something funky about your new computer monitor, and it doesn't work out as well.

This message brought to you by the well, I hope others don't make the same stupid mistake I made department.

[identity profile] lakidaa.livejournal.com 2005-01-30 12:57 pm (UTC)(link)
see, I don't have any of those at all, and my eyes are too important to me to not freak out. Them, and me ears. need those.

[identity profile] beetlebomb.livejournal.com 2005-01-30 03:05 am (UTC)(link)
Fascinating! But I wish the article actually SHOWED a PICTURE or two of his work!!!

[identity profile] bridgetester.livejournal.com 2005-01-30 09:48 am (UTC)(link)
http://images.google.com/images?q=%22Esref%20Armagan%22

Also, for pages about him and even more pictures...
http://www.google.com/search?q=%22Esref+Armagan%22

[identity profile] bridgetester.livejournal.com 2005-01-30 09:44 am (UTC)(link)
Yeah, I was going to pull that article; it's linked from Wired. I'll see whether I can dig up some of the other articles from that series in databases.
rachelkachel: (Default)

[personal profile] rachelkachel 2005-01-29 05:47 pm (UTC)(link)
That's fascinating.

[identity profile] wakasplat.livejournal.com 2005-01-29 06:04 pm (UTC)(link)
I've often thought of the way I think as how a blind person sees in their mind — in my case not visual but extremely spatial. Which is why I'm not all that surprised by this.
adiva_calandia: (Default)

[personal profile] adiva_calandia 2005-01-29 06:34 pm (UTC)(link)
That is extraordinarily cool.

There was an interesting article in a New Yorker a few years back about blindness -- I don't remember many of the details -- but it was talking about one man who went blind relatively late in life. He lost much of his visual sense. He could no longer imagine the shape of the number 3, for example, unless he traced it with his hand.

Now I really want to see some of this man's paintings. I wonder if he's ever done portraits. . . .

[identity profile] leora.livejournal.com 2005-01-29 07:11 pm (UTC)(link)
I'm legally blind but almost as sighted as you can be while still being legally blind. 20/200 in the left eye. Not much depth perception though, as the right eye is far worse. Went blind in my 20s. I've noticed since then that the visual quality of my dreams has decreased. Plus, sometimes in dreams I specifically xan't see things because of my vision problems; they're too far away now, too blurry. That could be adapting psychologically, but even when the dreams include no blindness-anxiety, they seem to be adapting to my new lessened vision.

I also am forgetting what it was like to see far better than I can. Vision seems to be a particularly tricky thing. It seems like unless you have active anomalies like floaters, you adjust to whatever vision you have so it feels totally normal. It feels like the amount of vision any person would have. It feels natural. I think this is part of why so many people I know vividly remember their first pair of glasses. But likewise, you adjust too smoothly. I think this is why driver's don't always realize when their visual abilities have become too poor. There's something in the brain that just goes - this is the way it is, don't even realize it's a big thing.

Sudden changes are always noticeable, but slow ones, I fear, are frighteningly easy to miss.

But basically, my point is that I'm not surprised that a sighted person gone blind could forget vision.
adiva_calandia: (Default)

[personal profile] adiva_calandia 2005-01-29 08:05 pm (UTC)(link)
Neither am I. It just really stuck with me, that the only way he could remember visual things was by physicalizing them.

You mention that the visual quality of your dreams has decreased. Can you describe how you experience dreams now? Or is it something a sighted person can't understand?

[identity profile] leora.livejournal.com 2005-01-29 08:40 pm (UTC)(link)
This is almost too simple to explain. It'd help if you wear glasses. It's just all poorer quality. I can't see something clearly unless I am closer. Like, I can see a sign and make out there are words on it, but not read what the words are. Just like used to be the case, but now the sign can be closer for me to still be unable to read it. And this carries over into dreams. It'd be like dreams where you're not wearing your glasses and the world looked that way.

The dreams are visual still (most of them, I've had rare non-visual dreams before I ever had serious vision problems). I just can't see the dream stuff as well, and there's no reason for that, other than my brain adjusting to this as the normal level of vision.

As to the peripheral vision, it seems most people don't know it's black and white. It's just one of those facts I learned really early and take for granted. My father was a doctor and I studied psychology from a fairly young age, and I just knew cones control central vision and are color vision. The peripheral vision is created by the rods, which have no color perception, but they have better night vision.

You can prove it to yourself, or try, if you can keep your head still and try really hard to not move your eyes. Then you bring objects toward your head from behind slowly, to just where you can tell they are there. But it's really hard, and usually you'll need assistance, because the impulse to move your head and eyes toward what you want to look at is so strong. I've never really pulled it off, which is why I leaped on the ability to do it when the central vision was gone and all I had to do was close the left eye and then I couldn't cheat.

It's still hard to try to look at something without turning the central vision to it, which works even more poorly when you have no central vision. :) I didn't have total central vision loss long enough to see if those impulses would change.
adiva_calandia: (Default)

[personal profile] adiva_calandia 2005-01-29 10:38 pm (UTC)(link)
I do wear glasses, actually -- I'm not sure what my sight is without them, but I know it's a heckuva lot worse than most people my age. I don't think I've ever had dreams where I'm not wearing my glasses, but I can visualize it. Thanks! This is all really interesting.

[identity profile] leora.livejournal.com 2005-01-29 07:17 pm (UTC)(link)
Oh, on kind of arelated note... when full vision isn't lost, part of the problem is that what you see is only partly related to what you see. I know I see more than I can, because my brain will happily fill in its best guess without telling me. It does this for everyone, but it's something I've had to deal with far more, because when its best guess is wrong, I may be the one getting hurt.

This seems to be a part of why even though peripheral vision has no color reception, people see things in color in the periphery. I got to test this to a fuller extent than most when my right retina detached, neatly leaving me with no central vision and only peripheral vision. I was disturbed by seeing color, as I knew that there should only be rods active. So, I tested myself on an object whose color I wasn't sure of - a soda can of unknown type. It looked red. But nope, it was green. I had been best-guessing it was coke, but it was mountain dew. After I had convinced myself that I actually couldn't see color, I started to see things more in black and white. Very, very weird.

Alas, I can't run any more tests of that nature as I had my retina reattached. But quite fascinating and worth doing if you ever lose a retina anyway.
adiva_calandia: (Default)

[personal profile] adiva_calandia 2005-01-29 08:13 pm (UTC)(link)
I had no idea peripheral was in black and white! I'm trying to test that now, and you're right -- my brain refuses to acknowledge any lack of color. Huh. You learn something new every day. :)

[identity profile] lakidaa.livejournal.com 2005-01-30 11:35 am (UTC)(link)
part of me is still shriekging from when I read about retinas being detached, but that IS a neat fact.

neet.

[identity profile] leora.livejournal.com 2005-01-30 12:31 pm (UTC)(link)
The funny thing is, retinal detachments don't usually cause much vision loss, if you get medical care on time. If you follow the following rules, it will probably never be a problem for you even if it happens:

Any sudden injury that leads to vision issues, get checked ASAP.
If you start seeing flashing lights, weird floating blind spots, or floaters that you don't recognize, get an eye exam.

The eye exam in both cases must include pupil dilation.

Do that, and in almost all cases, you'll be fine. Put it off for a few months because you think you're just having more migraines than usual or there's something funky about your new computer monitor, and it doesn't work out as well.

This message brought to you by the well, I hope others don't make the same stupid mistake I made department.

[identity profile] lakidaa.livejournal.com 2005-01-30 12:57 pm (UTC)(link)
see, I don't have any of those at all, and my eyes are too important to me to not freak out. Them, and me ears. need those.

[identity profile] beetlebomb.livejournal.com 2005-01-30 03:05 am (UTC)(link)
Fascinating! But I wish the article actually SHOWED a PICTURE or two of his work!!!

[identity profile] bridgetester.livejournal.com 2005-01-30 09:48 am (UTC)(link)
http://images.google.com/images?q=%22Esref%20Armagan%22

Also, for pages about him and even more pictures...
http://www.google.com/search?q=%22Esref+Armagan%22

[identity profile] bridgetester.livejournal.com 2005-01-30 09:44 am (UTC)(link)
Yeah, I was going to pull that article; it's linked from Wired. I'll see whether I can dig up some of the other articles from that series in databases.