Video Scenes Pulled from Peoples' Thoughts
Pulling an image out of a person's brain is a feat that is hard to believe, but Dr. Jack Gallant of the UCB psychology department seems to have gone this accomplishment one better. In a recent experiment, Dr. Gallant claims to have made it possible to reproduce video images from human brain activity. Would you post your thoughts on Youtube?
Although this research has not yet been peer reviewed, Dr. Gallant and his colleague Shinji Nishimoto have used fMRI to scan the brains of two patients as they watched videos. According to the Times Online:
"A computer program was used to search for links between the configuration of shapes, colors and movements in the videos, and patterns of activity in the patients’ visual cortex.
"It was later fed more than 200 days’ worth of YouTube internet clips and asked to predict which areas of the brain the clips would stimulate if people were watching them.
"Finally, the software was used to monitor the two patients’ brains as they watched a new film and to reproduce what they were seeing based on their neural activity alone.
"Remarkably, the computer program was able to display continuous footage of the films they were watching — albeit with blurred images."
For example, in one scene which featured Steve Martin wearing a white shirt, the software recreated his shape and torso but missed other details, like his facial features.
