Robots, video games create radical new approach to treating stroke survivors

The first part of The New Yorker article:

In late October, when the Apple TV was relaunched, Bandit’s Shark Showdown was among the first apps designed for the platform. The game stars a young dolphin with anime-huge eyes, who battles hammerhead sharks with bolts of ruby light. There is a thrilling realism to the undulance of the sea: each movement a player makes in its midnight-blue canyons unleashes a web of fluming consequences. Bandit’s tail is whiplash-fast, and the sharks’ shadows glide smoothly over rocks. Every shark, fish, and dolphin is rigged with an invisible skeleton, their cartoonish looks belied by the programming that drives them—coding deeply informed by the neurobiology of action. The game’s design seems suspiciously sophisticated when compared with that of apps like Candy Crush Soda Saga and Dude Perfect 2.

Bandit’s Shark Showdown’s creators, Omar Ahmad, Kat McNally, and Promit Roy, work for the Johns Hopkins School of Medicine, and made the game in conjunction with a neuroscientist and neurologist, John Krakauer, who is trying to radically change the way we approach stroke rehabilitation. Ahmad told me that their group has two ambitions: to create a successful commercial game and to build “artistic technologies to help heal John’s patients.” A sister version of the game is currently being played by stroke patients with impaired arms. Using a robotic sling, patients learn to sync the movements of their arms to the leaping, diving dolphin; that motoric empathy, Krakauer hopes, will keep patients engaged in the immersive world of the game for hours, contracting their real muscles to move the virtual dolphin.

Many scientists co-opt existing technologies, like the Nintendo Wii or the Microsoft Kinect, for research purposes. But the dolphin simulation was built in-house at Johns Hopkins, and has lived simultaneously in the commercial and the medical worlds since its inception. “We depend on user feedback to improve the game for John’s stroke patients,” Ahmad said. “This can’t work without an iterative loop between the market and the hospital.”

In December, 2010, Krakauer arrived at Johns Hopkins. His space, a few doors from the Moore Clinic, an early leader in the treatment ofAIDS, had been set up in the traditional way—a wet lab, with sinks and ventilation hoods. The research done in neurology departments is, typically, benchwork: “test tubes, cells, and mice,” as one scientist described it. But Krakauer, who studies the brain mechanisms that control our arm movements, uses human subjects. “You can learn a lot about the brain without imaging it, lesioning it, or recording it,” Krakauer told me. His simple, non-invasive experiments are designed to produce new insights into how the brain learns to control the body. “We think of behavior as being the fundamental unit of study, not the brain’s circuitry. You need to study the former very carefully so that you can even begin to interpret the latter.”

Krakauer wanted to expand the scope of the lab, arguing that the study of the brain should be done in collaboration with people rarely found on a medical campus: “Pixar-grade” designers, engineers, computer programmers, and artists. Shortly after Krakauer arrived, he founded the Brain, Learning, Animation, Movement lab, or BLAM! That provocative acronym is true to the spirit of the lab, whose goal is to break down boundaries between the “ordinarily siloed worlds of art, science, and industry,” Krakauer told me. He believes in “propinquity,” the ricochet of bright minds in a constrained space. He wanted to create a kind of “neuro Bell Labs,” where different kinds of experts would unite around a shared interest in movement. Bell Labs is arguably the most successful research laboratory of all time; it has produced eight Nobel Prizes, and inventions ranging from radio astronomy to Unix and the laser. Like Bell, BLAM! would pioneer both biomedical technologies and commercial products. By developing a “self-philanthropizing ecosystem,” Krakauer believed, his lab could gain some degree of autonomy from traditionally conservative funding structures, like the National Institutes of Health.

The first problem that BLAM! has addressed as a team is stroke rehabilitation. Eight hundred thousand people in the U.S. have strokes each year; it is the No. 1 cause of long-term disability. Most cases result from clots that stop blood from flowing to part of the brain, causing tissue to die. “Picture someone standing on a hose, and the patch of grass it watered dying almost immediately,” Steve Zeiler, a neurologist and a colleague of Krakauer’s, told me. Survivors generally suffer from hemiparesis, weakness on one side of the body. We are getting better at keeping people alive, but this means that millions of Americans are now living for years in what’s called “the chronic state” of stroke: their recovery has plateaued, their insurance has often stopped covering therapy, and they are left with a moderate to severe disability.

 In 2010, Krakauer received a grant from the James S. McDonnell Foundation to conduct a series of studies exploring how patients recover in the first year after a stroke. He was already well established in the worlds of motor-control and stroke research. He had discovered that a patient’s recovery was closely linked to the degree of initial impairment, a “proportional recovery rule” that had a frightening implication: if you could use early measures of impairment to make accurate predictions about a patient’s recovery three months later, what did that say about conventional physical therapy? “It doesn’t reverse the impairment,” Krakauer said.