UTC Students’ Research Project Controls Drones Using Brainwaves

Monday, December 4, 2017 - by Shawn Ryan, UTC
In the SimCenter’s Unmanned Drone Lab, a mind-controlled drone hovers in mid-air.
In the SimCenter’s Unmanned Drone Lab, a mind-controlled drone hovers in mid-air.

Buzzing like a mammoth insect, the four-prop drone lifts off the ground, rising straight up. Once it reaches about four feet, it hovers for a bit, then slowly settles back to the ground. 

It doesn’t seem like much of a flight until you understand how it happened. 

No handheld controls, no tether, no nothing. 

Just brain waves. 

Tony Ferguson sits about 12 feet away at a laptop. As he works in what has been dubbed the Unmanned Systems Lab, on top of his head is a lattice of white plastic dotted with blue electrodes about the size of a thumb. The electrodes, which register brainwave activity, can be tightened to firmly hold the entire device in place. 

Unfortunately, at the skull-touching end, the electrodes have a circle of tiny points—little needles, basically—and they tend to dig into the flesh. Not enough to draw blood, but enough to make anyone wearing the headgear want to take it off as quickly as possible. 

“These things are pretty uncomfortable; they stick and they aren’t fun. About an hour is all I can take,” Mr. Ferguson says, several small, reddish circles indented in the skin of his forehead just short of the hairline. 

But the pain is worth it, he says, because his goal is to develop technology that will allow control all aspects of the drone simply through thought. Want it to move right? Think about it. Want it to take a photo with its camera? Imagine it. 

“Visualization in the brain would control the drone,” says Mr. Ferguson, an electrical engineering major. 

Future uses
Dr. Zach Ruble, a researcher in the Departments of Engineering and Electrical Engineering and director of the drone project, pictures a future in which one person can control multiple drones by thought. A separate research project that uses infrared light to control a swarm of drones—led by electrical engineering student Artem Malashiy—is taking place alongside the project on brain-wave control. 

“Ultimately, we want to detect patterns in the brainwaves such that we can give abstract commands to multiple drones,” Dr. Ruble says. “So instead of giving a basic command such as ‘take off’ or ‘land,’ we can send out an abstract command such as ‘search and rescue.’ 

“After receiving the command, the swarm of drones will determine what needs to be done in order to carry out that command and execute the mission autonomously.” 

A smaller, more comfortable headset should be possible as the technology develops, Mr. Ferguson says. 

“It could have military applications, search-and-rescue applications, etc. Obviously, prosthetics has a huge, huge application here,” says Mr. Ferguson, a former Marine who served spent time under fire in Iraq’s war-torn Fallujah. 

In the current setup, his brainwaves are fed into his laptop, which sends a Wi-Fi signal to a second computer that, in turn, sends a wireless signal to the drone. The second computer, manned by Ed Steele, a graduate student in electrical engineering, contains the software that actually controls the drone. Mr. Steele developed the software and, without his work, the project would not be possible, Mr. Ferguson says. 

“He did all the groundwork, all the legwork, to fly the drone,” he says.

Both spent several months just getting the drone to move up and down, and both say the work took longer than they wanted, but now they want more. Much more.

Following footsteps
Using brainwaves to control robotics limbs is nothing new, but those rely on implants in the brain that fire nerves and send electric impulses to microprocessors in the limbs. What Mr. Ferguson and other members of the project team have plans that are difficult to create but will ultimately make things easier. 

“I’m following in the footsteps of stuff that’s gone before, but the thought avenue is what I’m focusing on, to be able to control things just by thinking,” says Mr. Ferguson, who adds that, until he joined the drone project in January, “had no idea” that this type of technology was even available much less usable. 

He’s in the process of creating a wide “vocabulary” for drone control and says he hopes to have that done by the end of December. Creating a wider command list is another step to increase the drone’s capabilities, Dr. Ruble says. 

“For example, if we can detect a pattern in the EEG signals that differentiates a person moving his left arm versus moving his right arm, we can generate two different commands based off which arm the person is moving.” 

Mr. Ferguson says he’s “trying to get gesture control, the brainwave response for this”— he moves his right arm up and down—“to fly the drone left or right, I will move on to purely thought,” he explains. 

“I’ve done it a little bit; it’s kind of hard to do.”




Chattanooga State Hosts "Why Solar" Event May 4

The resurgence of interest in solar energy is one reason that the Solar Energy Technology program at Chattanooga State Community College is experiencing growth. To meet the expected increase of future solar energy engineers, Chattanooga State is hosting an opportunity called “Why Solar” on Friday, May 4, beginning at 3 p.m.in the Center for Engineering, Technology, Arts and Sciences ... (click for more)

CHS Senior Named U.S. Presidential Scholars Semifinalist

Cleveland High School senior Brian Byerly has been named one of 630 semifinalists in the 2018 U.S. Presidential Scholars Program. Semifinalists were selected from nearly 5,300 candidates from high schools across the United States. Scholars are selected on the basis of superior academic and artistic achievements, leadership qualities, strong character and involvement in community ... (click for more)

McCallie Coach From 90s Who Is Now Deceased Is Accused Of Abusing Students

A McCallie School coach from the 1990s who is now deceased is being accused of abusing students at the private prep school. Two former students said Steven Lee "Steve" Carpenter sexually abused them. Carpenter was the basketball coach at McCallie for 11 seasons - through 1999. He was boys basketball coach at Ridgeland High School beginning in 2000. Carpenter was ... (click for more)

County Commission Committee Recommends 2-Year Terms For Magistrates; To Advertise For 2 Openings After Pay Raise

A committee of the County Commission has recommended that county magistrates have two-year terms, instead of one year, and for the commission to take applications on two open seats. The commission will proceed with advertising for the two posts and make an official announcement next Wednesday. Applications will then be taken until May 8. The commission will interview candidates ... (click for more)

Pluses And Minuses Of Tennessee's New Opioid Law

It was clear when Governor Haslam announced his TN Together plan in January that lawmakers were going to do something to try to address the state’s opioid abuse epidemic. With the passage of SB 2257/HB 1831, Tennessee now has one of the most comprehensive and restrictive laws of any state.   The Tennessee Medical Association was actively engaged in the process and appreciates ... (click for more)

Roy Exum: ‘We’ll Lose The Senate!’

A guy who I admire and respect wrote me yesterday. He had just read my story defending Bob Corker for honoring “The Code” due to his true friendship with Phil Bredesen. He is also no stranger to my vivid dislike of the Republican choice to replace Corker in the Senate. Marsha Blackburn is no match against Bredesen on any tier and it is clearly the Republican Party itself that has ... (click for more)