Swarming drones, self-driving vehicles, and the algorithms that light the way

 

Any driver knows the biggest problem on roads: other drivers. Each independently—and with highly variable skill—pilots a vehicle weighing an average of two tons at high speed in a complex environment that includes road conditions, weather, obstacles and the constant jockeying of other cars and trucks. Drivers ideally keep plenty of space between them to allow time reaction time in case of erratic or surprising developments.

The advent of self-driving cars may minimize some of the risks associated with driver inconsistency. Rather than battling a chaotic jumble of people ranging from sedate slowpokes to crazed speed demons, you may someday—perhaps sooner than you think—belong to what’s called a platoon of cars that travel in a self-regulating group. Each car would communicate with cars nearby so they’d be attuned to what others are doing and be able to maneuver optimally to reach a given destination in the most efficient amount of time possible.

“We envision a team of high-speed, driverless cars, safely distanced from one another, traveling from city to city,” says Nader Motee, associate professor of mechanical engineering and mechanics. “The most desirable feature for these networks is long-term autonomy. Yet this independence introduces the concepts of risk and fragility.”

Risk and fragility, in fact, are key areas of Motee’s work in design, control and optimization of distributed control and dynamical systems. “When we’re talking about the kinds of systems where you have a group of agents—self-driving cars, drones, power plants—aiming to work as a team to accomplish a task, we’re talking about networks,” Motee says. “These are highly dynamic systems where a small time delay or an incorrectly computed response to an external disturbance can lead to catastrophic consequences.”

Fragility refers to potential for the whole system to crash if individual agents or nodes are lost—for example, by colliding with each other. Motee and his students are gaining significant insights—both theoretical and practical—into ways to avoid systemic (and individual) crashes, protect against vulnerabilities and optimize a network’s ability to perform a task.

He and other Lehigh researchers are at the forefront of research into complex systems dealing with constantly changing variables—an area important to development of robotics, automation and machine learning. “There’s great interest in these areas at Lehigh,” says Subhrajit Bhattacharya, assistant professor of mechanical engineering and mechanics, who explores motion planning and control of autonomous, intelligent systems. “What’s happening here is very exciting.”

DISTRIBUTING CONTROL

Crucial to a system’s integrity, autonomy and efficiency is how it’s controlled. And distributing control across multiple agents can make a network more robust in responding to local failures. Take the example of drones, which can be flown in networked arrays—sometimes referred to as swarms—that have a variety of potential applications such as traffic reporting, surveillance and military missions.

Relying on a central control system such as a ground-based command center introduces potential vulnerabilities. “Each agent needs a communication channel with the base, which may be far from where the drones do their mission,” Motee says. “If for some reason there’s a failure at the base—power outage or hackers get into the central server—then all the drones are in trouble.” Fragility is high.

Distributing control among the agents shores up some of these weaknesses. “If drones don’t communicate to a central base but are just in touch with their neighbors and make decisions using local information, you can endure loss of one drone and still go on with the mission because the remaining drones continue to exchange information among each other,” Motee says. “The network is less fragile and uncertain events become more tolerable.”

FORESEEING UNCERTAINTY’S OUTCOMES

Yet vulnerabilities remain. Part of what can make systems fragile is what researchers call noise—variables from outside the system that can degrade performance or make agents fail, increasing the risk that remaining nodes will also fail in a domino-like cascade. A car platoon that hits a road obstacle might suffer a collision that becomes a pileup. A fleet of drones flying south to north that hits a strong east-west wind might get thrown off course.

Sensing and communication become important elements in overcoming noise—but too much communication between agents becomes its own vulnerability. “As agents talk more and establish more communication channels, noisy information circulates more and gets amplified across the network,” Motee says. So does the potential for intruders to hack the network and disrupt signals.

“You want to minimize the number of talking points across the network by dropping communication links but at the same time not lose performance,” Motee says. This process, known as sparsification, presents difficult mathematical problems related to identifying where a system is most likely to fail and which channels between which agents should be used. “We have come up with some tractable algorithms to solve this inherently difficult problem,” Motee says.

One approach is to use randomized algorithms. “We randomly pick a pair of agents and drop their communication channel, but in a way that allows performance of the network to remain the same,” Motee says. So while performance doesn’t drop, complexity does.

Motee and his students have also developed a computational framework based on systemic risk measures that can be applied to design a wide variety of networks. Systemic risk measures allow for constraints and uncertainties to be treated in terms of safety margins instead of exact requirements.

“Our methodology allows for all these seemingly different problems to be viewed in a rather unified manner,” Motee says. “Autonomy and fragility issues in self-driving cars are different from drone problems, which are different from smart-grid problems, but the mathematical challenges are similar. Using our framework, relevant features can be abstracted away from these domain-specific applications into dynamic models suitable for risk and fragility analysis.”

IN THE COLISEUM

Motee’s lab is now researching advanced control capabilities in a 4,000-square-foot Lehigh space known as the ‘Flying Machines Coliseum.’ It’s equipped with a high-precision motion capture system, a central server, a wireless communication network, and custom software that can monitor drones and provide information about their location in space along with dynamical measures such as the roll and pitch of each quad copter in a networked array.

One new initiative is to design drones that can fly and navigate on their own by learning from what they see―without the aid of GPS. “This is particularly useful in providing fast and reliable information for emergency or search and rescue operations, or even reconnaissance missions,” Motee says. “These drones can navigate through collapsed structures or even hazardous conditions with radiological, biological or chemical contamination.”

Motee’s team is developing a design methodology to optimize drone size, flight controller, and on-board sensors by integrating and co-designing control, navigation, and vision algorithms. “We blend tools from control theory, probabilistic modeling, computer vision, and embedded systems,” he says. “We aren’t as focused on the drones themselves or planning their motion as we are on understanding long-term autonomy for a wide range of dynamic network applications.”

Motee’s work is funded through grants associated with his Office of Naval Research Young Investigator Program in 2016 and receiving a National Science Foundation Engineering CAREER Award in 2015.

MAPPING MOTION

A self-driving car needs to know where it’s going from the start of its journey to the finish and the exact route to travel at every moment along the way. If the road curves, it needs to steer through the turn; if people are in the middle of a street, it needs to avoid them. “This is not only an engineering problem, it’s a mathematical problem,” Bhattacharya says. “Motion planning finds a sequence of action in the system's configuration space.”

A rudimentary way to compute the motion of a robot navigating on a plane is to construct a line between its start and goal points. But, for more complex systems, executing many forms of multidimensional motion that sound simple to the human mind quickly become difficult to describe in mathematical terms.

“Making a 10-segment robot arm move through space to grab the handle of a coffee mug while avoiding the bookcase beside the table requires a mathematically rigorous algorithm,” Bhattacharya says. In dynamic systems, motion complexity sometimes outstrips computational capacity to calculate it. “You have to find abstractions of these spaces that are computationally manageable,” Bhattacharya says.

One tool for constructing such abstractions is topology -- a branch of mathematics that analyses the characteristics of a configuration space and motions in it. A computational tool in topology is simplicial complexes, which, which build on traditional graph representations but add dimensionality. “Simplicial complexes offer much richer descriptions of configuration space,” Bhattacharya says. “The unifying idea is to create simpler spaces where it’s more feasible to do motion planning and come up with solutions that are optimally correct.”

Optimal motion planning has wide applications. Some of Bhattacharya’s work involves developing algorithms that determine how a pair of boats with a flexible boom or cable could navigate the ocean autonomously while avoiding collisions or entanglements with obstacles like buoys or other boats—potentially useful for automated oil-spill cleanup, where self-guided boats would collect and separate floating oil patches on the water’s surface. Bhattacharya has also developed motion-planning algorithms for guiding robots in hazardous search-and-rescue tasks and law enforcement operations.

Bhattacharya joined Lehigh in 2016 after serving as a postdoctoral researcher in mathematics at the University of Pennsylvania, publishing work in the International Journal of Robotics Research, Annals of Mathematics and Acta Applicandae Mathematicae. “We’re building an area that’s relatively new, and Lehigh is a very good place to try out new ideas,” Bhattacharya says.

Story by Richard Laliberte

Subhrajit Bhattacharya, assistant professor, mechanical engineering and mechanics, and his students develop algorithms that guide the motion of robots and other devices and vehicles.

Using our framework, relevant features can be abstracted away from these domain-specific applications into dynamic models suitable for risk and fragility analysis.
Nader Motee, Associate Professor, Mechanical Engineering and Mechanics

RELATED LINKS

Resolve Magazine (Vol. II, 2017): Small light, and fast
Researchers ultimately expect their discoveries to have practical applications. Joachim Grenestedt, professor of mechanical engineering and mechanics and director of Lehigh’s Composites Lab, is adept at bringing ideas to physical fruition.

 

Lehigh Engineering News Archive: "Motee earns Office of Naval Research Young Investigator award"
The associate professor of mechanical engineering and mechanics was recognized for his project, "Risk is New Robustness: A Systemic Perspective."

 

Lehigh Engineering News Archive: "Serious recognition from NSF"
Three of Lehigh’s outstanding young professors – Arindam Banerjee and Nader Motee of mechanical engineering and mechanics, and Bryan Berger of chemical and biomolecular engineering -- have received a significant boost to their research endeavors, courtesy of the National Science Foundation (NSF) CAREER Awards.