Experts are taking design tips from nature – attempting to recreate the extraordinary vision of insects.

The visual processing skills of the dragonfly are the envy not only of the animal kingdom, but the human one as well.

They can remain in the air under very tight control waiting for potential mates, prey or predators. Using their nearly 360-degree eyesight they can discern targets against cluttered backgrounds and then take the appropriate action.

Dr Russell Brinkworth, a neuroscientist, mechatronic engineer and roboticist, and Professor Anthony Finn, an expert on sensor processing and autonomous systems, are using insect brains as inspiration for vision systems in computers.

For six years, Dr Brinkworth has painstakingly measured and modelled the neurology of the early vision system of the hoverfly and dragonfly.

Over the past eight years, he, Prof Finn, and a growing team of scientists at the University of South Australia have replicated the visual functionality of these insects and are using them as a basis to improve detection systems in cameras.

Their bio-inspired research has a range of applications, from developing bionic eyes to improving the navigation systems of driverless cars, spotting drones in complicated environments, scanning forests to capture detailed information about individual trees, improving facial recognition techniques, and even monitoring wildlife in densely camouflaged areas.

By replicating the dragonfly’s visual algorithms in a computer model, the researchers are building sensor systems that can find objects in scenes that are very bright or very dark, have either high or low contrasts, and are in complex and obscure landscapes – something that computers currently fail to do well.

“The reason there have been some fatal accidents involving driverless cars is because more progress needs to be made in the visual processing field. Current camera systems struggle with differentiating between light and dark and different objects. Our research is helping to address this,” Dr Brinkworth says.

“Biologically, the human eye structure bears little comparison to insect eyes and the two species perceive things very differently. However, the way that insects process visual information is remarkably like humans.

“We take the algorithms that insects use, and we modify them to suit our purposes, whether it’s to improve security camera footage or to improve facial recognition.”

The same biologically-inspired algorithms can also be applied to sound, making it easier to listen for objects in noisy environments.

This means that small, quiet, slow-moving targets, such as drones, can be tracked based on both their visual and acoustic signatures.

Using their image processing skills and sensing expertise, Prof Finn and Dr Brinkworth are also leading project to help combat the growing global threat posed by IED-carrying drones.

Improvised explosive devices are among the deadliest weapons in modern warfare, killing or injuring more than 3,000 soldiers in Afghanistan in 2017.

This weaponisation of drones by terror groups has led to the Defence Science and Technology (DST) Group inviting researchers and experts from industry and academia to come up with technological solutions.

Prof Finn and Dr Brinkworth’s project has secured funding from the $730 million Next Generation Technologies Fund.

Using the algorithm inspired by insect neurology and physiology, their research team has developed electro-optic, infra-red and acoustic sensor technologies which can detect remotely- piloted aircraft at impressive distances.

“What we have done is to transition the model of the hoverfly beyond the biology and simulation and put it on to embedded computers,” Prof Finn says.

“These are small, portable systems that allow us to process images and data at around 100 frames a second, identifying targets in very complex settings in real time, even when they occupy less than one image pixel or are practically inaudible.

“If somebody wants to stop a major airport from operating, all they have to do is fly a small drone in the vicinity. We saw this in December 2018 when hundreds of flights were cancelled at Gatwick Airport near London following drone sightings close to one of the runways.”

Prof Finn and Dr Brinkworth have been able to significantly extend the range at which drones can be detected while simultaneously “massively reducing” the false alarm rates in cluttered environments.

The drone detection project is expected to be completed by the end of 2020.