Summary: Researchers developed a single-chip device that mimics the human eye’s capacity to capture, process, and store visual data.
This groundbreaking innovation, fueled by a thin layer of doped indium oxide, could be a significant leap towards applications like self-driving cars that require quick, complex decision-making abilities. Unlike traditional systems that need external, energy-intensive computation, this device encapsulates sensing, information processing, and memory retention in one compact unit.
As a result, it enables real-time decision-making without being hampered by processing extraneous data or being delayed by transferring information to separate processors.
The neuromorphic device uses a single layer of doped indium oxide, which is thousands of times thinner than a human hair, to mimic the human eye’s ability to capture, process, and store visual information.
The device can retain information for more extended periods without the need for frequent electric signals to refresh the memory, significantly reducing energy consumption and improving performance.
The scientists behind the device envisage a wide range of applications, from self-driving cars to bionic vision and advanced forensics. Future work includes extending the technology for visible and infrared light detection.
Source: RMIT University
Researchers have created a small device that ‘sees’ and creates memories in a similar way to humans, in a promising step towards one day having applications that can make rapid, complex decisions such as in self-driving cars.
The neuromorphic invention is a single chip enabled by a sensing element, doped indium oxide, that’s thousands of times thinner than a human hair and requires no external parts to operate.
RMIT University engineers in Australia led the work, with contributions from researchers at Deakin University and the University of Melbourne.
The team’s research demonstrates a working device that captures, processes and stores visual information. With precise engineering of the doped indium oxide, the device mimics a human eye’s ability to capture light, pre-packages and transmits information like an optical nerve, and stores and classifies it in a memory system like the way our brains can.
Collectively, these functions could enable ultra-fast decision making, the team says.
Team leader Professor Sumeet Walia said the new device can perform all necessary functions – sensing, creating and processing information, and retaining memories – rather than relying on external energy-intensive computation, which prevents real-time decision making.
“Performing all of these functions on one small device had proven to be a big challenge until now,” said Walia from RMIT’s School of Engineering.
“We’ve made real-time decision making a possibility with our invention, because it doesn’t need to process large amounts of irrelevant data and it’s not being slowed down by data transfer to separate processors.”
What did the team achieve and how does the technology work?
The new device was able to demonstrate an ability to retain information for longer periods of time, compared to previously reported devices, without the need for frequent electrical signals to refresh the memory. This ability significantly reduces energy consumption and enhances the device’s performance.
Their findings and analysis are published in Advanced Functional Materials.
First author and RMIT PhD researcher Aishani Mazumder said the human brain used analog processing, which allowed it to process information quickly and efficiently using minimal energy.
“By contrast, digital processing is energy and carbon intensive, and inhibits rapid information gathering and processing,” she said.
“Neuromorphic vision systems are designed to use similar analog processing to the human brain, which can greatly reduce the amount of energy needed to perform complex visual tasks compared with today’s technologies
What are the potential applications?
The team used ultraviolet light as part of their experiments, and are working to expand this technology even further for visible and infrared light – with many possible applications such as bionic vision, autonomous operations in dangerous environments, shelf-life assessments of food and advanced forensics.
“Imagine a self-driving car that can see and recognise objects on the road in the same way that a human driver can or being able to able to rapidly detect and track space junk. This would be possible with neuromorphic vision technology.”
Walia said neuromorphic systems could adapt to new situations over time, becoming more efficient with more experience.
“Traditional computer vision systems – which cannot be miniaturised like neuromorphic technology – are typically programmed with specific rules and can’t adapt as easily,” he said.
“Neuromorphic robots have the potential to run autonomously for long periods, in dangerous situations where workers are exposed to possible cave-ins, explosions and toxic air.”
The human eye has a single retina that captures an entire image, which is then processed by the brain to identify objects, colours and other visual features.
The team’s device mimicked the retina’s capabilities by using single-element image sensors that capture, store and process visual information on one platform, Walia said.
“The human eye is exceptionally adept at responding to changes in the surrounding environment in a faster and much more efficient way than cameras and computers currently can,” he said.
“Taking inspiration from the eye, we have been working for several years on creating a camera that possesses similar abilities, through the process of neuromorphic engineering.”
Support for the research
The team used the Micro Nano Research Facility and the Microscopy and Microanalysis Research Facility at RMIT.
Funding: The work was also supported by the Australian Research Council and the National Computational Infrastructure.
Key facts Antimicrobial resistance (AMR) is one of the top global public health and development threats. It is estimated that bacterial AMR was directly responsible for 1.27 million global deaths in 2019 and contributed to [...]
Pancreatic cancer, a particularly lethal form of cancer and the fourth leading cause of cancer-related deaths in the western world, often remains undiagnosed until its advanced stages due to a lack of early symptoms. [...]
Richard Feynman famously stated, "Everything that living things do can be understood in terms of the jigglings and wigglings of atoms." This week, Nature Nanotechnology features a study that sheds new light on the evolution of the coronavirus [...]
Cambridge scientists have shown that placing physical constraints on an artificially-intelligent system—in much the same way that the human brain has to develop and operate within physical and biological constraints—allows it to develop features [...]
Summary: A new study reveals that people who are blind can recognize faces using auditory patterns processed by the fusiform face area, a brain region crucial for face processing in sighted individuals. The study employed [...]
Cancer biologists at EPFL, UNIGE, and the German Cancer Research Center (Heidelberg) have developed a novel immunotherapy that does not require knowledge of a tumor's antigenic makeup. The new results may pave the way [...]
Biological computing machines, such as micro and nano-implants that can collect important information inside the human body, are transforming medicine. Yet, networking them for communication has proven challenging. Now, a global team, including EPFL [...]
Research conducted during World Antimicrobial Awareness Week examines the effects of employing suggested chlorine-based chemicals to combat Clostridioides difficile, the leading cause of antibiotic-related illness in healthcare environments worldwide. A recent study reveals that a [...]
An Historical Overview of the Philosophy of Artificial Intelligence by Anton Vokrug Many famous people in the philosophy of technology have tried to comprehend the essence of technology and link it to society and human [...]
A new research study shows that human behavior, like lockdowns, influences the evolution of COVID-19, leading to strains that are more transmissible earlier in their lifecycle. Using artificial intelligence technology and mathematical modeling, a research [...]
Hereditary diseases are usually not curable. Now, however, an epochal turning point is taking place in medicine: For the first time ever, a therapy with the CRISPR/Cas9 gene scissors has received approval. According to [...]
New study shows that common genetic variation among people is responsible for mediating SARS-CoV-2 asymptomatic infection. Have you ever wondered why some people never became sick from COVID-19? A study published recently in the journal Nature shows that common [...]
Researchers have integrated AI approaches from satellite mapping and community ecology to develop a tool to interpret data obtained from tumor tissue imaging, with the aim of implementing a more individualized approach to cancer care. [...]
A new understanding of lung cancer cells' "memories" suggests a new strategy for improving treatment, Memorial Sloan Kettering Cancer Center (MSK) researchers have found. Research from the lab of cancer biologist Tuomas Tammela, MD, Ph.D. [...]
An artificial sensory system that is able to recognize fine textures—such as twill, corduroy and wool—with a high resolution, similar to a human finger, is reported in a Nature Communications paper. The findings may help improve the subtle [...]
You can adjust all of your cookie settings by navigating the tabs on the left hand side.
Strictly Necessary Cookies
Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.
If you disable this cookie, we will not be able to save your preferences. This means that every time you visit this website you will need to enable or disable cookies again.
What Are Cookies
For more general information on cookies see the Wikipedia article on HTTP Cookies.
You can prevent the setting of cookies by adjusting the settings on your browser (see your browser Help for how to do this). Be aware that disabling cookies will affect the functionality of this and many other websites that you visit. Disabling cookies will usually result in also disabling certain functionality and features of the this site. Therefore it is recommended that you do not disable cookies.
The Cookies We Set
Site preferences cookies. In order to provide you with a great experience on this site we provide the functionality to set your preferences for how this site runs when you use it. In order to remember your preferences we need to set cookies so that this information can be called whenever you interact with a page is affected by your preferences.
Third Party Cookies
This site uses Google Analytics which is one of the most widespread and trusted analytics solutions on the web. It helps us to understand how you use the site and ways that we can improve your experience. These cookies may track things such as how long you spend on the site and the pages that you visit so we can continue to produce engaging content. For more information on Google Analytics cookies, see the official Google Analytics page.
Hopefully that has clarified things for you and as was previously mentioned if there is something that you aren’t sure whether you need or not it’s usually safer to leave cookies enabled in case it does interact with one of the features you use on our site.
However if you are still looking for more information then you can contact us through our preferred contact method: