In a recent study published in the journal Science Advances, researchers leveraged crucial aspects of feline eyes, particularly their tapetum lucidum and vertically elongated pupils (VP), to develop a monocular artificial vision system capable of hardware-level object detection, recognition, and camouflage-breaking. While software-aided implementations of object recognition and tracking have been attempted, they require substantial energy and computation requirements, necessitating hardware-level innovations.
The present vision system uses a custom slit-like elliptical aperture (inspired by the asymmetric depth of field of cats’ VPs) to augment object focus and allow for an asymmetric depth of field, improving contrast between the target object and its background. An additional tapetum lucidum-inspired silicon photodiode array with patterned metal reflectors enhances low-light vision. Together, these advancements open the doors to a new generation of mobile robots that can detect, recognize, and track targets with significantly improved accuracy, even in dynamically changing environments with variable lighting conditions.
Background
The 21st century has witnessed unprecedented advancements in robotics and automation, resulting in the gradual influx of robotics across scientific, medical, industrial, and military applications. While software-based machine learning (ML) and artificial intelligence (AI) deployments have revolutionized robotic automation, hardware-level progress remains shackled by the limitations of conventional design and fabrication decisions.
An ideal example of the above is vision-based operation strategies. Conventional image-capturing devices (e.g., cameras) were optimized to record image data (e.g., light intensity, color, and object shape) but required user input to adjust aperture size and exposure duration to target objects focused under dynamically changing lighting. Modern robotics applications, particularly those used for surveillance, cannot be content with passive image data acquisition. Instead, they need to extract and analyze real-time image data and use this information to guide their subsequent motion.
“However, these tasks become substantially difficult under diverse environments and illumination conditions (e.g., indoor and outdoor and daytime and nighttime). This variability can severely affect the contrast between target objects and their backgrounds, mainly due to pixel saturation under bright conditions and low photocurrent in dark conditions. Objects often create indistinct boundaries with their backgrounds, posing detection and differentiation challenges.”
Software-based computer vision technologies, including high dynamic range (HDR), binocular vision-based camouflage-breaking, and AI-assisted post-processing, have partially addressed the hardware limitations of today’s robotics implementations. Unfortunately, these technologies require substantial computational and energetic (power/electricity) investment, increasing the size and running costs of resulting robotic systems. It is thus imperative for the future of robot automation that hardware capable of unassisted object identification, camouflage-breaking, and optimized performance under a wide range of lighting conditions is developed.
“…animals have adapted themselves to ecologically complex environments for their survival. As a result, distinctive vision systems optimized for their habitats have been developed through long-term evolution. These natural vision systems could offer potential solutions to tackle limitations of conventional artificial vision systems, in terms of depth of field (DoF), field of view (FoV), and optical aberrations.”
About the study
In the present study, researchers developed and tested an artificial vision system that mimics the feline eye. The system comprises two main components: a custom-made optical lens capable of varying apertures between elliptical, small shape, and full-opening circular and a novel hemispherical silicon photodiode array with patterned metal (silver) reflectors (HPA-AgR).
The photodiode array was fabricated by spin coating a silicon dioxide (SiO₂) wafer with a polyamic acid solution containing an ultrathin polyimide (PI) layer upon which a patterned reflector was superimposed using the wet-etching technique (100 nm Ag). The structured reflectors were designed to simulate the light-reflecting properties of the tapetum lucidum, enhancing light absorption under dim lighting conditions. The performance of the resulting photodiode was measured using a wide temperature (3100 K) halogen lamp, a probe station (image sensor array + semiconductor device analyzer), and a data acquisition (DAQ) board.
Monte Carlo-based ray tracing was used to evaluate the camouflage-breaking performance of the feline-inspired vision system versus conventional optical systems (circular pupil [CP]) against a variable lighting of 0-500 lumens.
Study findings
While monocular CP systems (including human eyes) struggle to differentiate between the target object and its background (pixel saturation) in extremely bright scenarios, the asymmetrical aperture design of feline eyes (feline VP) and, by extension, the current vision system can adjust focus between different (tangential and sagittal) planes thereby substantially offsetting light intensity and enabling camouflage breaking.
The design also allows for improved focus on objects at different distances, further reducing optical noise from background elements. Comparisons between the current VP-inspired and conventional CP-like systems highlight the latter’s lack of camouflage-breaking, especially in bright-light conditions. This is predominantly due to observed astigmatism between tangential and sagittal planes, which blurs the target and its background. In contrast, the VP system could easily distinguish between the target and the object irrespective of ambient light intensity. Furthermore, while ‘locked on’ a target, the vision system’s design blurs out the target’s background, reducing the amount of uninformative noise and thereby lowering the computational burden required for real-time analysis.
“Although computer vision and deep learning algorithms have substantially improved handling of noisy targets, the feline eye–inspired vision system provides intrinsic advantages originated from hardware. The feline eye–inspired artificial vision inherently induces background blurring and camouflage breaking, which can markedly reduce the computational burden.”
Similarly, while monocular CP systems achieve high camouflage-breaking performance in low-light conditions (wide-open pupils), they often suffer from low photocurrent in dark scenarios. Feline (and the current artificial) optics circumvent this limitation by not only fully dilating their VPs but also using their tapetum lucidum (or, in the artificial case, their metal reflectors) to reflect ambient light onto the pupil, further enhancing low-light target acquisition. Notably, comparisons between conventional CP optics and the current VP-inspired ones revealed that the novel system is 52-58% more efficient at photoabsorption than traditional technologies.
Despite these advances, the researchers noted one primary limitation of their system: its narrow field of view (FoV). Innovations in optic system movement (possibly inspired by the movements of cat heads) will be needed before these systems can be integrated into autonomous robotics.
Conclusions
The present study reports the development and validation of a novel, feline eye-inspired vision system. The system consists of a variable aperture lens and a metallic silicon photodiode array to achieve unprecedented, hardware-level object tracking and camouflage-breaking irrespective of the intensity of ambient light. While this vision system suffers from a low FoV, advancements in robotic movement may allow for its integration into autonomous robotics, allowing for a new generation of unmanned surveillance and tracking systems.
- Min Su Kim et al. Feline eye–inspired artificial vision for enhanced camouflage breaking under diverse light conditions. Sci. Adv.10, eadp2809 (2024), DOI – 10.1126/sciadv.adp2809, https://www.science.org/doi/10.1126/sciadv.adp2809
News
NIH Scientists Discover Gene Responsible for Rare Eye Disease
Findings supported by the NIH pave the way for the development of genetic testing, clinical trials, and therapies. Researchers at the National Institutes of Health (NIH) and their collaborators have discovered a gene linked to certain [...]
Alzheimer’s Breakthrough: Synthetic THC Pill Proves Effective in Clinical Trial
Patients tolerated synthetic THC (dronabinol) well, without the adverse effects commonly associated with existing Alzheimer’s agitation medications. A study conducted by researchers from Johns Hopkins University School of Medicine and Tufts University School of Medicine found that a pill form [...]
The Future of Rare Disease Treatment with Precision Medicine
Understanding rare diseases Rare diseases affect less than 5 people out of 10,000. However, this still amounts to about 7% of the world’s population, with over 10,000 such conditions. Almost all are genetic in [...]
Doctors issue warning for upcoming ‘tripledemic
The term ‘tripledemic’ has hit headlines this week as the NHS begins its Covid and fluvaccine roll-out for vulnerable adults. As the cold weather sets in, many of us have experienced a decline in health, and this may [...]
The FDA approved a gel that can stop bleeding from wounds in seconds
Aug 15 (Reuters) - The U.S. Food and Drug Administration has cleared Cresilon's gel to quickly control bleeding, the privately held company said on Thursday, potentially giving emergency medical technicians and combat medics a [...]
High levels of microplastics found in prostate tumors, possibly linked to take-out food
The presence of microplastics in prostate tumors points to potential health risks, and researchers are calling for urgent studies to explore how take-out food may be driving this exposure. In a recent study published [...]
AI outperforms radiologists in brain tumor diagnosis
As artificial intelligence advances, its uses and capabilities in real-world applications continue to reach new heights that may even surpass human expertise. In the field of radiology, where a correct diagnosis is crucial to ensure [...]
Breakthrough Study Reveals Molecular Clues to Dementia Origins
Work could lead to the discovery of new therapeutic targets. For the first time, researchers have identified “molecular markers” linked to degeneration—detectable changes in cells and their gene-regulating networks—that are common across several types [...]
Better than blood tests? Nanoparticle potential found for assessing kidneys
In a study published July 29 in Advanced Materials, University of Texas at Dallas researchers found that X-rays of the kidneys using gold nanoparticles as a contrast agent might be more accurate in detecting kidney [...]
Greener nanomaterials could transform how our everyday stuff is made
Tiny nanoparticles are at the forefront of materials science—with special properties that make them great at absorbing light in solar panels, cleaning wastewater, and delivering drugs precisely. Some nanoparticles take the form of sheets or fibers. But nanomaterials all [...]
AI could predict breast cancer risk via ‘zombie cells’
Women worldwide could see better treatment with new AI technology, which enables better detection of damaged cells and more precisely predicts the risk of getting breast cancer, shows new research from the [...]
Through the eyes of a cat – biomimicry of feline eyes may revolutionize robotic vision
In a recent study published in the journal Science Advances, researchers leveraged crucial aspects of feline eyes, particularly their tapetum lucidum and vertically elongated pupils (VP), to develop a monocular artificial vision system capable of [...]
New Alzheimer’s Therapy Shows Remarkable Results in Animal Trials
A study from TUM demonstrates a promising therapeutic approach. Researchers at the Technical University of Munich (TUM) have made promising advances in preventing Alzheimer’s by developing a new therapeutic strategy. Their approach focuses on targeting the amyloid beta [...]
Rewriting Cancer’s Blueprint: New Study Challenges Old Theories
A new study argues for a revised clonal evolution model of cancer, incorporating genetic and non-genetic factors to improve understanding and treatment. Like all living organisms, cancer cells are driven by the fundamental need [...]
Microplastics Everywhere: Experts Demand Worldwide Treaty Before It’s Too Late
A new report calls for global action on plastic pollution, urging reductions in plastic production and microplastic emissions. Researchers stress the importance of addressing plastic pollution through both scientific and social science perspectives. A [...]
Blood tests could soon predict your risk of Alzheimer’s
Scientists are closing in on biomarkers that reflect the progression of Alzheimer’s disease and could improve treatments. Like many Alzheimer’s researchers, neurologist Randall Bateman is not prone to effusiveness, having endured disappointments in his [...]
