A new technology from the Institute of Industrial Science and Technology can display information about different animals in aquariums by tracking the user’s eye movements.
AI aquariums use multiple cameras to track eye movements and fish positions to display information about different species in the visitor’s line of sight.
A new technology that could prove to be a game-changer for aquariums is utilizing eye-tracking technology to display real-time information about the creatures the user is looking at.
Dubbed AI Aquarium, an innovative system developed by the Industrial Technology Research Institute (ITRI) in Hsinchu, Taiwan, the system uses dynamic object recognition and augmented reality (AR) to provide information about different fish species. Recognize and display information from the visitor’s perspective.
Developed by the Industrial Technology Research Institute (ITRI) in Hsinchu, Taiwan, the system is able to recognize different fish species with 98% accuracy regardless of water clarity, movement, and light, and is able to identify fish locations and visitors. Track both eye movements.
A depth-sensitive, outward-facing 3D camera mounted above the tank tracks the movements of the viewer’s eyes. Her second camera inside the tank tracks the position of the fish. A video captured by the second camera is analyzed by an object recognition algorithm. The algorithm uses a photo database to visually identify species.
Eye movements are then compared to the fish’s position before the information is delivered to a transparent micro-LED screen inside the viewer’s line of sight. Additional gesture recognition technology allows users to learn more with simple hand gestures, and audio and video can be used to enhance the experience.
“AI Aquarium combines dynamic object recognition technology with an intuitive user interface to provide an intelligent, self-guided experience,” said ITRI’s statement.
“Observers can learn about marine life in real-time and access detailed information through gesture controls. AI Aquarium recognizes over 10 gestures to create a fun and interactive human-machine interface.”
The AI Aquarium system has already been installed at the National Museum of Marine Science and Technology in Keelung, Taiwan and was recently recognized with a CES Innovation Award.
“This innovation addresses the needs of the post-pandemic era and the trend of immersive experiences,” said ITRI President Edwin Liu.
“It has been applied to enhance marine exploration and education in Taiwan’s National Museum of Marine Science and Technology, providing a more interactive and effective option than traditional aquariums.”