Ivan Vishniakou1, Paul G Plöger2, Johannes D Seelig3. 1. Center of Advanced European Studies and Research (caesar), Bonn, Germany. 2. Department of Computer Science, Hochschule Bonn-Rhein-Sieg, Sankt Augustin, Germany. 3. Center of Advanced European Studies and Research (caesar), Bonn, Germany. Electronic address: johannes.seelig@caesar.de.
Abstract
BACKGROUND: Virtual reality combined with a spherical treadmill is used across species for studying neural circuits underlying navigation and learning. NEW METHOD: We developed an optical flow-based method for tracking treadmill ball motion in real time using a single high-resolution camera. RESULTS: Tracking accuracy and timing were determined using calibration data. Ball tracking was performed at 500 Hz and integrated with an open source game engine for virtual reality projection. The projection was updated at 120 Hz with a latency with respect to ball motion of 30 ± 8 ms. The system was tested for behavior with fruit flies. The application and source code are available at https://github.com/ivan-vishniakou/neural-circuits-vr. COMPARISON WITH EXISTING METHOD(S): Optical flow-based tracking of treadmill motion is typically achieved using optical mice. The camera-based optical flow tracking system developed here is based on off-the-shelf components and offers control over the image acquisition and processing parameters. This results in flexibility with respect to tracking conditions - such as ball surface texture, lighting conditions, or ball size - as well as camera alignment and calibration. CONCLUSIONS: A fast system for rotational ball motion tracking suitable for virtual reality behavior with fruit flies was developed and characterized.
BACKGROUND: Virtual reality combined with a spherical treadmill is used across species for studying neural circuits underlying navigation and learning. NEW METHOD: We developed an optical flow-based method for tracking treadmill ball motion in real time using a single high-resolution camera. RESULTS: Tracking accuracy and timing were determined using calibration data. Ball tracking was performed at 500 Hz and integrated with an open source game engine for virtual reality projection. The projection was updated at 120 Hz with a latency with respect to ball motion of 30 ± 8 ms. The system was tested for behavior with fruit flies. The application and source code are available at https://github.com/ivan-vishniakou/neural-circuits-vr. COMPARISON WITH EXISTING METHOD(S): Optical flow-based tracking of treadmill motion is typically achieved using optical mice. The camera-based optical flow tracking system developed here is based on off-the-shelf components and offers control over the image acquisition and processing parameters. This results in flexibility with respect to tracking conditions - such as ball surface texture, lighting conditions, or ball size - as well as camera alignment and calibration. CONCLUSIONS: A fast system for rotational ball motion tracking suitable for virtual reality behavior with fruit flies was developed and characterized.