Motion tracking
Motion analysis of singing behavior
We use high-speed cameras and synchronized sound recordings to study the song production of crickets and bush-crickets in detail. Animals are filmed with two cameras at 1000 fps (frames per second) and the produced songs are recorded simultaneously. The wing movements are then analyzed using DeepLabCut (an open source software package for markerless, automated motion analysis) and a neural network specially trained for wing movements. In this way, the motion patterns of any wing region can be analyzed and evaluated in combination with the sound signals (see video).
A high-speed video recording (1000 fps) of a male Tettigonia cantans during song production. Wing motion is automatically tracked and analysed using DeepLabCut (video and data analysis: Jan Wille)
In the future, we are planning to track wing motion in 3D as well.
