Learning the link between Drosophila 3D Pose and Neural Activity Patterns
Event details
| Date | 25.06.2018 |
| Hour | 14:00 › 16:00 |
| Speaker | Semih Günel |
| Location | |
| Category | Conferences - Seminars |
EDIC candidacy exam
Exam president: Prof. Mark Pauly
Thesis advisor: Prof. Pascal Fua
Thesis co-advisor: Prof. Pavan Ramdya
Co-examiner: Prof. Brian McCabe
Abstract
Behavior is the final output of the animal's nervous system. To understand how brain governs behavior, we first need to precisely quantify the behavioral output. In this report, we review three papers describing the problem of recovering the 3D pose of Drosophila Melanogaster (fruit-fly) in high-frequency infra-red imaging and using 3D pose information to understand how Ventral Nerve Cord (VNC)--the locomotor center controlling limb movements governs the behavior of living adult Drosophila Melanogaster. First, we start with presenting a survey of human pose estimation from monocular images and describe the state-of-art on human pose estimation. Then we talk about the shape-from-silhouette method and how to calibrate a camera-network using only silhouette information, which will enable us to acquire 3D information only from human annotation from multiple cameras. We then show how we can use behavior information to do correlation analysis, and create brain-behavior correlation maps. This will show us the brain regions responsible for the stereotyped behavior. We conclude with the current state of the research and possible future work.
Background papers
Human Pose Estimation from Monocular Images: A Comprehensive Survey, by Wenjuan Gong et al.
Camera Network Calibration from Dynamic Silhouettes, by Sudipta N. Sinha et al.
Mapping the Neural Substrates of Behavior, by Alice A. Robie et al.
Exam president: Prof. Mark Pauly
Thesis advisor: Prof. Pascal Fua
Thesis co-advisor: Prof. Pavan Ramdya
Co-examiner: Prof. Brian McCabe
Abstract
Behavior is the final output of the animal's nervous system. To understand how brain governs behavior, we first need to precisely quantify the behavioral output. In this report, we review three papers describing the problem of recovering the 3D pose of Drosophila Melanogaster (fruit-fly) in high-frequency infra-red imaging and using 3D pose information to understand how Ventral Nerve Cord (VNC)--the locomotor center controlling limb movements governs the behavior of living adult Drosophila Melanogaster. First, we start with presenting a survey of human pose estimation from monocular images and describe the state-of-art on human pose estimation. Then we talk about the shape-from-silhouette method and how to calibrate a camera-network using only silhouette information, which will enable us to acquire 3D information only from human annotation from multiple cameras. We then show how we can use behavior information to do correlation analysis, and create brain-behavior correlation maps. This will show us the brain regions responsible for the stereotyped behavior. We conclude with the current state of the research and possible future work.
Background papers
Human Pose Estimation from Monocular Images: A Comprehensive Survey, by Wenjuan Gong et al.
Camera Network Calibration from Dynamic Silhouettes, by Sudipta N. Sinha et al.
Mapping the Neural Substrates of Behavior, by Alice A. Robie et al.
Practical information
- General public
- Free
Contact
- EDIC - [email protected]