Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Artículo científico |
| Language: | en |
| Published: |
iScience
2026
|
| Online Access: | https://pubmed.ncbi.nlm.nih.gov/42256308/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1868266039402299393 |
|---|---|
| author | Fujii, Keisuke Tsutsui, Kazushi Teshima, Yu Itoh, Makoto Takeishi, Naoya Nishiumi, Nozomi Tanaka, Ryoya Shigaki, Shunsuke Kawahara, Yoshinobu |
| author_facet | Fujii, Keisuke Tsutsui, Kazushi Teshima, Yu Itoh, Makoto Takeishi, Naoya Nishiumi, Nozomi Tanaka, Ryoya Shigaki, Shunsuke Kawahara, Yoshinobu Fujii, Keisuke Tsutsui, Kazushi Teshima, Yu Itoh, Makoto Takeishi, Naoya Nishiumi, Nozomi Tanaka, Ryoya Shigaki, Shunsuke Kawahara, Yoshinobu |
| collection | PubMed - marine biology |
| contents | Data-driven simulator of multi-animal behavior with unknown dynamics via reinforcement learning. Fujii, Keisuke Tsutsui, Kazushi Teshima, Yu Itoh, Makoto Takeishi, Naoya Nishiumi, Nozomi Tanaka, Ryoya Shigaki, Shunsuke Kawahara, Yoshinobu Advances in imitation learning for robotics have expanded the possibilities for imitating human and animal movements. However, simulating realistic multi-animal behaviors in biology remains challenging because transition models are often unknown. Since locomotion dynamics are seldom known, one cannot rely solely on mathematical models, and constructing a simulator that reproduces trajectories and supports reward-driven optimization remains a research gap. Here we introduce a data-driven simulator of multi-animal behavior using deep reinforcement learning with (counterfactual) simulations. We address the ill-posed problem caused by high degrees of freedom via estimating movement variables in reinforcement learning. We also use a distance-based pseudo-reward to align and compare states between cyber and physical spaces. We verified our approach using data from artificial agents, flies, newts, and silkmoth, revealing higher reproducibility and reward acquisition than simple imitation learning and reinforcement learning approaches. Furthermore, our approach enables counterfactual behavior prediction in unknown experimental settings. These suggest the potential to simulate and understand complex multi-animal behaviors. |
| format | Artículo científico |
| id | pubmed_42256308 |
| institution | PubMed |
| language | en |
| publishDate | 2026 |
| publisher | iScience |
| record_format | pubmed |
| spellingShingle | Data-driven simulator of multi-animal behavior with unknown dynamics via reinforcement learning. Fujii, Keisuke Tsutsui, Kazushi Teshima, Yu Itoh, Makoto Takeishi, Naoya Nishiumi, Nozomi Tanaka, Ryoya Shigaki, Shunsuke Kawahara, Yoshinobu Data-driven simulator of multi-animal behavior with unknown dynamics via reinforcement learning. Fujii, Keisuke Tsutsui, Kazushi Teshima, Yu Itoh, Makoto Takeishi, Naoya Nishiumi, Nozomi Tanaka, Ryoya Shigaki, Shunsuke Kawahara, Yoshinobu Advances in imitation learning for robotics have expanded the possibilities for imitating human and animal movements. However, simulating realistic multi-animal behaviors in biology remains challenging because transition models are often unknown. Since locomotion dynamics are seldom known, one cannot rely solely on mathematical models, and constructing a simulator that reproduces trajectories and supports reward-driven optimization remains a research gap. Here we introduce a data-driven simulator of multi-animal behavior using deep reinforcement learning with (counterfactual) simulations. We address the ill-posed problem caused by high degrees of freedom via estimating movement variables in reinforcement learning. We also use a distance-based pseudo-reward to align and compare states between cyber and physical spaces. We verified our approach using data from artificial agents, flies, newts, and silkmoth, revealing higher reproducibility and reward acquisition than simple imitation learning and reinforcement learning approaches. Furthermore, our approach enables counterfactual behavior prediction in unknown experimental settings. These suggest the potential to simulate and understand complex multi-animal behaviors. |
| title | Data-driven simulator of multi-animal behavior with unknown dynamics via reinforcement learning. |
| url | https://pubmed.ncbi.nlm.nih.gov/42256308/ |