Annealed Winner-Takes-All for Motion Forecasting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Yihong, Letzelter, Victor, Chen, Mickaël, Zablocki, Éloi, Cord, Matthieu
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909488824451072
author Xu, Yihong
Letzelter, Victor
Chen, Mickaël
Zablocki, Éloi
Cord, Matthieu
author_facet Xu, Yihong
Letzelter, Victor
Chen, Mickaël
Zablocki, Éloi
Cord, Matthieu
contents In autonomous driving, motion prediction aims at forecasting the future trajectories of nearby agents, helping the ego vehicle to anticipate behaviors and drive safely. A key challenge is generating a diverse set of future predictions, commonly addressed using data-driven models with Multiple Choice Learning (MCL) architectures and Winner-Takes-All (WTA) training objectives. However, these methods face initialization sensitivity and training instabilities. Additionally, to compensate for limited performance, some approaches rely on training with a large set of hypotheses, requiring a post-selection step during inference to significantly reduce the number of predictions. To tackle these issues, we take inspiration from annealed MCL, a recently introduced technique that improves the convergence properties of MCL methods through an annealed Winner-Takes-All loss (aWTA). In this paper, we demonstrate how the aWTA loss can be integrated with state-of-the-art motion forecasting models to enhance their performance using only a minimal set of hypotheses, eliminating the need for the cumbersome post-selection step. Our approach can be easily incorporated into any trajectory prediction model normally trained using WTA and yields significant improvements. To facilitate the application of our approach to future motion forecasting models, the code is made publicly available: https://github.com/valeoai/MF_aWTA.
format Preprint
id arxiv_https___arxiv_org_abs_2409_11172
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Annealed Winner-Takes-All for Motion Forecasting
Xu, Yihong
Letzelter, Victor
Chen, Mickaël
Zablocki, Éloi
Cord, Matthieu
Robotics
Computer Vision and Pattern Recognition
In autonomous driving, motion prediction aims at forecasting the future trajectories of nearby agents, helping the ego vehicle to anticipate behaviors and drive safely. A key challenge is generating a diverse set of future predictions, commonly addressed using data-driven models with Multiple Choice Learning (MCL) architectures and Winner-Takes-All (WTA) training objectives. However, these methods face initialization sensitivity and training instabilities. Additionally, to compensate for limited performance, some approaches rely on training with a large set of hypotheses, requiring a post-selection step during inference to significantly reduce the number of predictions. To tackle these issues, we take inspiration from annealed MCL, a recently introduced technique that improves the convergence properties of MCL methods through an annealed Winner-Takes-All loss (aWTA). In this paper, we demonstrate how the aWTA loss can be integrated with state-of-the-art motion forecasting models to enhance their performance using only a minimal set of hypotheses, eliminating the need for the cumbersome post-selection step. Our approach can be easily incorporated into any trajectory prediction model normally trained using WTA and yields significant improvements. To facilitate the application of our approach to future motion forecasting models, the code is made publicly available: https://github.com/valeoai/MF_aWTA.
title Annealed Winner-Takes-All for Motion Forecasting
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.11172