Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2404.10849 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910414361591808 |
|---|---|
| author | Jaladi, Satya R. Chen, Zhimin Malayanur, Narahari R. Macherla, Raja M. Li, Bing |
| author_facet | Jaladi, Satya R. Chen, Zhimin Malayanur, Narahari R. Macherla, Raja M. Li, Bing |
| contents | The current autonomous stack is well modularized and consists of perception, decision making and control in a handcrafted framework. With the advances in artificial intelligence (AI) and computing resources, researchers have been pushing the development of end-to-end AI for autonomous driving, at least in problems of small searching space such as in highway scenarios, and more and more photorealistic simulation will be critical for efficient learning. In this research, we propose a novel game-based end-to-end learning and testing framework for autonomous vehicle highway driving, by learning from human driving skills. Firstly, we utilize the popular game Grand Theft Auto V (GTA V) to collect highway driving data with our proposed programmable labels. Then, an end-to-end architecture predicts the steering and throttle values that control the vehicle by the image of the game screen. The predicted control values are sent to the game via a virtual controller to keep the vehicle in lane and avoid collisions with other vehicles on the road. The proposed solution is validated in GTA V games, and the results demonstrate the effectiveness of this end-to-end gamification framework for learning human driving skills. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_10849 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | End-To-End Training and Testing Gamification Framework to Learn Human Highway Driving Jaladi, Satya R. Chen, Zhimin Malayanur, Narahari R. Macherla, Raja M. Li, Bing Robotics Artificial Intelligence The current autonomous stack is well modularized and consists of perception, decision making and control in a handcrafted framework. With the advances in artificial intelligence (AI) and computing resources, researchers have been pushing the development of end-to-end AI for autonomous driving, at least in problems of small searching space such as in highway scenarios, and more and more photorealistic simulation will be critical for efficient learning. In this research, we propose a novel game-based end-to-end learning and testing framework for autonomous vehicle highway driving, by learning from human driving skills. Firstly, we utilize the popular game Grand Theft Auto V (GTA V) to collect highway driving data with our proposed programmable labels. Then, an end-to-end architecture predicts the steering and throttle values that control the vehicle by the image of the game screen. The predicted control values are sent to the game via a virtual controller to keep the vehicle in lane and avoid collisions with other vehicles on the road. The proposed solution is validated in GTA V games, and the results demonstrate the effectiveness of this end-to-end gamification framework for learning human driving skills. |
| title | End-To-End Training and Testing Gamification Framework to Learn Human Highway Driving |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2404.10849 |