Logo do repositório
 
Miniatura indisponível
Publicação

Artificial intelligence-based control of autonomous vehicles in simulation: a CNN vs. RL case study

Utilize este identificador para referenciar este registo.
Nome:Descrição:Tamanho:Formato: 
Artificial_inteligence-based.pdf13.5 MBAdobe PDF Ver/Abrir

Orientador(es)

Resumo(s)

The article provides a comparison of Convolutional Neural Network (CNN) and Reinforcement Learning (RL) applied to the field of autonomous driving within the CARLA (CAr Learning to Act) simulator for training and evaluation. The analysis of results revealed CNNs better overall performance, as it demonstrated a more refined driving experience, shorter training durations, and a more straightforward learning curve and optimization process. However, it required data labelling. In contrast, RL relayed on an exhaustive (unsupervised) exploration of different models, ultimately selecting the model at timestep 600,000, which had the highest mean reward. Nevertheless, RL’s approach revealed its susceptibility to excessive oscillations and inconsistencies, necessitating additional optimization and tuning of hyperparameters and reward functions. This conclusion is further substantiated by a range of used performance metrics (objective and subjective), designed to assess the performance of each approach.

Descrição

Palavras-chave

Reinforcement learning CNN CARLA simulator

Contexto Educativo

Citação

Vasiljević, Ive; Musić, Josip; Lima, José (2024). Artificial intelligence-based control of autonomous vehicles in simulation: a CNN vs. RL case study. In Second International Conference, MoStart 2024. Cham: Springer Nature, p. 124-151. ISBN 978-3-031-62058-4. DOI: 10.1007/978-3-031-62058-4_10

Projetos de investigação

Unidades organizacionais

Fascículo