Skip navigation
Run Run Shaw Library City University of Hong KongRun Run Shaw Library

Please use this identifier to cite or link to this item: http://dspace.cityu.edu.hk/handle/2031/9530
Title: AWS DeepRacer
Authors: Au, Cheuk Ming (區倬鳴)
Department: Department of Electrical Engineering
Issue Date: 2021
Course: EE4080 Project
Programme: Bachelor of Engineering (Honours) in Information Engineering
Supervisor: Mr. Ting, Van C W
Citation: Au, C. M. (2021). AWS DeepRacer (Outstanding Academic Papers by Students (OAPS), City University of Hong Kong).
Abstract: AWS DeepRacer League is the world's global autonomous racing league. In the league, partitions will train their own AI models to drive the cars and win the competition. In this project, reinforcement learning is used, and Proximal Policy Optimization (PPO) Algorithm is applied for model training. Since the action spaces and the reward function are the essential elements which affect the model performance. Therefore, the project will focus on how to implement them to achieve a better result. To improve the action spaces, the optimal racing line for the Penbay circuit, which is the racing track of the March qualifier, was calculated with the K1999 path optimization algorithm's inspiration. After that, by collecting the steering angles and the velocity through the track, Kmean clustering is applied to select the action spaces. Furthermore, hyperparameters are another factor that will significantly affect the training result. Therefore, during the model training, log analysis will be performed for evaluating those three elements. For the final result, the model has ranked 6 in the March qualifier.
Appears in Collections:OAPS - Dept. of Electrical Engineering 

Files in This Item:
File SizeFormat 
fulltext.html154 BHTMLView/Open
Show full item record


Items in Digital CityU Collections are protected by copyright, with all rights reserved, unless otherwise indicated.

Send feedback to Library Systems
Privacy Policy | Copyright | Disclaimer