Skip navigation
Please use this identifier to cite or link to this item: http://arks.princeton.edu/ark:/88435/dsp01pr76f653q
Title: An Exploration of Reinforcement Learning Through Rocket League
Authors: Berman, Samuel "Sam"
Advisors: Littman, Michael
Department: Mechanical and Aerospace Engineering
Class Year: 2021
Abstract: The objective of this project was to use reinforcement learning to create an AI that can play the video game Rocket League. In order to solve for the Bellman Equation of Rocket League using neural networks, a method of evaluating all possible future states in some time horizon had to found. This task was split up into two separate tasks, state prediction and state evaluation. The state prediction task was accomplished by estimating how the state of each of the cars and ball change through each time step. These estimations were made through a combination of data collection, mathematical approximations, physical intuition and estimations widely used by the RLBot community. The state evaluation task was accomplished training many different TensorFlow neural networks on both live data with rewards (reinforcement learning) and labeled state data from other Rocket League games (inverse reinforcement learning). All of the neural networks that were created failed to significantly distinguish between the evaluations of the states generated by the state prediction model. This is likely due to the fact that, despite being accurate, the state predictor is too slow. As a result, it was unable to predict enough states into the future to meaningfully distinguish between all of the projected states. Consequently, the neural networks could not properly evaluate which states were better because they were so similar. If reinforcement learning is to be successfully applied to Rocket League, it is almost certain that a different methodology will have to be implemented.
URI: http://arks.princeton.edu/ark:/88435/dsp01pr76f653q
Type of Material: Princeton University Senior Theses
Language: en
Appears in Collections:Mechanical and Aerospace Engineering, 1924-2023

Files in This Item:
File Description SizeFormat 
BERMAN-SAM-THESIS.pdf741.28 kBAdobe PDF    Request a copy


Items in Dataspace are protected by copyright, with all rights reserved, unless otherwise indicated.