Use eyeball to control computing devices

Abstract

Since the early 2000s, computers and smartphones had become a popular trend. Until now, nearly everyone has their own computers and smartphones. However, there is a group of users that the general public forgot about who are not able to use computers or smartphones - the handicaps. The aim of this project is to assist this group of users by developing an application for them to control computers by using their eyeballs. Computer vision and artificial intelligence are used in the project to capture the movement of eyeballs, perform image analysis and determine the action. The capturing will be done via a built-in camera in computer or external webcam. The image data will be analyzed, and the actions wanted are deduced. The prototype developed in this project is based on Window computers for basic controls by detecting horizontal movements and blinking to select buttons and cursor control. Currently, the prototype can serve as a platform for others to further develop with more functions or migrate to other operating platforms.