The hand is a part of the body that performs many important functions for humans. It is involved in most tasks and activities, especially in gripping and holding objects. At the same time, the hand is also a part that is easily injured due to frequent movement, collisions, and contact with various objects. Therefore, the purpose of this research is to establish a hand rehabilitation tool that helps patients increase their motivation for exercise and improve outcomes after rehabilitation treatment by using OpenCV to recognize hand gestures and convert them into actions for playing the game Flappy Bird. The popular designs such as the MediaPipe, and OpenCV are used to design hand movements, which in turn are used to develop the application named Flappy Bird game. The result of this program will be the gaming data of patients to assess the level of hand recovery, thereby supporting experts in making accurate evaluations of the patient’s recovery capability and designing more intensive exercises.