Traditional handicraft making and display usually require fixed steps of hand operating. Gesture-based design is a considerable way when designing serious interactive games for traditional handicraft transmission. This paper developed a design framework for interactive game using gesture with five modules including investigation, gesture-determination, scheme, rapid prototyping, and evaluation. Gestures are obtained by behavior observation of traditional handicraft and user study, and drawn as corresponding icons used in UI scheme, captured by Leap motion, and recognized by the code implementation in Processing environment. The interactive flow is designed based on behavior observation of making and displaying process of traditional handicraft. Eye tracking and test of system usability scale (SUS) are implemented to analyze the feasibility of UI scheme and the usability, learnability, and satisfaction of interactive game respectively from the subjective and objective views. The feasibility of developed design framework has been illustrated through a design case of an interactive game for hand shadow teaching. 51 participants were recruited for the evaluation of this case study, and the data are analyzed by statistical methods to get the guide for iterative design. In addition, user study is used to discuss the effectiveness of designed interaction game for transmission of traditional handicraft. This study mainly explores the interactive design approach of serious game combing rapid prototyping and subjective and objective evaluations with the hope to provide helpful guidance for related design in the future.