Hand gesture recognition (HGR) is an essential task in human-computer interaction. Hand gestures and whole-body actions are human-made motions, so recognition tasks are similar. Graph-based deep learning has been a dominant approach for whole-body action recognition. A two-scheme graph-based network is proposed for dynamic HGR to benefit from state-of-the-art methods for whole-body action recognition. The proposed method outperforms existing methods on the public benchmark SHREC dataset.