<p>Broken oracle bones record valuable information about ancient Chinese cultural heritage in the Shang Dynasty. However, many complete oracle bones have broken into pieces over the years, resulting in disjoining fragments scattered around the world, researchers have turned their attention to current technology to piece together oracle bone fragment images. A survey on rejoining object fragment algorithms and experiment datasets has been conducted, and it shows that the restoration work poses a serious challenge for current restoration models. To enhance the effectiveness of a deep rejoining model (DRM) with two stages, in the first stage, the longest similar edge segment (LSES) is proposed to match edge segments of two images, and a complete image rejoining (CIR) algorithm is given to rejoin the two images to be a complete image, in the second stage, we have embedded machine learning or deep learning methods into the DRM to determine whether the two images’ textures are continuity. In addition, a data set of oracle bone fragment image (OBFI) is given to evaluate current methods, it consists of three parts, and they are single high-resolution oracle bone fragment images, oracle bone fragment image pairs that can be rejoined together, and images that have rejoinable or unrejoinable textures. Extensive experiments on DRM and OBFI datasets demonstrate that DRM over previous state-of-the-art methods and the dataset can be used to evaluate the performance fragment rejoining algorithms.</p>