Integrated Geologic Terms and Dual Model for Chinese Geological Word Segmentation

Mining knowledge from the rapid growth geological documents is essential for the development of geoscience. Languages such as Chinese, which consist of continuous characters, are difficult for computer processing and understanding, and word segmentation is a prerequisite in this situation. The quality of word segmentation has a crucial impact on the correct completion of downstream tasks, such as named entity recognition, relationship extraction and dependency analysis. Due to the specialization and complexity of the documents in the geological field, tools and models built in general domain usually have a poor performance in solving this problem. In this paper, we propose a new model named DualBERT which combines general model with domain model, and provides the ability to adapt to the new scenarios while maintaining the adaptability to the original scene. We introduce a words segmentation correction method based on the similarity with geologic terms, in order to enhance the ability to identify the boundaries of highly domain-specific geologic terms.