Enhancing Named Entity Recognition (NER) in Biomedical Texts: BIOBERT on CORD-19 Data set
摘要
The CORD-19 data and Bio BERT-NER (Bidirectional Encoder Representations from Transformers for Named Entity Recognition) are strong natural language processing and biological research approaches. Bio BERT-NER provides scientific articles on COVID-19 and associated historical coronavirus research. CORD-19 allows for text mining and data retrieval system development using its extensive metadata and structured full-text publications. Applying the BioBERT model to the CORD-19 data to recognise named entities (NER). An adaptation of the BERT concept is tailored to deal with biomedical works. Named entities (people, places, things, etc.), biomedical entities (genes, proteins, illnesses, etc.), and other types of textual entities are recognised and placed into predetermined categories in NER. Since its release, the CORD-19 data set has been used as the foundation for several text analysis and discovery algorithms focused on Covid-19. In this study, we present a comprehensive approach utilising the BioBERT model for NER on the CORD-19 data set, which contains a vast collection of scholarly articles related to Covid-19. The workflow begins with data pre-processing, including handling missing values, dropping low-frequency tags, and tokenising the text using the BioBERT tokeniser. The tokenised sequences are then encoded into numerical representations using BioBERT's vocabulary. A custom NER model is constructed using PyTorch, with the pre-trained BioBERT weights loaded for transfer learning. This article provides an in-depth account of creating a data set, focusing on the difficulties and significant choices made during its creation. This research will facilitate the collaboration between the scientific computing community, biomedical professionals, and policymakers in pursuing efficient therapies and management strategies for Covid-19.