Pretraining a foundation model for small-molecule natural products
摘要
Natural products, as metabolites from microorganisms, animals or plants, exhibit diverse biological activities, making them crucial for drug discovery. Nowadays, existing deep-learning methods for natural products research primarily rely on supervised learning approaches designed for specific downstream tasks. However, such one-model-for-a-task paradigm often lacks generalizability and leaves substantial room for performance improvement. Additionally, existing molecular characterization methods are not well-suited for the unique tasks associated with natural products. Here, to address these limitations, we pretrained a foundation model for natural products (NaFM) based on their unique properties. Our approach employs a pretraining strategy specifically tailored to natural products. By incorporating contrastive learning and masked graph learning objectives, we emphasize evolutional information from molecular scaffolds while capturing side-chain information. NaFM achieves state-of-the-art results in various downstream tasks related to natural product mining and drug discovery. We first compare taxonomy classification with synthetic molecule-focused baselines to demonstrate that current models are inadequate for understanding natural synthesis. Furthermore, by diving into a fine-grained analysis at both the gene and microbial levels, NaFM demonstrates the ability to capture evolutionary information. Eventually, our method is applied to virtual screening, illustrating informative natural product representations that can lead to more effective identification of potential drug candidates.