Handwritten signature verification (HSV) models are notably recognized for their ability to discern whether a signature is forged in an offline document. Recently, HSV technology has made significant development. However, these methods have primarily focused on the shape features of the text image and overlooked the textual feature information inherent in the text itself, which makes the HSV model overfit. In this paper, we propose a novel network model named OCR4HSV to solve the above shortcomings. The proposed OCR4HSV first attempts to combine OCR and HSV to learn textual features in a multi-task learning manner. The model employs a dual-parameter approach, combining shared parameters and independent parameters. Specifically, Within the shared parameters, the Laplace attention module (LAM) is incorporated for edge information extraction. For independent parameters, CN-Mamba is utilized for sequence feature extraction in OCR, and the multi-scale global fusion block (MGFB) is designed to enhance the distinction between reference and test sample pairs. Leveraging OCR-related information and these architectural enhancements can fully mine the inherent textual feature information and significantly mitigate overfitting in the HSV task, thereby boosting verification accuracy. Our model has achieved state-of-the-art performance on the ChiSig and HanSig datasets.