This paper explores the latest methodologies for fine-tuning open-source Large Language Models (LLMs) in enhancing quantitative trading strategies by integrating numerical data (e.g., historical prices, technical indicators) with textual data (e.g., news, earnings reports, social media sentiment). We employ Retrieval-Augmented Generation (RAG) with a vector database to efficiently handle and contextualize textual data, alongside Low-Rank Adaptation (LoRA) techniques for cost-effective and scalable model fine-tuning. The proposed approach aims to create a hybrid trading model that combines the predictive power of LLMs with traditional quantitative methods, improving accuracy and adaptability in financial markets. This study details the implementation process, highlighting practical innovations such as the integration of real-time data pipelines and adaptive model tuning. Experimental results show significant improvements in predictive accuracy and risk-adjusted returns, demonstrating the practical value of these advanced fine-tuning methodologies in finance.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Advancing Quantitative Trading Strategies Using Fine-Tuned Open-Source Large Language Models: A Hybrid Approach with Numerical and Textual Data Integration Using RAG and LoRA Techniques

  • Seth H. Huang,
  • Jimin Kim,
  • Ka Lok Kellogg Wong

摘要

This paper explores the latest methodologies for fine-tuning open-source Large Language Models (LLMs) in enhancing quantitative trading strategies by integrating numerical data (e.g., historical prices, technical indicators) with textual data (e.g., news, earnings reports, social media sentiment). We employ Retrieval-Augmented Generation (RAG) with a vector database to efficiently handle and contextualize textual data, alongside Low-Rank Adaptation (LoRA) techniques for cost-effective and scalable model fine-tuning. The proposed approach aims to create a hybrid trading model that combines the predictive power of LLMs with traditional quantitative methods, improving accuracy and adaptability in financial markets. This study details the implementation process, highlighting practical innovations such as the integration of real-time data pipelines and adaptive model tuning. Experimental results show significant improvements in predictive accuracy and risk-adjusted returns, demonstrating the practical value of these advanced fine-tuning methodologies in finance.