Rehabilitation chatbots must extract structured events and estimate users’ self-efficacy in real time, yet Japanese dialogue—rich in honorifics, ellipsis, and loanwords—plus limited annotations and edge-device constraints make this difficult. We propose Synergy-BERT, a lightweight multi-task framework that jointly performs event extraction (event, rationale, facilitator, barrier) and self-efficacy assessment. The model augments a Japanese BERT encoder with a BiLSTM, five learnable task tokens, and a synergistic attention module enabling bidirectional interaction between tasks and the sequence; BIO tags are decoded with a CRF, and scores are produced by a compact MLP. A progressive fine-tuning schedule freezes most pre-trained layers before partially unfreezing for domain transfer, mitigating gradient interference and improving convergence stability. Experiments on real Japanese rehabilitation dialogues show consistent improvements over a strong BERT baseline while preserving low-latency inference suitable for edge deployment. The framework provides a practical, pluggable core for rehabilitation assistants and opens avenues for multimodal inputs, energy-aware optimization, and cross-lingual transfer.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Synergistic Multi-task BERT Framework for Event Extraction and Self-Efficacy Assessment in Rehabilitation Chatbot Dialogues

  • Yuqi Zhang,
  • Yuning Shi,
  • Han Shi,
  • Kubota Naoyuki

摘要

Rehabilitation chatbots must extract structured events and estimate users’ self-efficacy in real time, yet Japanese dialogue—rich in honorifics, ellipsis, and loanwords—plus limited annotations and edge-device constraints make this difficult. We propose Synergy-BERT, a lightweight multi-task framework that jointly performs event extraction (event, rationale, facilitator, barrier) and self-efficacy assessment. The model augments a Japanese BERT encoder with a BiLSTM, five learnable task tokens, and a synergistic attention module enabling bidirectional interaction between tasks and the sequence; BIO tags are decoded with a CRF, and scores are produced by a compact MLP. A progressive fine-tuning schedule freezes most pre-trained layers before partially unfreezing for domain transfer, mitigating gradient interference and improving convergence stability. Experiments on real Japanese rehabilitation dialogues show consistent improvements over a strong BERT baseline while preserving low-latency inference suitable for edge deployment. The framework provides a practical, pluggable core for rehabilitation assistants and opens avenues for multimodal inputs, energy-aware optimization, and cross-lingual transfer.