In this paper, we introduce a relevant approach for payroll fraud detection, leveraging Large Language Models (LLMs) to generate synthetic fraud data scenarios that are not text-based. For the first time, LLMs are used to create structured data that present real payroll patterns without relying on textual tasks. These synthetic data integrate seamlessly with real non-fraud data. In fact, this is achieved through an extensive data analysis phase that captures natural feature correlations and patterns, ensuring that the generated data mirror realistic data. The synthetically generated data are then used to fine-tune a finance pre-trained LLM, enabling the generation of scalable fraud schemes. Therefore, they are combined with historical non-fraud data, and then input into a meta multilabel classifier model to categorize fraud scenarios. Obtained results are evaluated against those from a standard multi-label classifier model. The comparison confirms that our approach has higher performance compared to a decision tree multi-label classifier on a real-world test dataset across nearly all fraud labels. Indeed, the proposed approach can easily generalize to other fraud domains and could be extended to unlabeled data, ensuring both data fidelity and diversity.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

LLM Non-text-focused Data Generation for Payroll Fraud Detection

  • Farah Ouesleti,
  • Khaoula ElBedoui,
  • Walid Barhoumi,
  • Mohamed Amine Aissaoui

摘要

In this paper, we introduce a relevant approach for payroll fraud detection, leveraging Large Language Models (LLMs) to generate synthetic fraud data scenarios that are not text-based. For the first time, LLMs are used to create structured data that present real payroll patterns without relying on textual tasks. These synthetic data integrate seamlessly with real non-fraud data. In fact, this is achieved through an extensive data analysis phase that captures natural feature correlations and patterns, ensuring that the generated data mirror realistic data. The synthetically generated data are then used to fine-tune a finance pre-trained LLM, enabling the generation of scalable fraud schemes. Therefore, they are combined with historical non-fraud data, and then input into a meta multilabel classifier model to categorize fraud scenarios. Obtained results are evaluated against those from a standard multi-label classifier model. The comparison confirms that our approach has higher performance compared to a decision tree multi-label classifier on a real-world test dataset across nearly all fraud labels. Indeed, the proposed approach can easily generalize to other fraud domains and could be extended to unlabeled data, ensuring both data fidelity and diversity.