Large language models (LLMs) can produce convincing ‘fake text’ in domains such as academic writing, product reviews, and political news. Many approaches have been investigated for the detection of artificially generated text. While this may seem to presage an endless ‘arms race’, we note that newer LLMs use ever more parameters, training data, and energy, while relatively simple classifiers demonstrate a good level of detection accuracy with modest resources. To approach the question of whether these models’ ability to beat the detectors may therefore reach a plateau, we examine the ability of statistical classifiers to identify ‘fake text’ in the style of classical detective fiction. Over a 0.5 version increase, we found that Gemini showed an increased ability to generate deceptive text, while GPT did not. This suggests that reliable detection of fake text may remain feasible even for ever-larger models, though new model architectures may increase their deceptiveness.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Cat & Mouse - Can Fake Text Generation Outpace Detector Systems?

  • Andrea McGlinchey,
  • Peter J. Barclay

摘要

Large language models (LLMs) can produce convincing ‘fake text’ in domains such as academic writing, product reviews, and political news. Many approaches have been investigated for the detection of artificially generated text. While this may seem to presage an endless ‘arms race’, we note that newer LLMs use ever more parameters, training data, and energy, while relatively simple classifiers demonstrate a good level of detection accuracy with modest resources. To approach the question of whether these models’ ability to beat the detectors may therefore reach a plateau, we examine the ability of statistical classifiers to identify ‘fake text’ in the style of classical detective fiction. Over a 0.5 version increase, we found that Gemini showed an increased ability to generate deceptive text, while GPT did not. This suggests that reliable detection of fake text may remain feasible even for ever-larger models, though new model architectures may increase their deceptiveness.