Skip to content

Commit

Permalink
Paper Revision{2024.acl-long.3}, closes #3843.
Browse files Browse the repository at this point in the history
  • Loading branch information
anthology-assist committed Sep 10, 2024
1 parent 3663c56 commit e1c30cf
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion data/xml/2024.acl.xml
Original file line number Diff line number Diff line change
Expand Up @@ -57,8 +57,10 @@
<author><first>Yue</first><last>Zhang</last><affiliation>Westlake University</affiliation></author>
<pages>36-53</pages>
<abstract>Large language models (LLMs) have achieved human-level text generation, emphasizing the need for effective deepfake text detection to mitigate risks like the spread of fake news and plagiarism. Existing research has been constrained by evaluating detection methods o specific domains or particular language models. In practical scenarios, however, the detector faces texts from various domains or LLMs without knowing their sources. To this end, we build a comprehensive testbed by gathering texts from diverse human writings and deepfake texts generated by different LLMs. Empirical results on mainstream detection methods demonstrate the difficulties associated with detecting deepfake text in a wide-ranging testbed, particularly in out-of-distribution scenarios. Such difficulties align with the diminishing linguistic differences between the two text sources. Despite challenges, the top-performing detector can identify 84.12% out-of-domain texts generated by a new LLM, indicating the feasibility for application scenarios.</abstract>
<url hash="5fdb577f">2024.acl-long.3</url>
<url hash="31eb75e1">2024.acl-long.3</url>
<bibkey>li-etal-2024-mage</bibkey>
<revision id="1" href="2024.acl-long.3v1" hash="5fdb577f"/>
<revision id="2" href="2024.acl-long.3v2" hash="31eb75e1" date="2024-09-09">Minor updates.</revision>
</paper>
<paper id="4">
<title><fixed-case>P</fixed-case>riv<fixed-case>LM</fixed-case>-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models</title>
Expand Down

0 comments on commit e1c30cf

Please sign in to comment.