All major LLM providers will be required, by the AI Act of the European Union, to add watermarks to the generated content, including text. Anthropic, owner of Claude, explained its method:<\/p>\n
Large language models like Claude work by generating one word at a time. Each time the model decides on the next word, it chooses among a list of potential candidates, ultimately selecting the most sensible or likely based on the preceding text. Take the sentence \u201cThe weather today was cold and\u2026\u201d. The next word is very unlikely to be \u201csugary.\u201d But it is quite likely to be \u201covercast\u201d or \u201cgrey.\u201d Under most circumstances, it doesn\u2019t matter much to the reader which of these latter two words the model ultimately chooses\u2014the meaning of the sentence is largely the same either way. In cases like this, the choice is settled by a random number.<\/p>\n
Watermarking uses low-stakes choices like these\u2014which occur many times over a piece of generated text\u2014to leave a pattern in Claude\u2019s responses. That pattern is undetectable to the reader, but is detectable to anyone who has a key that encodes it. When watermarking is used, choices are still made at random, but the source of the randomness is different. Instead of using an arbitrary random number generator to pick the next word, watermarking uses the key and a few words that come before to settle what word the model should pick. That is, the words that Claude picks are still random, but now, one can check the sequence of words and see if it\u2019s consistent with the choices Claude would make if it was using the key. If it is, one can assign a probability that the text was generated by Claude.<\/p><\/blockquote>\n
The solution is the same one Google created and has used since 2024 in Gemini, called SynthID-Text<\/a>.<\/p>\n
Some people are freaking out over this change. As I’ve been saying for a while now, it doesn’t matter<\/a>.<\/p>\n
Besides, simple systems that swap out some words for synonyms are likely to show up (if they don’t exist already), which (in theory? someone correct me if that’s the case) would break SynthID-Text’s digital signature. Still in the realm of guesswork, I’d imagine that feeding the text into another LLM and asking it to swap out some words and structures would already do the trick.<\/p>\n
Regardless of all that, isn’t it about time people who use generative AI to write text started owning up to their choices?<\/p>\n
I think the first thing that comes to mind when this topic comes up is using the watermark to point fingers and shame whoever uses it. It’s possible to imagine other uses, though, such as helping triage requests sent to public agencies, which, as Ronaldo Lemos pointed out<\/a> [pt_BR] in his column in Folha de S.Paulo<\/cite> this past Sunday (the 16th<\/sup>), are already swamping governments and courts in several countries.<\/p>\n","protected":false},"excerpt":{"rendered":"
Some people are freaking out over the news that Anthropic’s Claude will watermark text it generates. I think that: 1) whatever; 2) it seems easy to remove the watermark; and 3) people who use generative AI to write text should start owning up to their choices.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"link","meta":{"episode_type":"","audio_file":"","podmotor_file_id":"","podmotor_episode_id":"","cover_image":"","cover_image_id":"","duration":"","filesize":"","filesize_raw":"","date_recorded":"","explicit":"","block":"","itunes_episode_number":"","itunes_title":"","itunes_season_number":"","itunes_episode_type":"","_locale":"en_US","_original_post":"https:\/\/manualdousuario.net\/?p=65006"},"categories":[1575],"tags":[2306,24,593],"_links":{"self":[{"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/posts\/65010"}],"collection":[{"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/comments?post=65010"}],"version-history":[{"count":1,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/posts\/65010\/revisions"}],"predecessor-version":[{"id":65011,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/posts\/65010\/revisions\/65011"}],"wp:attachment":[{"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/media?parent=65010"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/categories?post=65010"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/manualdousuario.net\/wp-json\/wp\/v2\/tags?post=65010"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}