textGrain, a watermark that uses a secret key to generate pseudorandom values influencing which token the model suggests, creates a statistical pattern in the text that a detector with the same secret key can look for, according to Xiang Li, coauthor of the textGrain technical report and a postdoctoral researcher at the University of Pennsylvania.[1] The law requires providers of systems generating synthetic audio, images, video, or text to mark outputs in a machine-readable format so they can be detected as artificially generated or manipulated, but MindStudio questions whether the watermarking rule is effective.[1][2]

textGrain differs from other methods by budgeting entropy—the unpredictability of word choices—to balance detectability and output variation, Li said.[1]

The E.U. law requires technical solutions to be effective, interoperable, robust and reliable as far as technically feasible, according to IEEE Spectrum.[1] The E.U.’s voluntary Code of Practice does not require watermarks on outputs shorter than 200 tokens, according to IEEE Spectrum.[1]

In tests, OpenAI’s system detected watermarks in about 80 percent of 200-token passages and 95 percent of 400-token passages, IEEE Spectrum reported.[1] Replacing just 10 percent of words with synonyms reduced detection from 92 percent to 66 percent, and up to 25 percent replacement cut it to 17 percent, according to OpenAI.[1] Thomas Souverain, a postdoctoral fellow on AI Ethics at the Institute of Advanced Education in Paris, said the legislation is open to interpretation and that independent validation is lacking.[1] OpenAI is working with a limited group of researchers, including John Thickstun at Cornell and Dominik Macko at KInIT in Slovakia, but they had only just gained access and had not begun evaluation, IEEE Spectrum reported.[1]

Until independent researchers can test textGrain and the AI Act’s criteria are clarified with measurable thresholds, it is too early to say whether it meets legal requirements, IEEE Spectrum wrote.[1] AI Act went into effect on 2 August.[1]