Anthropic Accused of Citing AI ‘Hallucination’ in Song Lyrics Lawsuit – Decrypt

An AI knowledgeable at Amazon-backed agency Anthropic has been accused of citing a fabricated tutorial article in a courtroom submitting meant to defend the corporate towards claims that it skilled its AI mannequin on copyrighted track lyrics with out permission.

The submitting, submitted by Anthropic information scientist Olivia Chen, was a part of the corporate’s authorized response to a $75 million lawsuit filed by Common Music Group, Harmony, ABKCO, and different main publishers.

The publishers alleged within the 2023 lawsuit that Anthropic unlawfully used lyrics from lots of of songs, together with these by Beyoncé, The Rolling Stones, and The Seashore Boys, to coach its Claude language mannequin.

Chen’s declaration included a quotation to an article from The American Statistician, meant to assist Anthropic’s argument that Claude solely reproduces copyrighted lyrics beneath uncommon and particular circumstances, in line with a Reuters report.

Throughout a listening to Tuesday in San Jose, the plaintiffs’ legal professional Matt Oppenheim referred to as the quotation a “full fabrication,” however stated he didn’t imagine Chen deliberately made it up, solely that she probably used Claude itself to generate the supply.

Anthropic’s legal professional, Sy Damle, instructed the courtroom Chen’s error gave the impression to be a mis-citation, not a fabrication, whereas criticizing the plaintiffs for elevating the difficulty late within the proceedings.

Per Reuters, U.S. Justice of the Peace Decide Susan van Keulen stated the difficulty posed “a really severe and grave” concern, noting that “there’s a world of distinction between a missed quotation and a hallucination generated by AI.”

She declined a request to right away query Chen, however ordered Anthropic to formally reply to the allegation by Thursday.

Anthropic didn’t instantly reply to Decrypt’s request for remark.

Anthropic in courtroom

The lawsuit towards Anthropic was filed in October 2023, with the plaintiffs accusing Anthropic’s Claude mannequin of being skilled on an enormous quantity of copyrighted lyrics and reproducing them on demand.

They demanded damages, disclosure of the coaching set, and the destruction of infringing content material.

Anthropic responded in January 2024, denying that its techniques had been designed to output copyrighted lyrics.

It referred to as any such replica a “uncommon bug” and accused the publishers of providing no proof that typical customers encountered infringing content material.

In August 2024, the corporate was hit with one other lawsuit, this time from authors Andrea Bartz, Charles Graeber, and Kirk Wallace Johnson, who accused Anthropic of coaching Claude on pirated variations of their books.

GenAI and copyright

The case is a part of a rising backlash towards generative AI corporations accused of feeding copyrighted materials into coaching datasets with out consent.

OpenAI is dealing with a number of lawsuits from comic Sarah Silverman, the Authors Guild, and The New York Occasions, accusing the corporate of utilizing copyrighted books and articles to coach its GPT fashions with out permission or licenses.

Meta is known as in related fits, with plaintiffs alleging that its LLaMA fashions had been skilled on unlicensed literary works sourced from pirated datasets.

In the meantime, in March, OpenAI and Google urged the Trump administration to ease copyright restrictions round AI coaching, calling them a barrier to innovation of their formal proposals for the upcoming U.S. “AI Motion Plan.”

Within the UK, a authorities invoice that may allow synthetic intelligence companies to make use of copyright-protected work with out permission hit a roadblock this week, after the Home of Lords backed an modification requiring AI companies to disclose what copyrighted materials they’ve used of their fashions.