Sam Altman singing in a toilet. James Bond playing Altman in high-stakes poker. Pikachu storming Normandy’s beaches. Mario jumping from his virtual world into real life.
Those are just some of the lifelike videos that are rocketing through the internet a day after OpenAI released Sora, an app at the intersection of social media and artificial intelligence-powered media generation. The app surged to be the most popular app in the iOS App Store’s Photo and Video category within a day of its release.
Powered by OpenAI’s upgraded Sora 2 media generation AI model, the app allows users to create high-definition videos from simple text prompts. After it processes one-time video and audio recordings of users’ likenesses, Sora allows users to embed lifelike “cameos” of themselves, their friends and others who give their permission.
The app is a recipe made for virality. But many of the videos published within the first day of Sora’s debut have also raised alarm bells from copyright and deepfake experts.
Users have so far reported being able to feature video game characters like Lara Croft or Nintendo heavyweights like Mario, Luigi and even Princess Peach in their AI creations.
One user inserted Ronald McDonald into a saucy scene from the romantic reality TV show “Love Island.”
The Wall Street Journal reported Monday that the app would enable users to feature material protected by copyright unless the copyright holders opted out of having their work appear.
However, the report said, blanket opt-outs did not appear to be an option, instead requiring copyright holders to submit examples of offending content.
Sora 2 builds on OpenAI’s original Sora model, which was released to the public in December. Unlike the original Sora, Sora 2 now enables users to create videos with matching dialogue and sound effects.
AI models ingest large swaths of information in the “training” process as they learn how to respond to users’ queries. That data forms the basis for models’ responses to future user requests. For example, Google’s Veo 3 video generation model was trained on YouTube videos, much to the dismay of some YouTube creators.
OpenAI has not clearly indicated which exact data its models draw from, but the appearance of characters under copyright indicates that it used copyright-protected information to design the Sora 2 system. China’s ByteDance and its Seedance video generation model have also attracted recent copyright scrutiny.
OpenAI faces legal action over copyright infringement claims, including a high-profile lawsuit featuring authors including Ta-Nehisi Coates and Jodi Picoult and newspapers like The New York Times. OpenAI competitor Anthropic recently agreed to pay $1.5 billion to settle claims from authors who alleged that Anthropic illegally downloaded and used their books to train its AI models.
In an interview, Mark McKenna, a law professor and the faculty director of the UCLA Institute for Technology, Law, and Policy, drew a stark line between using copyrighted data as an input to train models and generating outputs that depict copyright-protected information.
“If OpenAI is taking an aggressive approach that says they’re going to allow outputs of your copyright-protected material unless you opt out, that strikes me as not likely to work. That’s not how copyright law works. You don’t have to opt out of somebody else’s rules,” McKenna said.
“The early indications show that training AI models on legitimately acquired copyright material can be considered fair use. There’s a very different question about the outputs of these systems,” he continued. “Outputting visual material is a harder copyright question than just the training of models.”
As McKenna sees it, that approach is a calculated risk. “The opt-out is clearly a ‘move fast and break things’ mindset,” he said. “And the aggressive response by some of the studios is ‘No, we’re not going to go along with that.’”
Disney, Warner Bros. and Sony Music Entertainment did not reply to requests for comment.
In addition to copyright issues, some observers were unsettled by one of the most popular first-day creations, which depicted OpenAI CEO Sam Altman stealing valuable computer components from Target — illustrating the ease with which Sora 2 can create content depicting real people committing crimes they had not actually committed.
