Dear Commons Community,

OpenAI has unveiled a new system called Sora that creates videos that look as if they were lifted from a Hollywood movie. A demonstration included short videos (see demos below) — created in minutes from short descriptions — of woolly mammoths trotting through a snowy meadow, a Tokyo street scene seemingly shot by a camera swooping across the city, and a fuzzy character gazing at a melting candle.

OpenAI, the company behind the ChatGPT chatbot and the still-image generator DALL-E, is among the many companies racing to improve this kind of instant video generator, including start-ups like Runway and tech giants like Google and Meta, the owner of Facebook and Instagram. The technology could speed the work of seasoned moviemakers, while replacing less experienced digital artists entirely.

It could also become a quick and inexpensive way of creating online disinformation, making it even harder to tell what’s real on the internet.  As reported by The New York Times.

“I am absolutely terrified that this kind of thing will sway a narrowly contested election,” said Oren Etzioni, a professor at the University of Washington who specializes in artificial intelligence. He is also the founder of True Media, a nonprofit working to identify disinformation online in political campaigns.

OpenAI calls its new system Sora, after the Japanese word for sky. The team behind the technology, including the researchers Tim Brooks and Bill Peebles, chose the name because it “evokes the idea of limitless creative potential.”

In an interview, they also said the company was not yet releasing Sora to the public because it was still working to understand the system’s dangers. Instead, OpenAI is sharing the technology with a small group of academics and other outside researchers who will “red team” it, a term for looking for ways it can be misused.

“The intention here is to give a preview of what is on the horizon, so that people can see the capabilities of this technology — and we can get feedback,” Dr. Brooks said.

OpenAI is already tagging videos produced by the system with watermarks that identify them as being generated by A.I. But the company acknowledges that these can be removed. They can also be difficult to spot. 

The system is an example of generative A.I., which can instantly create text, images and sounds. Like other generative A.I. technologies, OpenAI’s system learns by analyzing digital data — in this case, videos and captions describing what those videos contain.

OpenAI declined to say how many videos the system learned from or where they came from, except to say the training included both publicly available videos and videos that were licensed from copyright holders. The company says little about the data used to train its technologies, most likely because it wants to maintain an advantage over competitors — and has been sued multiple times for using copyrighted material.(The New York Times sued OpenAI and its partner, Microsoft, in December, claiming copyright infringement of news content related to A.I. systems.)

Very impressive technology.  While I would like to think it can be controlled.  I don’t think it will!

Tony

This video’s A.I. prompt: “Several giant wooly mammoths approach treading through a snowy meadow, their long wooly fur lightly blows in the wind as they walk, snow covered trees and dramatic snow capped mountains in the distance, mid afternoon light with wispy clouds and a sun high in the distance creates a warm glow, the low camera view is stunning capturing the large furry mammal with beautiful photography, depth of field.”CreditCredit…Video by OpenAI

This video’s A.I. prompt: “Beautiful, snowy Tokyo city is bustling. The camera moves through the bustling city street, following several people enjoying the beautiful snowy weather and shopping at nearby stalls. Gorgeous sakura petals are flying through the wind along with snowflakes.”CreditCredit…Video by OpenAI

This video’s A.I. prompt: “Animated scene features a close-up of a short fluffy monster kneeling beside a melting red candle. The art style is 3D and realistic, with a focus on lighting and texture. The mood of the painting is one of wonder and curiosity, as the monster gazes at the flame with wide eyes and open mouth. Its pose and expression convey a sense of innocence and playfulness, as if it is exploring the world around it for the first time. The use of warm colors and dramatic lighting further enhances the cozy atmosphere of the image.”CreditCredit…Video by OpenAI

This entry is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license.