Artificial intelligence leader OpenAI introduced a new AI model called Sora which it claims can create 鈥渞ealistic鈥� and 鈥渋maginative鈥� 60-second videos from quick text prompts.
In a blog post on Wednesday, the company said is capable of generating videos up to 60 seconds in length from text instructions, with the ability to serve up scenes with multiple characters, specific types of motion, and detailed background details.
鈥淭he model understands not only what the user has asked for in the prompt, but also how those things exist in the physical world,鈥� the blog post said.
OpenAI said it intends to train the AI models so it can 鈥渉elp people solve problems that require real-world interaction.鈥�
This is the latest effort from the company behind the viral chatbot ChatGPT, which continues to push the generative AI movement forward. Although 鈥渕ulti-modal models鈥� are not new and text-to-video models already exist, what sets this apart is the length and accuracy that OpenAI claims Sora to have, according to Reece Hayden, a senior analyst at market research firm ABI Research.
Hayden said these types of AI models could have a big impact on digital entertainment markets with new personalized content being streamed across channels.
鈥淥ne obvious use case is within TV; creating short scenes to support narratives,鈥� Hayden said. 鈥淭he model is still limited though, but it shows the direction of the market.鈥�
At the same time, OpenAI said Sora is still a work in progress with clear 鈥渨eaknesses,鈥� particularly when it comes to spatial details of a prompt 鈥� mixing up left and right 鈥� and cause and effect. It gave the example of creating a video of someone taking a bite out of a cookie but it not having a bite mark right after.
For now, OpenAI鈥檚 messaging remains focused on safety. The company said it plans to work with a team of experts to test the latest model and look closely at various areas including misinformation, hateful content and bias. The company said it is also building tools to help detect misleading information.
Sora will first be made available to cybersecurity professors, called 鈥渞ed teamers,鈥� who can assess the product for harms or risks. It is also granting access to a number of visual artists, designers and filmmakers to collect feedback on how creative professionals could use it.
The latest update comes as OpenAI continues to advance ChatGPT.
Earlier this week, the company said it is in which users can control ChatGPT鈥檚 memory, allowing them to ask the platform to remember chats to make future conversations more personalized or tell it to forget what was previously discussed.
