New reports from Common Sense Media highlight the potential hazards of two prominent OpenAI tools, ChatGPT and Sora, especially concerning younger users. While the updated ChatGPT chatbot is still considered high-risk for children, Sora, an AI video creation application, has received an \"unacceptable\" rating due to its significant safety deficiencies.
Sora, an AI video generator from OpenAI, functions similarly to ChatGPT but for visual content. Users can generate highly realistic videos from text prompts and share them across various social media platforms, often with watermarks that can be easily removed or overlooked. The app's minimal content oversight poses substantial risks, allowing for the potential spread of harmful content such as material related to eating disorders, stereotypes, and dangerous activities, all presented in an engaging and appealing manner. A particularly alarming feature is the \"cameo\" function, which enables users to upload their face and voice to create AI-generated versions of themselves. This raises serious concerns about misuse, as a child's likeness could be incorporated into inappropriate or humiliating content without their consent, spreading rapidly across the internet before any preventative measures can be taken. In contrast, while ChatGPT has improved safety systems and can be a valuable learning tool when used correctly, it still presents mental health and emotional support risks, as many teenagers turn to it for companionship, an area where AI cannot provide adequate assistance.
Given the identified dangers, experts strongly advise parents to prevent their children from using Sora. For ChatGPT, careful parental oversight and explicit conversations about its appropriate use, particularly regarding emotional support, are crucial. Instead of solely relying on blocking or monitoring, open dialogue with children about online safety and making informed choices is paramount. It is essential for children to understand the lasting implications of their digital footprint and the importance of minimizing personal information online, which can impact future relationships, education, and career opportunities.
