OpenAI, under increasing pressure from activists and concerned parents, has established a dedicated team to explore strategies aimed at preventing the misuse or abuse of its AI tools by children. This move comes amidst growing awareness of the negative impact of AI, with studies revealing instances of GenAI being utilized in harmful ways by youngsters. For instance, surveys such as the one conducted by the U.K. Safer Internet Centre indicate that a significant portion of children (53%) have encountered instances where GenAI was employed to propagate false information or create distressing images.

In an effort to address these concerns and provide guidance to educators, OpenAI released documentation in September outlining the use of its ChatGPT model in classrooms. The materials include prompts and frequently asked questions (FAQs) to assist teachers in utilizing GenAI as an educational tool. Notably, OpenAI acknowledged the potential for its tools, particularly ChatGPT, to generate content unsuitable for certain audiences or age groups, advising caution, even for children meeting the age requirements.

The demand for comprehensive guidelines regarding the use of GenAI among minors continues to escalate. UNESCO, the United Nations Educational, Scientific and Cultural Organization, has called upon governments to regulate the integration of GenAI into educational settings. This includes proposing age restrictions for users and implementing measures to safeguard data protection and user privacy. Audrey Azoulay, UNESCO's director-general, emphasized the dual nature of Generative AI, highlighting its potential for both advancement and harm, underscoring the necessity for public engagement and governmental regulations to ensure its responsible integration into education.