AI-generated content is becoming a nuisance to some people. These days, it's getting harder to identify what's real and what's fake.
Recently, authorities started to investigate how the AI fake nude photos of some students made rounds on group chats. This alarmed many parents about the safety of their children.
Disturbing Situation Sparks Controversy
According to LondonNewsToday.ca, St. Thomas Aquinas Catholic Secondary School notified the parents of students involved in the latest incident.
In a letter, the school's administrators said that for the past several days, there have been reports that some of the students' pictures have been seen on social media sites.
The alarming part of the announcement says that AI has manipulated the photos. The letter says that the photos are not real, but they are concerning since the students appear to be nude.
"As you can imagine, this is a very difficult and challenging situation for our young students and can have lasting adverse effects for them," administrators of the west London school wrote to parents.
The school adds that those people who continue sharing explicit and fake images of nude students should be aware of the harmful consequences that the children and the community will face.
It was discovered that the nude AI photos were being shared in group chats, prompting the administrators to urge the people to be accountable for their actions.
"The creation and distribution of this material could result in disciplinary measures," they added.
Related Article: Australia's Tasmania Makes First Ever Conviction for AI-Generated Child Abuse Material
Dangers of AI and Social Media
Using social media responsibly is always the proper approach when using apps. It comes with awareness and acknowledgment that the present dangers are almost digital.
Because of the recent incident that affected some students, the school officials and the London District Catholic School Board told the parents to be more open in communicating the potential dangers of using AI and social media.
It's noteworthy to mention that parents should also teach their children to refrain from sharing malicious images online, as this might affect the person's reputation.
According to Sandasha Bough, the Acting Sergeant in the case, the police have been made aware of the case. The investigation is currently ongoing on where the AI-generated fake nude photos started and who is the culprit behind them.
What happened to the Canadian school is only one of a few incidents in which AI can be harmful when used irresponsibly.
For instance, the middle schoolers of Beverly Hills Schools also experienced the same kind of trauma with AI-generated nude images. Upon learning about the incident, the city's police department immediately investigated how the production and distribution of AI-generated pictures had started.
