In a bold move against deepfake porn, Twitch has banned the practice entirely.
In a blog post, Addressing Explicit Deepfake Content, the live-streaming service now prohibits "synthetic non-consensual exploitative images," or synthetic NCEI. It is also updating its policy on sexual assault and exploitation, making it clear that users who create and distribute non-consensual deepfakes risk being permanently banned for even a single incident.
The Capability of AI Tech
The velocity at which technology is advancing is both fascinating and terrifying. Nowadays, artificial intelligence (AI) plays a significant role in everyday life, and its many applications have inspired innovative thinking. This stuff is not all bad; some are just for pleasure or learning. Yet it has also been used to harm countless individuals.
Deepfakes allow users to virtually build a digital clone of another person by layering the face of a third party over the original subject's image, as ComicBook.com explains. Although it is possible to detect these deepfakes, they have been used to make pornographic images of famous individuals, influential people, and even average people.
The topic is revolting and has recently been a talking point on Twitch.
Controversial Deepfake Porn on Twitch
A Twitch broadcaster named Atrioc was recently discovered utilizing a service that created deepfake porn of his Twitch colleagues and friends. He received harsh criticism immediately and, after issuing an apology, decided to stop live-streaming and making new videos.
Even though the site was quickly taken down, the women who had been participating continued to feel objectified and were vulnerable to additional forms of harassment as a result.
There are plenty of other places like this, so the issue is going to be around for a while. Yet Twitch is working hard to combat it and lessen its effects as much as possible.
The video-sharing website wrote an extensive blog entry on the subject, titled Addressing Explicit Deepfake Content. According to the article, these photographs are "synthetic non-consensual exploitative images," or synthetic NCEI.
The platform aims to highlight the distinction between pornography and porn deepfakes. It acknowledges that pornography is voluntary, but synthetic NCEIs are not.
Related Story : Twitch Streamer Atrioc's Deepfake Porn Controversy Sparks Wisesweeping Debate on AI Efficacy
Policy Revisions on Twitch
The good news is that many regulations have been enacted to curb its harmful effects.
In a report by ComicBook.com, the rules are being revised to clarify that they result in an indefinite ban on the first violation for anyone who knowingly promotes, creates, or shares synthetic NCEI. To the same extent, you risk legal repercussions if it is shown on stream at all, even momentarily, to convey displeasure or fury.
For obvious reasons, Twitch does not want the service to be platformed in any way, shape, or form since even unfavorable press might drive traffic to the site.
