Expert warns learners about the dangers of AI-generated fake nudes

The use of Artificial Intelligence (AI) in schools has spiralled out of control, with 18 schools reporting incidents within just one week. Learners are reportedly using AI to create and share fake explicit nude images of their peers. 

This alarming trend came to light following a video by Emma Sadleir from The Digital Law Company, who revealed on Instagram that she has received numerous enquiries regarding the circulation of about fake pornographic images among learners.

Sadleir explained: “I’ve just got off the phone with a principal at a school, usual issue. I think it’s the eighteenth of this week, where we have had frantic enquiries from parents, from kids, from principals to say that AI is being used in super nefarious ways at the school.

“So, this case is the same as many cases that I’ve dealt with in other places, and that is that kids at the school have created fake pictures of girls.

“So taken sweet innocent pictures of them from social media platforms, used AI technologies to turn them into deep fake pornographic pictures and then they’ve been sharing them on various platforms.”

Last year, the Western Cape Education Department confirmed that a similar case was allegedly happening at Vredendal High School on the West Coast, where parents opened police cases after pictures of girls' faces were allegedly photoshopped onto nude pictures using AI and circulated in the school.

Sadleir added that this is a serious offence and criminal capacity in South Africa starts at the age of 14 years.

She added: "If you commit a criminal offence and you are 14 years and older, you are going to be arrested, you are going to be charged. You are going to have to face a whole court process. From a civil point of view, you could be sued from seven years old in South Africa. So, we are looking at pretty serious legal stuff.

In terms of the criminal offences that have been committed, if the child is under the age of 18, the creation of child pornography, distribution of child pornography, the law doesn't care whether it is fake or real.

“These are very serious criminal offences, and I am afraid kids are getting arrested left, right and centre for these crimes.”

Get your news on the go, click here to join the Cape Argus News WhatsApp channel.

Cape Argus