UK cracks down on AI-fuelled child content
Sites and apps must introduce more robust measures to tackle child sexual abuse material (CSAM), under strengthened new rules set out on Monday (16 November) by telecommunications regulator Ofcom.
Platforms are already legally required, under the Online Safety Act, to assess the risk of CSAM appearing on their service and take proportionate steps to address it.
This includes content moderation, effective reporting and take-down processes, and, in certain case, using technology to identify and remove known CSAM.
But given the scale of child sexual abuse material online – made significantly worse by AI – and its truly devastating effect on victims, Ofcom said it is now requiring platforms go much further.
These include:
- Banning users who generate, upload or share child sexual exploitation and abuse content;
- Using ‘hash matching’ – a method of detection – to find and take down known CSAM on a greater number of sites and apps, including pornography sites; and
- Deploying automated tools to proactively identify and remove previously unknown CSAM on certain platforms, including all file sharing services and the biggest social media.
Subject to parliamentary process, Ofcom said it expects these new duties to come into force from early 2027.
Anti-grooming rules
Alongside these measures, Ofcom said it is setting rigorous new standards to make sure existing anti-grooming rules are implemented comprehensively, so that all accounts held by children are protected by default.
Separately, it also monitoring certain platforms and their algorithms. We are requiring services to take more precautions before recommending content to children, to help avoid them being exposed to illegal material.
Today’s announcement comes as Ofcom prepares for the UK’s social media ban next year. This will see under-16s no longer be permitted on particular platforms, in line with criteria that will be set by Government.
“While we have seen some progress from industry on tackling child sexual abuse on their platforms, we are not satisfied that enough is being done,” said Oliver Griffiths (Ofcom’s Online Safety Group Director).
“Our robust new rules announced today impose important additional legal duties on companies. And we will keep pushing platforms to do more to prevent, detect and remove this abhorrent material, report perpetrators, and shut them out for good.
“It is now for industry to step up – and any firm that doesn’t should expect to face serious consequences.”