UK’s ICO issues notice against Snapchat’s AI chatbot
While the United Kingdom currently lacks comprehensive legislation specifically regulating AI systems, existing laws, regulations, and oversight bodies remain vigilant. On October 6, 2023, the UK’s Information Commissioner’s Office (ICO) issued a preliminary enforcement notice against Snap, Inc., and Snap Group Limited (Snap), the parent company of the popular social media app Snapchat. The ICO’s action stems from concerns that Snap may have inadequately assessed the privacy risks associated with its “My AI” feature, particularly concerning UK users aged 13-17. Introduced in February 2023, “My AI” is a chatbot integrated into the Snapchat platform.
According to the ICO’s investigation, Snap’s initial risk assessment failed to sufficiently address the data protection risks posed by AI technology, especially in the context of minors. The enforcement notice suggests that Snap might be compelled to temporarily halt the processing of data related to “My AI” in the UK, effectively suspending the service for users in the region. However, this suspension would be temporary, contingent upon Snap conducting a comprehensive risk assessment that adequately identifies and evaluates potential harms arising from “My AI.” Once this evaluation is complete, and any necessary mitigations are implemented, the ban on data processing would be lifted.
Importantly, the ICO is not mandating a permanent suspension of “My AI” but is emphasizing the need for Snap to conduct a thorough assessment to address privacy risks before resuming its use. Snap will have an opportunity to respond to the notice before any final enforcement action is taken. The ICO underscores that this proactive stance is aimed at safeguarding consumers’ privacy rights in the UK concerning AI technology. The enforcement notice follows the ICO’s earlier publication of companies developing or utilizing generative AI systems, emphasizing their existing data protection obligations under the UK GDPR and Data Protection Act 2018.
Want to know if your company’s AI could be impacted by laws already on the books in the UK? Contact BABL AI and one of their Audit Experts will be able to answer all your questions related to this, AI audits, and more.