Online spaces are rife with toxicity. Well-designed AI tools can help clean them up
Online spaces are rife with toxicity. Well-designed AI tools can help clean them up
Online spaces are rife with toxicity. Well-designed AI tools can help clean them up
Lucy Sparrow, Eduardo Oliveira, Mahli-Ann Butt
September, 29, 2024
Summary
AI tools like ToxMod and Bodyguard.ai are being used to detect and remove online abuse in real time, aiming to create safer digital spaces. While these AI systems can help combat online toxicity, including in games and social media, their effectiveness depends on ensuring transparency, privacy, and fairness. Research on AI moderation, such as the GAIM project, shows its potential but highlights concerns over privacy, confusion around punishments, and lack of user understanding. The AI Ally initiative, designed to help those facing gendered harassment, demonstrates how AI can empower users with control over moderation while maintaining safety and transparency.
Reference
Sparrow, L., Oliveira, E., & Butt, M.-A. (2024, September 29). Online spaces are rife with toxicity. Well-designed AI tools can help clean them up. The Conversation. https://theconversation.com/online-spaces-are-rife-with-toxicity-well-designed-ai-tools-can-help-clean-them-up-239590