Microsoft Azure AI Content Safety is Here
Microsoft just announced yesterday the general availability of its Azure AI Content Safety. This is a brand a new service from Microsoft that helps users detect and filter harmful artificial intelligence (AI) and user generated content across applications and services.
This service is unique because it includes both text and image detection. It can analyze both for any terms that Microsoft deems offensive, risky, or undesirable including profanity, adult only content, violence, racism, etc. It can manage multiple languages and content categories also. It applies a severity metric based on a scale ranging from 0-7.
- 0-1 deemed safe and appropriate for all
- 2-3 expresses prejudiced, judgmental, or opinionated views
- 4-5 is labeled medium severity and contains offensive, insulting, mocking, intimidated language or explicit attacks against identity groups
- 6-7 is high severity content which contains harmful and explicit promotion of harmful acts or endorses or glorifies extreme forms of harmful activity towards identity groups.
Azure AI Content Safety offers image features that use AI algorithms to scan, analyze, and moderate visual content, which is cool and something we have not seen a lot of. This is what Microsoft deems 360-degree comprehensive safety measures.
“By focusing on content safety, we can create a safer digital environment that promotes responsible use of AI and safeguards the well-being of individuals and society as a whole,” wrote Louise Han, product manager for Azure Anomaly Detector, in the blog post announcing the launch. “When it comes to online safety, it is crucial to consider more than just human-generated content, especially as AI-generated content becomes prevalent, ensuring the accuracy, reliability, and absence of harmful or inappropriate materials in AI-generated outputs is essential. Content safety not only protects users from misinformation and potential harm but also upholds ethical standards and builds trust in AI technologies.”
Azure AI Content Safety is priced on a pay-as-you-go basis.