%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%23061b40;%20}%20.st1%20{%20fill:%20%23306af1;%20}%20.st2%20{%20fill:%20%235ce5cf;%20}%20%3c/style%3e%3c/defs%3e%3cg%3e%3cpath%20class='st0'%20d='M55,10.5h9v3h-9v9h12V7.5h-12v3ZM64,19.5h-6v-3h6v3Z'/%3e%3cpolygon%20class='st0'%20points='69%2016.5%2078%2016.5%2078%2019.5%2069%2019.5%2069%2022.5%2081%2022.5%2081%2013.5%2072%2013.5%2072%2010.5%2081%2010.5%2081%207.5%2069%207.5%2069%2016.5'/%3e%3cpolygon%20class='st0'%20points='95%2010.5%2095%207.5%2083%207.5%2083%2022.5%2095%2022.5%2095%2019.5%2086%2019.5%2086%2016.5%2095%2016.5%2095%2013.5%2086%2013.5%2086%2010.5%2095%2010.5'/%3e%3cpath%20class='st0'%20d='M40,1.5v21h11.6l1.4-1.4v-7.6h0c0,0-1.4-1.5-1.4-1.5l1.4-1.4V2.9l-1.4-1.4h-11.6ZM50,19.5h-7v-6h7v6ZM50,10.5h-7v-6h7v6Z'/%3e%3c/g%3e%3cpath%20class='st1'%20d='M23.1,24L14.7,4.8l-4.9,11.2h3.8l-1.8,4H3.3L12.1,0H2C.9,0,0,.9,0,2v20c0,1.1.9,2,2,2h21.1Z'/%3e%3cpath%20class='st2'%20d='M34,0h-16.8l10.6,24h6.2c1.1,0,2-.9,2-2V2C36,.9,35.1,0,34,0ZM32.5,20h-4V4h4v16Z'/%3e%3c/svg%3e)
Omni Moderation Latest
Overview :
The omni-moderation-latest model is a next-generation multimodal content moderation system built on GPT-4o. It offers improved accuracy in detecting harmful information in both text and image content, aiding developers in building more robust moderation systems. This model supports both text and image inputs and demonstrates enhanced accuracy, particularly in non-English languages. It can assess whether content falls under categories such as hate speech, violence, and self-harm while providing more nuanced moderation decision controls. Additionally, it offers probability scores to reflect the likelihood of content matching detected categories. This model is freely available to all developers, aiming to help them benefit from the latest research and investments in safety systems.
Target Users :
The target audience includes social media platforms, productivity tools, generative AI platforms, and others looking to build safer products to protect users. For instance, Grammarly uses this API to ensure the safety and fairness of its AI communication assistance products; ElevenLabs utilizes the API to scan content generated by its audio AI products to prevent and flag policy violations.
Use Cases
Grammarly uses this API to ensure the safety and fairness of its AI communication assistance products.
ElevenLabs utilizes this API to scan content produced by its audio AI products to prevent and flag policy violations.
Other companies leverage this API to build safer products that protect users from harmful content.
Features
Supports multimodal harmful content classification for text and image inputs
Introduces two new harmful content categories: Illegal and Violent Illegal content (text only)
Enhances detection accuracy for non-English content, supporting 40 languages
Improves detection performance by 70% for low-resource languages (e.g., Khmer or Swahili)
Provides calibrated scores that more accurately reflect the likelihood of content violating relevant policies
Available for all developers free of charge, with rate limits across different usage tiers
How to Use
Visit the OpenAI Moderation API documentation page
%20--%3e%3cdefs%3e%3cstyle%3e%20.st0%20{%20fill:%20%230080ff;%20}%20%3c/style%3e%3c/defs%3e%3cpath%20class='st0'%20d='M16.2,11.1c.4.5.4,1.2,0,1.8l-4.7,7.1h-3.8l5.3-8L7.6,4h3.8l4.7,7.1Z'/%3e%3c/svg%3e)
Register and obtain an API key
Read the documentation to understand how to send text or image content for review
Write code according to the API documentation to call the omni-moderation-latest model
Send content to the API and receive moderation results
Analyze the returned moderation results, including categories and probability scores
Take appropriate content moderation actions based on the review results
Featured AI Tools
AI Content Detector
AI Content Detector is an enterprise-grade tool for verifying whether text content was generated by artificial intelligence. It can help users determine if the content they are reading was created by a human or an AI, including ChatGPT.
AI content detection
288.4K
Chat GPT Anti Censorship
This plugin prevents text content within Chat GPT from being censored or blocked. It can hide censorship warnings and prevent content from being flagged as violating policy.
AI content detection
258.6K