Get a weekly rundown of the latest AI models and research... subscribe! https://aimodels.substack.com/

Prompt Classifier

fofr

๐Ÿ“‰

The model, prompt-classifier, is a text-to-text model that analyzes the toxicity of text-to-image prompts. Based on a fine-tuned version of the llama-13b model, it assigns a safety ranking between 0 (safe) and 10 (toxic). The model requires certain parameters such as "top_k", "top_p", "prompt", "temperature", "max_new_tokens", "min_new_tokens", and "stop_sequences". It returns a safety ranking for the prompt.

Use cases

The "prompt-classifier" AI model plays a significant role in determining the toxicity of text-to-image prompts, making it an excellent tool for enhancing online communication and interaction safety. A crucial application could be in social media platforms, where this model can be integrated to automatically assess and classify the toxicity of text prompts used in comment sections or personal messages, thus adding a layer of security against online harassment or abuse. Similarly, it can be used in various online forums, blog comment sections, and even in the fast-growing field of online education to moderate interactions between students. From a business standpoint, this model can be turned into a product for companies providing online community platforms, paving the way for safer online communication. It can also be applied in AI content generating systems to prevent the creation of offensive or toxic content. With an adjustable safety scale from 0 to 10, this model provides flexibility in determining what level of language is acceptable in different contexts.

Pricing

Cost per run
$-
USD
Avg run time
-
Seconds
Hardware
-
Prediction

Creator Models

ModelCostRuns
Sdxl Santa Hat$?475
Star Trek Adventure$0.0483154
Sdxl Dots$?167
Sdxl Cats Movie$?479
Sdxl Barbietron$?1,285

Similar Models

Model
No similar models found

Try it!

You can use this area to play around with demo applications that incorporate the Prompt Classifier model. These demos are maintained and hosted externally by third-party creators. If you see an error, message me on Twitter.

Currently, there are no demos available for this model.

Overview

Summary of this model and related resources.

PropertyValue
Creatorfofr
Model NamePrompt Classifier
Description

Determines the toxicity of text to image prompts, llama-13b fine-tune. [SAF...

Read more ยป
Tags
Model LinkView on Replicate
API SpecView on Replicate
Github LinkNo Github link provided
Paper LinkNo paper link provided

Popularity

How popular is this model, by number of runs? How popular is the creator, by the sum of all their runs?

PropertyValue
Runs1,477,713
Model Rank
Creator Rank

Cost

How much does it cost to run this model? How long, on average, does it take to complete a run?

PropertyValue
Cost per Run$-
Prediction Hardware-
Average Completion Time-