AI model preview image
The ControlNet model is a diffusion-based model that generates images from text descriptions. It uses a two-step process to first generate a semantic layout from the text and then synthesizes the image based on the layout. The model is trained on a large dataset of paired text and image examples to learn the relationship between text and visual content. It allows for fine-grained control over the image generation process by conditioning the synthesis on specific attributes or features mentioned in the text. ControlNet can be used in various applications such as image generation from captions or enhancing existing images with specific features described in text.

Use cases

ControlNet has numerous potential use cases in various domains. In the field of creative arts, it could be used to automatically generate visuals for storytelling or video game environments based on textual descriptions. In the fashion industry, it could assist designers by creating realistic images of clothing designs from text descriptions. In e-commerce, it could enable users to search for products using natural language descriptions and generate images of the desired items. Furthermore, ControlNet could be integrated into virtual reality or augmented reality systems to generate realistic virtual scenes based on textual input. Overall, this AI model has the potential to power a wide range of products and applications that require the conversion of text into visually meaningful content.



Cost per run
Avg run time
Nvidia A100 (40GB) GPU

Creator Models

Controlnet_2 1$?11,665
Controlnet_1 1$?7,866
Controlnet Canny$0.013861
Controlnet_​1 1$?0
Controlnet_​2 1$?0

Similar Models

Try it!

You can use this area to play around with demo applications that incorporate the Controlnet model. These demos are maintained and hosted externally by third-party creators. If you see an error, message me on Twitter.

Currently, there are no demos available for this model.


Summary of this model and related resources.

Model NameControlnet
Control diffusion models
Model LinkView on Replicate
API SpecView on Replicate
Github LinkView on Github
Paper LinkView on Arxiv


How popular is this model, by number of runs? How popular is the creator, by the sum of all their runs?

Model Rank
Creator Rank


How much does it cost to run this model? How long, on average, does it take to complete a run?

Cost per Run$0.0115
Prediction HardwareNvidia A100 (40GB) GPU
Average Completion Time5 seconds