add readme

README.md

@@ -91,6 +91,34 @@ Which should give you an image like below:
 
 ![A girl sitting in a cafe](sample_result.png)
 
+### Using Controlnets in Diffusers
+
+Make sure you upgrade to the latest diffusers version: `pip install -U diffusers`. And then you can run:
+
+```python
+import torch
+from diffusers import StableDiffusion3ControlNetPipeline, SD3ControlNetModel
+from diffusers.utils import load_image
+
+controlnet = SD3ControlNetModel.from_pretrained("stabilityai/stable-diffusion-3.5-large-controlnet-depth", torch_dtype=torch.float16)
+pipe = StableDiffusion3ControlNetPipeline.from_pretrained(
+    "stabilityai/stable-diffusion-3.5-large",
+    controlnet=controlnet,
+    torch_dtype=torch.float16,
+).to("cuda")
+
+control_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/marigold/marigold_einstein_lcm_depth.png")
+generator = torch.Generator(device="cpu").manual_seed(0)
+image = pipe(
+    prompt = "a photo of a man", 
+    control_image=control_image, 
+    guidance_scale=4.5,
+    num_inference_steps=40,
+    generator=generator,
+    max_sequence_length=77,
+).images[0]
+image.save('depth-8b.jpg')
+```
 
 ### Preprocessing