yangchen123321 commited on
Commit
4295eb5
·
verified ·
1 Parent(s): 1cde70b

End of training

Browse files
README.md ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: stabilityai/stable-diffusion-3-medium-diffusers
3
+ library_name: diffusers
4
+ license: other
5
+ instance_prompt: 'Close-up of a high-voltage transmission line with steel-reinforced
6
+ aluminum conductor over mountainous or forested terrain. The conductor shows a broken-strand
7
+ defect: multiple aluminum strands fractured, loosened, and protruding, appearing
8
+ frayed with exposed metallic ends, contrasting with intact twisted strands. Realistic
9
+ industrial inspection photo, high resolution, sharp focus.'
10
+ widget: []
11
+ tags:
12
+ - text-to-image
13
+ - diffusers-training
14
+ - diffusers
15
+ - lora
16
+ - template:sd-lora
17
+ - sd3
18
+ - sd3-diffusers
19
+ ---
20
+
21
+ <!-- This model card has been generated automatically according to the information the training script had access to. You
22
+ should probably proofread and complete it, then remove this comment. -->
23
+
24
+
25
+ # SD3 DreamBooth LoRA - yangchen123321/lora-trained-sd3-dx_dg
26
+
27
+ <Gallery />
28
+
29
+ ## Model description
30
+
31
+ These are yangchen123321/lora-trained-sd3-dx_dg DreamBooth LoRA weights for stabilityai/stable-diffusion-3-medium-diffusers.
32
+
33
+ The weights were trained using [DreamBooth](https://dreambooth.github.io/) with the [SD3 diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/dreambooth/README_sd3.md).
34
+
35
+ Was LoRA for the text encoder enabled? False.
36
+
37
+ ## Trigger words
38
+
39
+ You should use `Close-up of a high-voltage transmission line with steel-reinforced aluminum conductor over mountainous or forested terrain. The conductor shows a broken-strand defect: multiple aluminum strands fractured, loosened, and protruding, appearing frayed with exposed metallic ends, contrasting with intact twisted strands. Realistic industrial inspection photo, high resolution, sharp focus.` to trigger the image generation.
40
+
41
+ ## Download model
42
+
43
+ [Download the *.safetensors LoRA](yangchen123321/lora-trained-sd3-dx_dg/tree/main) in the Files & versions tab.
44
+
45
+ ## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
46
+
47
+ ```py
48
+ from diffusers import AutoPipelineForText2Image
49
+ import torch
50
+ pipeline = AutoPipelineForText2Image.from_pretrained(stabilityai/stable-diffusion-3-medium-diffusers, torch_dtype=torch.float16).to('cuda')
51
+ pipeline.load_lora_weights('yangchen123321/lora-trained-sd3-dx_dg', weight_name='pytorch_lora_weights.safetensors')
52
+ image = pipeline('Close-up of a high-voltage transmission line with steel-reinforced aluminum conductor over mountainous or forested terrain. The conductor shows a broken-strand defect: multiple aluminum strands fractured, loosened, and protruding, appearing frayed with exposed metallic ends, contrasting with intact twisted strands. Realistic industrial inspection photo, high resolution, sharp focus.').images[0]
53
+ ```
54
+
55
+ ### Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke
56
+
57
+ - **LoRA**: download **[`diffusers_lora_weights.safetensors` here 💾](/yangchen123321/lora-trained-sd3-dx_dg/blob/main/diffusers_lora_weights.safetensors)**.
58
+ - Rename it and place it on your `models/Lora` folder.
59
+ - On AUTOMATIC1111, load the LoRA by adding `<lora:your_new_name:1>` to your prompt. On ComfyUI just [load it as a regular LoRA](https://comfyanonymous.github.io/ComfyUI_examples/lora/).
60
+
61
+ For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
62
+
63
+ ## License
64
+
65
+ Please adhere to the licensing terms as described [here](https://huggingface.co/stabilityai/stable-diffusion-3-medium/blob/main/LICENSE.md).
66
+
67
+
68
+ ## Intended uses & limitations
69
+
70
+ #### How to use
71
+
72
+ ```python
73
+ # TODO: add an example code snippet for running this diffusion pipeline
74
+ ```
75
+
76
+ #### Limitations and bias
77
+
78
+ [TODO: provide examples of latent issues and potential remediations]
79
+
80
+ ## Training details
81
+
82
+ [TODO: describe the data used to train the model]
checkpoint-500/optimizer.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2d0650fe980c8fa4f86541593a81de84af8045a8264715123ac48ada8c80522
3
+ size 5189981
checkpoint-500/pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98e28b30d23a8a3f504613edc5d0752dcbc22a284a6ea1fdcbfcc149aef7454f
3
+ size 9437288
checkpoint-500/random_states_0.pkl ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:182cda4571e8c26950b1792cdcea9b389694bc12fd15b929a19e12e16705c22d
3
+ size 14757
checkpoint-500/scaler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f77569c2e850b04af982cc8c1389f1430851448915c593b69e5da36ce05b71d7
3
+ size 1383
checkpoint-500/scheduler.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8355bf0c65725d6402a14a4b7783f0085b275f5230eb72329b15a133a493e485
3
+ size 1401
logs/dreambooth-sd3-lora/1766478628.3750427/events.out.tfevents.1766478628.nb-a18168285635276800717961-a18168285635276800717961-0.9423.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d22cbaa8979042c7c3dc48faca962d421095da01a1c152729534bef2fd4f2e52
3
+ size 4198
logs/dreambooth-sd3-lora/1766478628.4530613/hparams.yml ADDED
@@ -0,0 +1,83 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ adam_beta1: 0.9
2
+ adam_beta2: 0.999
3
+ adam_epsilon: 1.0e-08
4
+ adam_weight_decay: 0.0001
5
+ adam_weight_decay_text_encoder: 0.001
6
+ allow_tf32: false
7
+ cache_dir: null
8
+ cache_latents: false
9
+ caption_column: null
10
+ center_crop: false
11
+ checkpointing_steps: 500
12
+ checkpoints_total_limit: null
13
+ class_data_dir: null
14
+ class_prompt: null
15
+ dataloader_num_workers: 0
16
+ dataset_config_name: null
17
+ dataset_name: null
18
+ gradient_accumulation_steps: 4
19
+ gradient_checkpointing: false
20
+ hub_model_id: null
21
+ hub_token: null
22
+ image_column: image
23
+ instance_data_dir: /input/yangchen/torch_learn/project/yc_graduate/diffusers/datasets/dx_dg_new/images
24
+ instance_prompt: 'Close-up of a high-voltage transmission line with steel-reinforced
25
+ aluminum conductor over mountainous or forested terrain. The conductor shows a broken-strand
26
+ defect: multiple aluminum strands fractured, loosened, and protruding, appearing
27
+ frayed with exposed metallic ends, contrasting with intact twisted strands. Realistic
28
+ industrial inspection photo, high resolution, sharp focus.'
29
+ learning_rate: 0.0001
30
+ local_rank: -1
31
+ logging_dir: logs
32
+ logit_mean: 0.0
33
+ logit_std: 1.0
34
+ lora_blocks: null
35
+ lora_dropout: 0.0
36
+ lora_layers: null
37
+ lr_num_cycles: 1
38
+ lr_power: 1.0
39
+ lr_scheduler: constant
40
+ lr_warmup_steps: 0
41
+ max_grad_norm: 1.0
42
+ max_sequence_length: 77
43
+ max_train_steps: 500
44
+ mixed_precision: fp16
45
+ mode_scale: 1.29
46
+ num_class_images: 100
47
+ num_train_epochs: 250
48
+ num_validation_images: 4
49
+ optimizer: AdamW
50
+ output_dir: lora-trained-sd3-dx_dg
51
+ precondition_outputs: 1
52
+ pretrained_model_name_or_path: stabilityai/stable-diffusion-3-medium-diffusers
53
+ prior_generation_precision: null
54
+ prior_loss_weight: 1.0
55
+ prodigy_beta3: null
56
+ prodigy_decouple: true
57
+ prodigy_safeguard_warmup: true
58
+ prodigy_use_bias_correction: true
59
+ push_to_hub: false
60
+ random_flip: false
61
+ rank: 4
62
+ repeats: 1
63
+ report_to: tensorboard
64
+ resolution: 256
65
+ resume_from_checkpoint: null
66
+ revision: null
67
+ sample_batch_size: 4
68
+ scale_lr: false
69
+ seed: 0
70
+ text_encoder_lr: 5.0e-06
71
+ train_batch_size: 1
72
+ train_text_encoder: false
73
+ upcast_before_saving: false
74
+ use_8bit_adam: false
75
+ validation_epochs: 25
76
+ validation_prompt: 'Close-up of a high-voltage transmission line with steel-reinforced
77
+ aluminum conductor over mountainous or forested terrain. The conductor shows a broken-strand
78
+ defect: multiple aluminum strands fractured, loosened, and protruding, appearing
79
+ frayed with exposed metallic ends, contrasting with intact twisted strands. Realistic
80
+ industrial inspection photo, high resolution, sharp focus.'
81
+ variant: null
82
+ weighting_scheme: logit_normal
83
+ with_prior_preservation: false
logs/dreambooth-sd3-lora/events.out.tfevents.1766478628.nb-a18168285635276800717961-a18168285635276800717961-0.9423.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e178281922b7afc27aff41972fd106af8be9c5d9080c24cfc5583f6e2faa7544
3
+ size 568
pytorch_lora_weights.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4df1c551cb9d6b4908b1b590b6cdf31aaa3dc5b4541e15cc9f8f944a288d9890
3
+ size 4743176