Sync from GitHub
Browse files
app.py
CHANGED
@@ -100,6 +100,11 @@ with gr.Blocks(theme=gr.themes.Soft()) as demo:
|
|
100 |
- Try to be as specific as possible about your local machine.
|
101 |
- As a rule of thumb, GPUs from RTX 4090 and later, are generally good for using `torch.compile()`.
|
102 |
- To leverage FP8, the GPU needs to have a compute capability of at least 8.9.
|
|
|
|
|
|
|
|
|
|
|
103 |
"""
|
104 |
)
|
105 |
|
|
|
100 |
- Try to be as specific as possible about your local machine.
|
101 |
- As a rule of thumb, GPUs from RTX 4090 and later, are generally good for using `torch.compile()`.
|
102 |
- To leverage FP8, the GPU needs to have a compute capability of at least 8.9.
|
103 |
+
- Check out the following docs for optimization in Diffusers:
|
104 |
+
* [Memory](https://huggingface.co/docs/diffusers/main/en/optimization/memory)
|
105 |
+
* [Caching](https://huggingface.co/docs/diffusers/main/en/optimization/cache)
|
106 |
+
* [Inference acceleration](https://huggingface.co/docs/diffusers/main/en/optimization/fp16)
|
107 |
+
* [PyTorch blog](https://pytorch.org/blog/presenting-flux-fast-making-flux-go-brrr-on-h100s/)
|
108 |
"""
|
109 |
)
|
110 |
|