wan-gguf / README.md
calcuis's picture
Update README.md
ec069a7 verified
metadata
license: apache-2.0
language:
  - en
base_model:
  - Comfy-Org/Wan_2.1_ComfyUI_repackaged
pipeline_tag: text-to-video
tags:
  - gguf-connector
  - gguf-node
widget:
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00007_.webp
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00009_.webp
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00003_.webp
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00004_.webp
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00005_.webp
  - text: >-
      a pig moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00006_.webp
  - text: >-
      a fox moving quickly in a beautiful winter scenery nature trees sunset
      tracking camera
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00002_.webp
  - text: >-
      a cute anime girl with massive fennec ears and a big fluffy tail wearing a
      maid outfit turning around
    parameters:
      negative_prompt: blurry ugly bad
    output:
      url: samples\ComfyUI_00008_.webp
  - text: glass flower blossom
    output:
      url: samples\ComfyUI_00010_.webp
  - text: >-
      An icicle dragon lunges forward, mouth wide open to exhale a stream of icy
      mist. Ultramarine energy flickers beneath its frost-coated scales as it
      twists. The camera circles slowly, capturing the swirling ice particles
      and the backdrop of floating glaciers and frozen nebulae under a cyan-blue
      filter.
    parameters:
      negative_prompt: bad quality, blurry, messy, chaotic
    output:
      url: samples\ComfyUI_00012_.mp4
  - text: >-
      Fujifilm Portra 400H film still, slammed Nissan Skyline R33 GTR LM JGTC,
      in heavy motion blur,  7-11 Tokyo, Midnight
    parameters:
      negative_prompt: bad quality, blurry, messy, chaotic
    output:
      url: samples\ComfyUI_00011_.mp4
  - text: >-
      Fujifilm Portra 400H film still, slammed Nissan Skyline R33 GTR LM JGTC,
      in heavy motion blur,  7-11 Tokyo, Midnight
    parameters:
      negative_prompt: bad quality, blurry, messy, chaotic
    output:
      url: samples\ComfyUI_00013_.mp4

gguf quantized version of wan video

  • drag gguf to > ./ComfyUI/models/diffusion_models
  • drag t5xxl-um to > ./ComfyUI/models/text_encoders
  • drag vae to > ./ComfyUI/models/vae

screenshot

workflow

  • for i2v model, drag clip-vision-h to > ./ComfyUI/models/clip_vision
  • run the .bat file in the main directory (assume you are using gguf pack below)
  • if you opt to use fp8 scaled umt5xxl encoder (if applies to any fp8 scale t5 actually), please use cpu offload (switch from default to cpu under device in gguf clip loader; won't affect speed); btw, it works fine for both gguf umt5xxl and gguf vae
  • drag any demo video (below) to > your browser for workflow
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a pig moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a fox moving quickly in a beautiful winter scenery nature trees sunset tracking camera
Negative Prompt
blurry ugly bad
Prompt
a cute anime girl with massive fennec ears and a big fluffy tail wearing a maid outfit turning around
Negative Prompt
blurry ugly bad
Prompt
glass flower blossom
Prompt
An icicle dragon lunges forward, mouth wide open to exhale a stream of icy mist. Ultramarine energy flickers beneath its frost-coated scales as it twists. The camera circles slowly, capturing the swirling ice particles and the backdrop of floating glaciers and frozen nebulae under a cyan-blue filter.
Negative Prompt
bad quality, blurry, messy, chaotic
Prompt
Fujifilm Portra 400H film still, slammed Nissan Skyline R33 GTR LM JGTC, in heavy motion blur, 7-11 Tokyo, Midnight
Negative Prompt
bad quality, blurry, messy, chaotic
Prompt
Fujifilm Portra 400H film still, slammed Nissan Skyline R33 GTR LM JGTC, in heavy motion blur, 7-11 Tokyo, Midnight
Negative Prompt
bad quality, blurry, messy, chaotic

screenshot

review

  • pig is a lazy architecture for gguf node; it applies to all model, encoder and vae gguf file(s); if you try to run it in comfyui-gguf node, you might need to manually add pig in it's IMG_ARCH_LIST (under loader.py); easier than you edit the gguf file itself; btw, model architecture which compatible with comfyui-gguf, including wan, should work in gguf node
  • 1.3b model: t2v, vace gguf is working fine; good for old or low end machine

run it with gguf-connector (alternative)

ggc v2

screenshot

reference