FP8 dont take?
#4
by
chuanyizjc
- opened
OSError: /data00/models/Llama-3_1-Nemotron-Ultra-253B-v1-FP8 does not appear to have a file named nconfiguration_decilm.py. Checkout 'https://huggingface.co//data00/models/Llama-3_1-Nemotron-Ultra-253B-v1-FP8/tree/main' for available files