FP8 dont take?

#4
by chuanyizjc - opened

OSError: /data00/models/Llama-3_1-Nemotron-Ultra-253B-v1-FP8 does not appear to have a file named nconfiguration_decilm.py. Checkout 'https://huggingface.co//data00/models/Llama-3_1-Nemotron-Ultra-253B-v1-FP8/tree/main' for available files

Sign up or log in to comment