RedHatAI
/

Llama-3.2-3B-Instruct-FP8

Text Generation

compressed-tensors

Model card Files Files and versions

Llama-3.2-3B-Instruct-FP8 / recipe.yaml

alexmarques's picture

Upload folder using huggingface_hub

3a9931b verified 10 months ago

history blame contribute delete

144 Bytes

	quant_stage:
	quant_modifiers:
	QuantizationModifier:
	ignore: [lm_head]
	scheme: FP8
	observer: mse
	targets: [Linear]