| tags: | |
| - fp8 | |
| Made with https://github.com/neuralmagic/AutoFP8: | |
| ``` | |
| python quantize.py --model-id facebook/opt-125m --save-dir opt-125m-fp8-dynamic --activation-scheme dynamic | |
| ``` |
| tags: | |
| - fp8 | |
| Made with https://github.com/neuralmagic/AutoFP8: | |
| ``` | |
| python quantize.py --model-id facebook/opt-125m --save-dir opt-125m-fp8-dynamic --activation-scheme dynamic | |
| ``` |