Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

Inference Endpoints

8-bit precision

text-generation-inference

text-embeddings-inference

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

285

Full-text search

Active filters: int8

RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • Updated 26 days ago • 13.3k • 8

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • Updated Feb 27 • 3.57k • 11

vlad-m-dev/distiluse-base-multilingual-v2-merged-onnx

Feature Extraction • Updated 3 days ago • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-static-inc

Text Classification • Updated Jun 27, 2023 • 166 • 5

Intel/bert-base-uncased-mrpc-int8-qat-inc

Text Classification • Updated Mar 21, 2024 • 35 • 1

Intel/albert-base-v2-sst2-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 92

Intel/bert-base-uncased-finetuned-swag-int8-static-inc

Multiple Choice • Updated Oct 6, 2023 • 28 • 1

Intel/bert-base-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 68

Intel/distilbert-base-uncased-finetuned-conll03-english-int8-static-inc

Token Classification • Updated Oct 6, 2023 • 87 • 1

Intel/camembert-base-mrpc-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 26

Intel/bert-base-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 31

Intel/roberta-base-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 50

Intel/bart-large-mrpc-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 26

Intel/xlnet-base-cased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 33

Intel/electra-small-discriminator-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 29

echarlaix/distilbert-sst2-inc-dynamic-quantization-magnitude-pruning-0.1

Text Classification • Updated Jun 13, 2023 • 48

Intel/MiniLM-L12-H384-uncased-mrpc-int8-static-inc

Text Classification • Updated Mar 21, 2024 • 23

Intel/MiniLM-L12-H384-uncased-mrpc-int8-qat-inc

Text Classification • Updated Oct 6, 2023 • 21

Intel/distilbert-base-cased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 21, 2024 • 31

Intel/bert-base-uncased-squad-int8-static-inc

Question Answering • Updated Oct 6, 2023 • 60 • 1

echarlaix/t5-small-int8-dynamic

Translation • Updated Oct 26, 2023 • 89 • 4

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 1.37k • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21, 2024 • 74 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29, 2024 • 1.39k • 5

Intel/roberta-base-squad2-int8-static-inc

Updated Mar 21, 2024 • 46 • 1

Intel/roberta-large-mnli-int8-static-inc

Text Classification • Updated Oct 6, 2023 • 44

Intel/vit-base-patch16-224-int8-static-inc

Image Classification • Updated Sep 6, 2022 • 109 • 1

Intel/t5-small-xsum-int8-dynamic-inc

Text2Text Generation • Updated Mar 21, 2024 • 1.36k • 1

Intel/t5-small-finetuned-cnn-news-int8-dynamic-inc

Text2Text Generation • Updated Oct 6, 2023 • 27

AlexKoff88/bert_nm_mnli_sparse_quantized_90

Text Classification • Updated Nov 25, 2022 • 20