Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

8-bit precision

text-embeddings-inference

Models

406

Full-text search

Active filters: llama-3.1

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated 29 days ago • 121

DavidAU/AI_AutocorrectAuto-Creative-EnhancementAuto-Low-Quant-Optimization__gguf-exl2-hqq-SOFTWARE

Text Generation • Updated 29 days ago • 52

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13, 2024 • 1.77k • 36

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 274k • 68

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 117k • 101

hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 1.66k • 16

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4

Text Generation • Updated Sep 16, 2024 • 188 • 2

hugging-quants/Meta-Llama-3.1-405B-Instruct-BNB-NF4

Text Generation • Updated Sep 16, 2024 • 41 • 5

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 2.68k • 8

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 2.19k • 1

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29, 2024 • 2.52k • 4

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 27, 2024 • 172 • 1

ModelCloud/Meta-Llama-3.1-8B-gptq-4bit

Text Generation • Updated Jul 26, 2024 • 25

ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation • Updated Jul 27, 2024 • 32 • 4

ValiantLabs/Llama3.1-8B-Fireplace2

Text Generation • Updated Mar 12 • 3.5k • 6

vicgalle/Configurable-Llama-3.1-8B-Instruct

Text Generation • Updated Jul 24, 2024 • 3.54k • 16

OpenBuddy/openbuddy-llama3.1-8b-v22.1-131k

Text Generation • Updated Jul 24, 2024 • 25 • 5

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 5.54k • 23

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7, 2024 • 326k • 25

sunnyyy/openbuddy-llama3.1-8b-v22.1-131k-Q4_K_M-GGUF

Text Generation • Updated Jul 25, 2024 • 9

jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Jul 25, 2024 • 12

jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Jul 25, 2024 • 14

azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16

Text Generation • Updated Aug 28, 2024 • 1.58k • 13

mudler/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated Jul 27, 2024 • 16

mradermacher/Configurable-Llama-3.1-8B-Instruct-GGUF

Updated Jul 29, 2024 • 527

OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k

Text Generation • Updated Aug 11, 2024 • 12 • 2

mradermacher/openbuddy-llama3.1-8b-v22.1-131k-GGUF

Updated Jul 29, 2024 • 255

mradermacher/openbuddy-llama3.1-8b-v22.2-131k-GGUF

Updated Jul 28, 2024 • 120

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16

Text Generation • Updated Sep 16, 2024 • 3.07k • 2

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4-BF16

Text Generation • Updated Jul 28, 2024 • 1.99k