Edit Models filters

Model Tree

meta-llama/Llama-3.1-70B

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

79

Full-text search

Active filters: meta-llama/Llama-3.1-70B

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 4.43k • 31

hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • Updated Aug 8, 2024 • 202 • 2

mradermacher/Meta-Llama-3.1-70B-GGUF

Updated Dec 16, 2024 • 477

mradermacher/Meta-Llama-3.1-70B-i1-GGUF

Updated Dec 16, 2024 • 818 • 2

RedHatAI/Meta-Llama-3.1-70B-FP8

Text Generation • Updated Oct 9, 2024 • 1.74k • 2

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 23, 2024 • 353 • 41

LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2

Updated Aug 15, 2024 • 24 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2

Updated Aug 16, 2024 • 11 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 29 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2

Updated Aug 16, 2024 • 14 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2

Updated Aug 16, 2024 • 11 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2

Updated Aug 16, 2024 • 24 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2

Updated Aug 16, 2024 • 11 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 16, 2024 • 88 • 3

XelotX/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 17, 2024 • 48 • 1

Orion-zhen/Hermes-3-Llama-3.1-70B-4.5bpw-exl2

Updated Aug 18, 2024 • 10

bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2

Updated Aug 22, 2024 • 7

bullerwins/Hermes-3-Llama-3.1-70B-exl2_4.0bpw

Updated Aug 24, 2024 • 9

bullerwins/Hermes-3-Llama-3.1-70B-exl2_5.0bpw

Updated Aug 24, 2024 • 25

bullerwins/Hermes-3-Llama-3.1-70B-exl2_6.0bpw

Updated Aug 24, 2024 • 10

Niansuh/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 25, 2024 • 33 • 1

bigstorm/Hermes-3-Llama-3.1-70B-7.0bpw-8hb-exl2

Updated Aug 26, 2024 • 26

bigstorm/Hermes-3-Llama-3.1-70B-8.0bpw-8hb-exl2

Updated Aug 26, 2024 • 9

ArtyLLaMa/LLaMa3.1-Instruct-70b-GGUF

Text Generation • Updated Aug 29, 2024 • 20 • 1

unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 1.61k • 1

unsloth/Meta-Llama-3.1-70B

Text Generation • Updated Dec 7, 2024 • 1.91k • 1

Ffftdtd5dtft/Meta-Llama-3.1-70B-Q2_K-GGUF

Text Generation • Updated Sep 3, 2024 • 3

FriendliAI/Meta-Llama-3.1-70B-Instruct-int8

Text Generation • Updated Sep 9, 2024 • 17

ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 14, 2024 • 14 • 17

mav23/Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Oct 3, 2024 • 156