Edit Models filters

Apps

Apps with no match

Inference Providers

Inference Providers with no match

HF Inference API

Misc

torchao-my-repo

Inference Endpoints

text-generation-inference

4-bit precision

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

36

Full-text search

Active filters: torchao-my-repo

medmekk/Llama-3.2-1B-ao-int8wo

Text Generation • Updated Mar 31 • 23

medmekk/Llama-3.2-1B-ao-int8da8w

Text Generation • Updated Mar 31 • 24

medmekk/Llama-3.2-1B-ao-int8wo-gs16

Text Generation • Updated Mar 31 • 40

medmekk/Llama-3.2-1B-ao-int8wo-gs32

Text Generation • Updated Mar 31 • 21

medmekk/Qwen2.5-0.5B-Instruct-ao-int8wo-gs128

Text Generation • Updated Mar 31 • 23

medmekk/Qwen2.5-0.5B-Instruct-ao-int8da8w

Text Generation • Updated Mar 31 • 21

Novaciano/SEX_ROLEPLAY-3.2-1B-ao-int4wo-gs128

Text Generation • Updated Apr 5 • 69

Novaciano/SEX_ROLEPLAY-3.2-1B-ao-int8wo-gs128

Text Generation • Updated Apr 5 • 88

Novaciano/SEX_ROLEPLAY-3.2-1B-ao-int8da8w

Text Generation • Updated Apr 16 • 233 • 1

medmekk/Llama-3.2-1B-ao-float8wo

Text Generation • Updated Apr 22 • 17

medmekk/Llama-3.2-1B-ao-float8da8w

Text Generation • Updated Apr 22 • 11

medmekk/Llama-3.2-1B-ao-autoquant-1

Text Generation • Updated Apr 22 • 14

medmekk/Llama-3.2-1B-ao-float8wo-2

Text Generation • Updated Apr 22 • 14

medmekk/Llama-3.2-1B-ao-float8wo-3

Text Generation • Updated Apr 22 • 11

medmekk/Llama-3.2-1B-ao-int8wo-gs256

Text Generation • Updated Apr 22 • 36

medmekk/Llama-3.2-1B-ao-int4wo-gs128

Text Generation • Updated Apr 22 • 9

medmekk/Qwen2.5-0.5B-Instruct-ao-float8wo

Text Generation • Updated Apr 22 • 12

medmekk/Llama-3.2-1B-ao-int4wo-gs256

Text Generation • Updated Apr 22 • 10

medmekk/Llama-3.1-8B-Instruct-ao-int8wo

Text Generation • Updated Apr 24 • 32

medmekk/Llama-3.1-8B-Instruct-ao-autoquant

Text Generation • Updated Apr 24 • 15

medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs128

Text Generation • Updated Apr 24 • 11

medmekk/Llama-3.1-8B-Instruct-ao-float8wo

Text Generation • Updated Apr 24 • 8

medmekk/Llama-3.1-8B-Instruct-ao-float8da8w8

Text Generation • Updated Apr 24 • 11

medmekk/Llama-3.1-8B-Instruct-ao-int8da8w8

Text Generation • Updated Apr 24 • 10

medmekk/Llama-3.1-8B-Instruct-ao-float8da8w8-2

Text Generation • Updated Apr 24 • 26

medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs32

Text Generation • Updated Apr 24 • 18

medmekk/Llama-3.1-8B-Instruct-ao-int4wo-gs16

Text Generation • Updated Apr 24 • 17

irresistiblegrace97/tinyllama.gguf

Updated Apr 24 • 12

andysalerno/Qwen3-8B-ao-autoquant

Text Generation • Updated May 9 • 7

HexLang/GPT2

Updated May 14 • 31