-
-
-
-
-
-
Inference Providers
Active filters:
dpo
TheBloke/CapybaraHermes-2.5-Mistral-7B-GGUF
7B
•
Updated
•
8.21k
•
120
QuantFactory/NeuralDaredevil-8B-abliterated-GGUF
Text Generation
•
8B
•
Updated
•
4.19k
•
70
mlabonne/NeuralBeagle14-7B-GGUF
7B
•
Updated
•
308
•
47
argilla/CapybaraHermes-2.5-Mistral-7B
7B
•
Updated
•
21
•
70
BramVanroy/fietje-2-chat
Text Generation
•
3B
•
Updated
•
1.24k
•
6
mlabonne/TwinLlama-3.1-8B-DPO
Text Generation
•
8B
•
Updated
•
527
•
15
HumanLLMs/Human-Like-Mistral-Nemo-Instruct-2407
Text Generation
•
12B
•
Updated
•
78
•
•
17
darkc0de/Xortron2025
Text Generation
•
24B
•
Updated
•
1.63k
•
20
AmberYifan/Qwen2.5-14B-Instruct-wildfeedback-RPO-DRIFT-iter1
Text Generation
•
0.0B
•
Updated
•
27
•
1
mradermacher/Qwen2.5-14B-Instruct-wildfeedback-RPO-DRIFT-iter1-GGUF
15B
•
Updated
•
298
•
1
emretmrk/smolvlm-trl-dpo
ntkhoi/Qwen3-4B-Medical-DPO-0803
Text Generation
•
4B
•
Updated
•
10
•
1
mradermacher/Qwen3-4B-Medical-DPO-0803-GGUF
4B
•
Updated
•
252
•
1
AmberYifan/Qwen2.5-14B-Instruct-wildfeedback-RPO-DRIFT-iter1-4k
Text Generation
•
0.0B
•
Updated
•
12
•
1
mradermacher/Qwen2.5-14B-Instruct-wildfeedback-RPO-DRIFT-iter1-4k-GGUF
15B
•
Updated
•
148
•
1
lyogavin/Anima33B-DPO-Belle-1k
Text Generation
•
Updated
•
1
lyogavin/Anima33B-DPO-Belle-1k-merged
Text Generation
•
Updated
•
13
•
12
daekeun-ml/Llama-2-ko-DPO-13B
Text Generation
•
13B
•
Updated
•
866
•
19
lewtun/zephyr-7b-dpo-full
Text Generation
•
7B
•
Updated
•
9
alignment-handbook/zephyr-7b-dpo-full
Text Generation
•
7B
•
Updated
•
70
•
3
alignment-handbook/zephyr-7b-dpo-qlora
Updated
•
12
•
9
argilla/notus-7b-v1-lora
Text Generation
•
7B
•
Updated
•
7
•
7
argilla/notus-7b-v1-lora-adapter
Text Generation
•
Updated
•
3
argilla/notus-7b-v1
Text Generation
•
7B
•
Updated
•
148
•
122
ContextualAI/archangel_sft_pythia1-4b
Text Generation
•
1B
•
Updated
•
8
ContextualAI/archangel_sft_pythia2-8b
Text Generation
•
3B
•
Updated
•
42
•
1
ContextualAI/archangel_sft_pythia6-9b
Text Generation
•
7B
•
Updated
•
6
ContextualAI/archangel_sft_pythia12-0b
Text Generation
•
12B
•
Updated
•
3
ContextualAI/archangel_sft_llama7b
Text Generation
•
7B
•
Updated
•
5
•
1
ContextualAI/archangel_sft_llama13b
Text Generation
•
13B
•
Updated
•
13