Various useful datasets with preference optimization
Nicholas Beerbower PRO
nbeerbower
AI & ML interests
QLoRA finetuning and merging LLMs for fun
Recent Activity
liked
a model
about 12 hours ago
openai/gpt-oss-20b
liked
a model
about 12 hours ago
openai/gpt-oss-120b
new activity
about 13 hours ago
nbeerbower/Xiaolong-Qwen3-8B:Any plans for future Qwen3 8B models?
Organizations
models
221
nbeerbower/Eloisa-Qwen3-8B
8B
•
Updated
•
10
•
4
nbeerbower/Wenyan-Qwen3-8B
8B
•
Updated
•
6
•
1
nbeerbower/NikuXL-v0.1
Text-to-Image
•
Updated
•
4
nbeerbower/NikuX1-Test
Text-to-Image
•
Updated
•
3
nbeerbower/Yanfei-v2-Qwen3-32B
Text Generation
•
33B
•
Updated
•
12
•
2
nbeerbower/Menghua-Qwen3-32B-lora
Updated
•
2
nbeerbower/Zhiming-Qwen3-32B-lora
Updated
•
2
nbeerbower/Mistral-Nemo-Gutenberg-Vitus-12B
12B
•
Updated
•
27
•
4
nbeerbower/Vitus-Qwen3-14B
15B
•
Updated
•
19
•
4
nbeerbower/Vitus-mistral-nemo-12B
12B
•
Updated
•
9
datasets
21
nbeerbower/WenyanMix-DPO
Viewer
•
Updated
•
30.2k
•
83
nbeerbower/NikuX-DPO-captioned
Viewer
•
Updated
•
792
•
21
nbeerbower/NikuX-DPO-filtered
Viewer
•
Updated
•
792
•
15
nbeerbower/NikuX-DPO-concat
Viewer
•
Updated
•
883
•
11
nbeerbower/NikuX3-DPO-Filtered
Viewer
•
Updated
•
581
•
8
nbeerbower/NikuX3-DPO
Viewer
•
Updated
•
651
•
4
nbeerbower/NikuX2-DPO-Filtered
Viewer
•
Updated
•
282
•
6
nbeerbower/YanfeiMix-DPO
Viewer
•
Updated
•
22.4k
•
48
•
1
nbeerbower/human-writing-dpo
Updated
•
61
•
6
nbeerbower/NikuX2-DPO
Viewer
•
Updated
•
333
•
7