TPO

community

AI & ML interests

Alignment, Preference Optimization, RLHF

sahsaeedi

updated a Space 4 months ago

README

sahsaeedi

updated 11 models 4 months ago

tpo-alignment/Instruct-Llama-3-8B-TPO-L-y2

Updated Feb 19 • 12

tpo-alignment/Instruct-Llama-3-8B-TPO-y2

Updated Feb 19 • 7

tpo-alignment/Instruct-Llama-3-8B-TPO-y4

Updated Feb 19 • 12

tpo-alignment/Instruct-Llama-3-8B-TPO-y3

Updated Feb 19 • 13

tpo-alignment/Mistral-Instruct-7B-TPO-y2-v0.2

Updated Feb 19 • 11

tpo-alignment/Mistral-Instruct-7B-TPO-y2-v0.1

Updated Feb 19 • 28

tpo-alignment/Mistral-Instruct-7B-TPO-y4

Updated Feb 19 • 15

tpo-alignment/Mistral-Instruct-7B-TPO-y3

Updated Feb 19 • 7

tpo-alignment/Llama-3-8B-TPO-L-40k

Updated Feb 19 • 14

tpo-alignment/Mistral-7B-TPO-40k

Updated Feb 19 • 36

tpo-alignment/Llama-3-8B-TPO-40k

Updated Feb 19 • 11

sahsaeedi

published a Space 5 months ago

README

kashif

authored a paper about 1 year ago

Margin-aware Preference Optimization for Aligning Diffusion Models without Reference

Paper • 2406.06424 • Published Jun 10, 2024 • 16

sahsaeedi

authored a paper about 1 year ago

Insights into Alignment: Evaluating DPO and its Variants Across Multiple Tasks

Paper • 2404.14723 • Published Apr 23, 2024 • 10

sverma76

authored a paper about 1 year ago

Insights into Alignment: Evaluating DPO and its Variants Across Multiple Tasks

Paper • 2404.14723 • Published Apr 23, 2024 • 10

kashif

authored a paper over 1 year ago

Zephyr: Direct Distillation of LM Alignment

Paper • 2310.16944 • Published Oct 25, 2023 • 122