Off-Topic Share method for merging?
#5
by
Qiko
- opened
Would be kind to explain how to merge HF files? I could never figure it out.
Hi! I'm just a Sunday programmer.
To merge the files, I actually asked an AI (Claude) to write a merge script for me.
Here’s roughly what I did:
- Downloaded the split
safetensorsfiles,config.json, andmodel.safetensors.index.jsonfrom the official repo:
https://huggingface.co/google/flan-t5-xxl/tree/main - Fed
config.jsonandmodel.safetensors.index.jsonto Claude, and asked it to generate a script that merges the files into a single model. - Ran that script locally on VS Code.
I don’t have the script anymore, but nowadays any AI assistant (ChatGPT, Gemini, Claude, etc.) should be smart enough to generate a similar one if you provide those two JSON files.
Hope that helps!