Off-Topic Share method for merging?

#5
by Qiko - opened

Would be kind to explain how to merge HF files? I could never figure it out.

Hi! I'm just a Sunday programmer.
To merge the files, I actually asked an AI (Claude) to write a merge script for me.

Here’s roughly what I did:

  1. Downloaded the split safetensors files, config.json, and model.safetensors.index.json from the official repo:
    https://huggingface.co/google/flan-t5-xxl/tree/main
  2. Fed config.json and model.safetensors.index.json to Claude, and asked it to generate a script that merges the files into a single model.
  3. Ran that script locally on VS Code.

I don’t have the script anymore, but nowadays any AI assistant (ChatGPT, Gemini, Claude, etc.) should be smart enough to generate a similar one if you provide those two JSON files.

Hope that helps!

Sign up or log in to comment