nonetrix/Sanity-Check-7b

nonetrix/Sanity-Check-7B

Just a sanity check to see if I could merge any model, because I was having errors. Not meant to be a serious model, but it's my first merge so I thought I might as well upload. I don't expect it to be good at really anything, because I have no idea what I am doing. However, please give feedback in tips! :-)

i couldn't merge any other models something about a vocabulary idk ¯_(ツ)_/¯

Disclaimer

DO NOT rely on this model for math or medical tasks or ANYTHING unless you have a death wish and want to lower your IQ. Dear God why do i have to say this? Shouldn't it be obvious? I made this on a free Discord bot at 3AM (and recreated the FP16 version of my own PC)

Merge settings

models:
  - model: BioMistral/BioMistral-7B
  - model: meta-math/MetaMath-Mistral-7B
    parameters:
      density: 0.53
      weight: 0.6
merge_method: dare_ties
base_model: BioMistral/BioMistral-7B
parameters:
  int8_mask: true
dtype: bfloat16
random_seed: 0

nonetrix
/

Sanity-Check-7b