add files

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,118 @@
+---
+library_name: mlc-llm
+tags:
+- mlc-llm
+- web-llm
+language:
+- en
+base_model:
+- MarinaraSpaghetti/NemoMix-Unleashed-12B
+pipeline_tag: text-generation
+---
+
+This is a MLC converted weight from [NemoMix-Unleashed-12B](https://huggingface.co/MarinaraSpaghetti/NemoMix-Unleashed-12B) model in MLC format `q4f16_1`.
+
+The model can be used for projects [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
+
+---
+
+![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/6550b16f7490049d6237f200/zYBXSewLbIxWHZdB3oEHs.jpeg)
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/6550b16f7490049d6237f200/eRwPcd9Ox03hn_WRnsotj.png)
+
+# Information
+## Details
+
+Okay, I tried really hard to improve my ChatML merges, but that has gone terribly wrong. Everyone is adding special tokens with different IDs so can't even make a proper union tokenizer for them, damn. Not to mention, I made some... interesting discoveres in regards to some models' context lenghts. You can watch the breakdown of how it went down here: https://www.captiongenerator.com/v/2303039/marinaraspaghetti's-merging-experience.
+
+This one feels a bit different to my previous attempts and seems less prone to repetition, especially on higher contexts, which is great for me! I'll probably improve on it even further, but for now, it feels rather nice. Great for RP and storytelling. All credits and thanks go to the amazing MistralAI, Intervitens, Sao10K and Nbeerbower for their amazing models! Plus, special shoutouts to Parasitic Rogue for ideas and Prodeus Unity and Statuo for cool exl2 quants of my previous merges. Cheers to folks over at the Drummer's server! Have a good one, everyone.
+
+## Instruct
+
+![image/gif](https://cdn-uploads.huggingface.co/production/uploads/6550b16f7490049d6237f200/JtOSIRNnMdGNycWACobO2.gif)
+
+*Sigh,* Mistral Instruct, I'm afraid.
+
+UPDATE: WE HAD THE WRONG FORMAT ALL ALONG, JUST RECEIVED HOW IT'S SUPPOSED TO LOOK LIKE FROM THE OFFICIAL MISTRALAI TEAM MEMBER.
+
+![image/png](https://cdn-uploads.huggingface.co/production/uploads/6550b16f7490049d6237f200/lAGz_ITUkVaLMvm_0AXuj.png)
+
+...This had made me question everything I thought I knew.
+
+```
+<s>[INST]{system}[/INST]{response}</s>[INST]{user's message}[/INST]{response}</s>
+```
+
+## Parameters
+
+I recommend running Temperature 1.0-1.25 with 0.1 Top A or 0.01-0.1 Min P, and with 0.8/1.75/2/0 DRY. Also works with lower Temperatures below 1.0. Nothing more needed.
+
+### Settings
+
+You can use my exact settings from here (use the ones from the Mistral Base/Customized folder, I also recommend checking the Mistral Improved folder): https://huggingface.co/MarinaraSpaghetti/SillyTavern-Settings/tree/main.
+
+## GGUF
+
+https://huggingface.co/bartowski/NemoMix-Unleashed-12B-GGUF
+
+## EXL2
+
+https://huggingface.co/Statuo/NemoMix-Unleashed-EXL2-8bpw
+
+# NemoMix-Unleashed-12B
+
+This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+
+## Merge Details
+### Merge Method
+
+This model was merged using the della_linear merge method using E:\mergekit\mistralaiMistral-Nemo-Base-2407 as a base.
+
+### Models Merged
+
+The following models were included in the merge:
+* E:\mergekit\intervitens_mini-magnum-12b-v1.1
+* E:\mergekit\nbeerbower_mistral-nemo-bophades-12B
+* E:\mergekit\Sao10K_MN-12B-Lyra-v1
+* E:\mergekit\nbeerbower_mistral-nemo-gutenberg-12B
+* E:\mergekit\mistralaiMistral-Nemo-Instruct-2407
+
+### Configuration
+
+The following YAML configuration was used to produce this model:
+
+```yaml
+models:
+  - model: E:\mergekit\mistralaiMistral-Nemo-Instruct-2407
+    parameters:
+      weight: 0.1
+      density: 0.4
+  - model: E:\mergekit\nbeerbower_mistral-nemo-bophades-12B
+    parameters:
+      weight: 0.12
+      density: 0.5
+  - model: E:\mergekit\nbeerbower_mistral-nemo-gutenberg-12B
+    parameters:
+      weight: 0.2
+      density: 0.6
+  - model: E:\mergekit\Sao10K_MN-12B-Lyra-v1
+    parameters:
+      weight: 0.25
+      density: 0.7
+  - model: E:\mergekit\intervitens_mini-magnum-12b-v1.1
+    parameters:
+      weight: 0.33
+      density: 0.8
+merge_method: della_linear
+base_model: E:\mergekit\mistralaiMistral-Nemo-Base-2407
+parameters:
+  epsilon: 0.05
+  lambda: 1
+dtype: bfloat16
+tokenizer_source: base
+```
+
+# Ko-fi
+## Enjoying what I do? Consider donating here, thank you!
+
+https://ko-fi.com/spicy_marinara

mlc-chat-config.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:84f3bb00589e4b956a0036e432d1d980fdd9fe2329ab7bfe8098e75c9ab6bbe2
+size 2068

ndarray-cache.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a48ddc9ab10ea5a98b975db6de79de414d8f9c586b4c167eccffc25733bd9d3b
+size 187265

params_shard_0.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0c1f49ae400e4fe6172f8c601c49156af64ea377cf170ce011883b13516408b5
+size 335544320

params_shard_1.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cbe5ead5ca9349364fbd5281027ed6f1998dcb478e24105e182c81340833988c
+size 41943040

params_shard_10.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:71842802dfdcecad0029b874508e75f8e68ea99fffe07631bac4ce8b67a9ef06
+size 36700160

params_shard_100.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:09294105e063ea1d424c231cb63d2731e0e6a077441348a914ea6a3342a5b1f5
+size 25579520

params_shard_101.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:79f4e6f360b3b5de1e2c94bf6d9b0580b6c37e59e87b2918ed9bf3588c968f26
+size 36700160

params_shard_102.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:079fafc93bd177fa405126c802a1d5db78bfa76a7d97f95ff6d72103eb5d2422
+size 29501440

params_shard_103.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6f4cd1eeb1efa3df4d176d9e282c37eaa8c8465aa1cc9b937a8b44743c52aa0d
+size 73400320

params_shard_104.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6bb01651f3f315b9e40c56142d9dfd2838383d222d60c272bf60da4730856ae5
+size 31467520

params_shard_105.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7512a72b40856401f8a6dd19353e9fcfd2a439ae4cacdd5d64623068af501fd0
+size 36700160

params_shard_106.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9ef8098ea38f0fe44c28e87a418edc2db7ca578b72ce6168eda7d7c7c79cd1b7
+size 73400320

params_shard_107.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c7bbbb238e29d5a5878a101d82a9f2738623b20ce929113eac02bf58eb5dde7b
+size 25579520

params_shard_108.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a73a3d8045925d4c3c220550a11eaf193bf65867ddf200f8cd9a948c5c26f8f0
+size 36700160

params_shard_109.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:87247573d63a6021cdf613708c7fd33a776b4e5022437f96fae0a24ef5031612
+size 29501440

params_shard_11.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d3b904354071badb3ba58768fe51d8f9c9ad3d8143e6db4722bf77c62f8ae862
+size 29501440

params_shard_110.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:36d798388208cdca73986db28518a35b125cba73cd93cc546f70df14dcf5ee25
+size 73400320

params_shard_111.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e7c587b2041530b2718b999ff0122342f17de4aba0d818ae018b6c019fb65dc2
+size 31467520

params_shard_112.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4b5f9c3cd3206fb0120e398cb5b16ecf57237a43ec697b716b18a922a4e0e9b3
+size 36700160

params_shard_113.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d8e11f6b8b383681d78f9d39d63f8341919fe641b661053d18574f1c8baba30b
+size 73400320

params_shard_114.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e8685a069696001cd9e672a99526e9f7ed32621a5915c704149f93901f3bba23
+size 25579520

params_shard_115.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c67dd0aa7a1284db09b3b3ac8b01ff881d93fc0c1155aa4f2b1ea4b0acd004a7
+size 36700160

params_shard_116.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f06d5041c33de0acef05417c25b128be6933455794a3cde24961ff1e65eca5a9
+size 29501440

params_shard_117.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9dfa99615ef865aa9c9ca17a34e5030363027fcf56d400f3d46023c6208b5ed0
+size 73400320

params_shard_118.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:075cc36230c2e33cfc21c880340e12da324865ceadda3ee50a6bcad70c5f12b2
+size 31467520

params_shard_119.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:93581f490e877ce83cb8115aed02fd934f4f3cf7f6188b861b8eaaf353827138
+size 36700160

params_shard_12.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f2f4975dda86475ca316b9f8d8028809094f9ba5f9cab69fc95a9b92c8c8b0d9
+size 73400320

params_shard_120.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9def9037cc54d987beb5b36460fb3d30ba682d42d1cf9cee64b6e2c865a62337
+size 73400320

params_shard_121.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:52b123534c077528e4f5915f2394f84f16035043465e2cfdbacbff7b114384ed
+size 25579520

params_shard_122.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fdcffc4c7db1fcbb3d359afab5a79e5cacaa14d570dc866bf7380777ff97d655
+size 36700160

params_shard_123.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:58c0cc8a4df3559f8532b0fd5095c5a898dfcb5c5a9c182a5b86269c07445809
+size 29501440

params_shard_124.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9256995ee89e941b86843e35b2fe106a3841f552642503cfa411aaf132bf4689
+size 73400320

params_shard_125.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6a1c6ee7e84e14139b7f1aa47eb3e918426ad0d66aeb8d7998ca257330b31d5
+size 31467520

params_shard_126.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:01b5e78858ddbe0bf4dee37678e18a0222bd54b5700d5cb623c2ce069f2d4ea4
+size 36700160

params_shard_127.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:683238ddb68610b766cfde26bb36aa0d656e16378ea3882ad3a28527e8e99a9e
+size 73400320

params_shard_128.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:33f5fd7e1ed87f9738c4518b1abd4439f50321667460e86659feb3bc9c2cda94
+size 25579520

params_shard_129.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b6919ccb72f25d70421deb2e2c7ec39b7630a718169920558fab3defad06f8ed
+size 36700160

params_shard_13.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8f02f9c81221ed32f398b6c01b6fad2e7f22203e715ceae05b3b975611a4cd4b
+size 31467520

params_shard_130.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cfdf51b92931ba7727f2cde725b4eb85171e06215646b88a8e94b105d4dfbe8f
+size 29501440

params_shard_131.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5f8c7dbe508ddbb8a6259c93f6014a84d89b31b7d46091b6f7572075fd736195
+size 73400320

params_shard_132.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:97ca6af5667642ece32359bed2cd7eed78df8a33e53aee84aeb1cfd91c756aae
+size 31467520

params_shard_133.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c2945d4ab905e53912bc11bf5ec509ef9216a1c7acebda1950255759e55423be
+size 36700160

params_shard_134.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f6b0020b7bc6feb9a76c3a3c717b407a9b7d2266788552ad61d29fc7523e0749
+size 73400320

params_shard_135.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:320362fb330dc113e2a759da7f62ea83409b1c5e6503ac1de6577309c82d8447
+size 25579520

params_shard_136.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:47783f339d4967cafaf08e736e9c2bd19da1ccebb3785c7b96c1bbc04664b1e7
+size 36700160

params_shard_137.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2af67f62bd3802e6a180ffecf38a40db53a426087960e267cf41d1e1de3a21c7
+size 29501440

params_shard_138.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c48ddc053a65fcc55b9837be0a501198a4cef892e4277eda2cd36be9b5fad113
+size 73400320

params_shard_139.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:214140c2574fa8cde349bcd0c96ca8baae6fcd9a0c1749ae9275956214f576ed
+size 31467520