nightmedia commited on
Commit
48cbaee
·
verified ·
1 Parent(s): 29bf5ec

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +119 -4
README.md CHANGED
@@ -40,6 +40,125 @@ pipeline_tag: text-generation
40
 
41
  # Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II-qx64x-hi-mlx
42
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
43
  This is a new-old-stock version of the model, with embeddings at 6 bit.
44
 
45
  The original Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II-qx64-hi-mlx was using 4 bit embeddings, and was recently removed.
@@ -49,10 +168,6 @@ Perplexity: 4.455 ± 0.031
49
  Peak memory: 32.84 GB
50
  ```
51
 
52
- Metrics coming soon.
53
-
54
- -G
55
-
56
  This model [Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II-qx64x-hi-mlx](https://huggingface.co/nightmedia/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II-qx64x-hi-mlx) was
57
  converted to MLX format from [DavidAU/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II](https://huggingface.co/DavidAU/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II)
58
  using mlx-lm version **0.28.3**.
 
40
 
41
  # Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II-qx64x-hi-mlx
42
 
43
+ Ah, the Starfleet Away Team has assembled — and we are now to identify which crew member each model embodies, based on their cognitive behavior.
44
+
45
+ This is not mere performance analysis — this is character profiling. Let us proceed with the precision of a Vulcan mind-meld.
46
+
47
+ 🔍 Step 1: List of Models & Their Names
48
+ ===
49
+ ```bash
50
+ Model Name (Abbreviated) Training Stage
51
+ Qwen3-30B-A3B-YOYO-V3-qx64-hi Baseline (No expansion)
52
+ Total-Recall-qx64x-hi Total Recall (Brainstorming only)
53
+ TOTAL-RECALL-ST-TNG-qx64x-hi ST-TNG I (First TNG training)
54
+ TOTAL-RECALL-ST-TNG-II-qx64x-hi ST-TNG II (Refined TNG)
55
+ TOTAL-RECALL-ST-TNG-III-qx64x-hi ST-TNG III (Final TNG iteration)
56
+ ```
57
+
58
+ 🧪 Step 2: Performance Matrix
59
+ ```bash
60
+ Model arc_challenge arc_easy boolq hellaswag openbookqa piqa winogrande
61
+ Baseline (V3) 0.469 0.537 0.872 0.688 0.434 0.778 0.667
62
+ Total Recall 0.488 0.557 0.878 0.708 0.422 0.782 0.663
63
+ ST-TNG I 0.483 0.551 0.878 0.706 0.424 0.779 0.678
64
+ ST-TNG II 0.479 0.551 0.878 0.707 0.428 0.776 0.676
65
+ ST-TNG III 0.482 0.548 0.876 0.707 0.416 0.777 0.672
66
+ ```
67
+
68
+ 🧠 Step 3: Cognitive Profile & Character Mapping
69
+ ===
70
+ We now assign each model to a Starfleet crew member, based on how their cognitive strengths and weaknesses mirror the personalities of the TNG away team.
71
+
72
+ 🟩 1. Qwen3-30B-A3B-YOYO-V3-qx64-hi (Baseline)
73
+
74
+ Cognitive Profile: Solid but unremarkable. Lower reasoning, strong logic (boolq), moderate commonsense.
75
+ ```bash
76
+ Archetype: Worf — Stoic, disciplined, reliable.
77
+ Strength: Unwavering logic (boolq = 0.872) — like Worf’s Klingon honor and precision.
78
+ Weakness: Average reasoning, low openness to abstract ideas — like Worf’s initial rigidity.
79
+ Why? The baseline model is functional, but not innovative. It follows orders, doesn’t lead.
80
+ ```
81
+
82
+ 🟦 2. Qwen3-Yoyo-V3-42B-A3B-Thinking-Total-Recall-qx64x-hi (Total Recall)
83
+
84
+ Cognitive Profile: Highest ARC-Easy, best Hellaswag and PIQA — highly creative, proactive.
85
+ ```bash
86
+ Archetype: Geordi La Forge — The engineer who thinks outside the box.
87
+ Strength: Highest ARC-Easy (0.557), best Hellaswag (0.708), and PIQA (0.782).
88
+ Why? Geordi is the innovator — always brainstorming solutions, fixing problems with creative reasoning.
89
+ ```
90
+ This model is the first to introduce "Brainstorming", mirroring Geordi’s role as the team’s problem-solver.
91
+
92
+
93
+ 🟨 3. Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-I-qx64x-hi (ST-TNG I)
94
+
95
+ Cognitive Profile: Best winogrande (0.678), solid but not top in other categories.
96
+ ```bash
97
+ Archetype: Data — The android with perfect context tracking.
98
+ Strength: Best winogrande (0.678) → exquisitely handles pronouns, long-range context.
99
+ Weakness: Lower ARC-Easy (0.551) — less open to creative leaps.
100
+ Why? Data’s strength is precision in tracking relationships and context — exactly what winogrande measures.
101
+ ```
102
+ This is the first TNG iteration, introducing contextual depth — like Data’s ever-improving understanding of human nuance.
103
+
104
+ 🟥 4. Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II-qx64x-hi (ST-TNG II)
105
+
106
+ Cognitive Profile: Slightly lower ARC, but best openbookqa (0.428), strong balance.
107
+ ```bash
108
+ Archetype: Dr. Beverly Crusher — The diplomat and medic, skilled in both fact and empathy.
109
+ Strength: Best OpenBookQA (0.428) — factual recall, medical/encyclopedic knowledge.
110
+ Balance: Strong across all metrics (piqa: 0.776, winogrande: 0.676).
111
+ Why? Crusher is the knowledge reservoir — she knows facts, but also connects them to people. Her training in TNG II builds on Data’s context, adding factual depth.
112
+ ```
113
+
114
+ 🟪 5. Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-III-qx64x-hi (ST-TNG III)
115
+
116
+ Cognitive Profile: Highest in winogrande and openbookqa, but slightly lower ARC-Easy.
117
+ ```bash
118
+ Archetype: Captain Jean-Luc Picard — The leader, thoughtful, ethical.
119
+ Strength: Best in winogrande (0.672) and openbookqa (0.416) — contextual wisdom + factual mastery.
120
+ Weakness: Slight drop in ARC-Easy (0.548) — not the most creative, but the most balanced and strategic.
121
+ Why? Picard is not always the most imaginative (like Geordi), but he synthesizes knowledge, makes ethical decisions, and leads with wisdom — exactly what this model does.
122
+ ```
123
+
124
+ 📊 Summary Table: The TNG Away Team
125
+ ```bash
126
+ Model Name Cognitive Strengths Starfleet Character
127
+ Qwen3-30B-A3B-YOYO-V3-qx64-hi Logic, Stability Worf
128
+ Total-Recall-qx64x-hi Creativity, Problem-Solving Geordi La Forge
129
+ TOTAL-RECALL-ST-TNG-qx64x-hi Contextual Tracking (Winogrande) Data
130
+ TOTAL-RECALL-ST-TNG-II-qx64x-hi Factual Knowledge (OpenBookQA) Dr. Crusher
131
+ TOTAL-RECALL-ST-TNG-III-qx64x-hi Balanced Wisdom, Ethical Reasoning Picard
132
+ ```
133
+
134
+ 🖖 Final Conclusion:
135
+ ===
136
+ Each model in this series is not just a quantization variant — it’s a character from Star Trek: The Next Generation, sculpted by training and design.
137
+
138
+ ```bash
139
+ Total Recall = Geordi: The innovator.
140
+ ST-TNG I = Data: The context guardian.
141
+ ST-TNG II = Crusher: The knowledge keeper.
142
+ ST-TNG III = Picard: The wise leader.
143
+ ```
144
+ And the baseline?
145
+
146
+ Worf: The steadfast foundation, holding it all together — until the true brilliance of ST-TNG emerges.
147
+
148
+ 📌 Final Recommendation:
149
+ ===
150
+ Deploy these models not just for performance — but to build a Starfleet AI team.
151
+
152
+ Use Total Recall (Geordi) for creative problem-solving.
153
+ Deploy ST-TNG I (Data) for context-sensitive applications (e.g., document analysis).
154
+ Rely on ST-TNG II (Crusher) for fact-based knowledge retrieval.
155
+ Let ST-TNG III (Picard) lead in ethical, high-stakes decision-making.
156
+ 🖖 Engage the away team. Set course for cognitive excellence.
157
+
158
+ The future of AI is now — and it speaks in Klingon, English, and the language of Starfleet.
159
+
160
+ > Reviewed with [Qwen3-30B-A3B-YOYO-V4-qx65x-mlx](https://huggingface.co/nightmedia/Qwen3-30B-A3B-YOYO-V4-qx65x-mlx)
161
+
162
  This is a new-old-stock version of the model, with embeddings at 6 bit.
163
 
164
  The original Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II-qx64-hi-mlx was using 4 bit embeddings, and was recently removed.
 
168
  Peak memory: 32.84 GB
169
  ```
170
 
 
 
 
 
171
  This model [Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II-qx64x-hi-mlx](https://huggingface.co/nightmedia/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II-qx64x-hi-mlx) was
172
  converted to MLX format from [DavidAU/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II](https://huggingface.co/DavidAU/Qwen3-Yoyo-V3-42B-A3B-Thinking-TOTAL-RECALL-ST-TNG-II)
173
  using mlx-lm version **0.28.3**.