NuMarkdown-8B-Thinking - bnb4 Quantized

English | Русский

Русский

Это квантованная версия модели numind/NuMarkdown-8B-Thinking.

Сквантована с использованием https://github.com/LeDXIII/BNB4-Model-converter

Создана специально для быстрого старта работы с программой распознавания текста: https://github.com/LeDXIII/NuMarkdown-OCR-bnb4

Описание квантизации

  • Тип квантизации: bnb4
  • Размер модели: 5,5 ГБ
  • Исходный размер: ~16 ГБ (оригинальная модель)

English Description

This is a quantized version of the numind/NuMarkdown-8B-Thinking model.

Quantized using https://github.com/LeDXIII/BNB4-Model-converter

Created specifically for a quick start with the text recognition program: https://github.com/LeDXIII/NuMarkdown-OCR-bnb4

Quantization Details

  • Quantization Type: bnb4
  • Model Size: 5.5 GB
  • Original Size: ~16 GB (original model)
Downloads last month
11
Safetensors
Model size
8B params
Tensor type
F16
·
F32
·
U8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for LeDXIII/NuMarkdown-8B-Thinking-bnb4

Quantized
(4)
this model