| tags: | |
| - gguf | |
| - llama.cpp | |
| - unsloth | |
| # opl-gst-model-v2-vllm - GGUF | |
| This model was finetuned and converted to GGUF format using [Unsloth](https://github.com/unslothai/unsloth). | |
| **Example usage**: | |
| - For text only LLMs: **llama-cli** **--hf** repo_id/model_name **-p** "why is the sky blue?" | |
| - For multimodal models: **llama-mtmd-cli** **-m** model_name.gguf **--mmproj** mmproj_file.gguf | |
| ## Available Model files: | |
| - `llama-3.2-1b-instruct.F16.gguf` | |
| ## Ollama | |
| An Ollama Modelfile is included for easy deployment. | |