merve's picture

merve PRO

merve

·

https://github.com/merveenoyan/smol-vision

AI & ML interests

I love this website VLMs, vision & co

Recent Activity

reacted to bartowski's post with 🤗 1 day ago

Was going to post this on /r/LocalLLaMa, but apparently it's without moderation at this time :') https://huggingface.co/bartowski/mistralai_Mistral-Small-3.2-24B-Instruct-2506-GGUF Was able to use previous mistral chat templates, some hints from Qwen templates, and Claude to piece together a seemingly working chat template, tested it with llama.cpp server and got perfect results, though lmstudio still seems to be struggling for some reason (don't know how to specify a jinja file there) Outlined the details of the script and results in my llama.cpp PR to add the jinja template: https://github.com/ggml-org/llama.cpp/pull/14349 Start server with a command like this: ``` ./llama-server -m /models/mistralai_Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M.gguf --jinja --chat-template-file /models/Mistral-Small-3.2-24B-Instruct-2506.jinja ``` and it should be perfect! Hoping it'll work for ALL tools if lmstudio gets an update or something, not just llama.cpp, but very happy to see it works flawlessly in llama.cpp In the meantime, will try to open a PR to minja to make the strftime work, but no promises :)

posted an update 1 day ago

we've merged LightGlue keypoint matcher to Hugging Face transformers! it allows commercial use when paired with an open-source keypoint detector 🙏🏻 it works very well, try it yourself: https://huggingface.co/spaces/ETH-CVG/LightGlue here's an in-the-wild test with two images of the same place ⤵️

new activity 1 day ago

ETH-CVG/lightglue_superpoint:Fix task tag

View all activity

Organizations

Posts 135

Post

343

we've merged LightGlue keypoint matcher to Hugging Face transformers! it allows commercial use when paired with an open-source keypoint detector 🙏🏻

it works very well, try it yourself: ETH-CVG/LightGlue

here's an in-the-wild test with two images of the same place ⤵️

Articles 31

Article

62

(LoRA) Fine-Tuning FLUX.1-dev on Consumer Hardware

View all Articles

Collections 61

spaces 106

Vision Papers

All paper summaries read by Merve

Running on Zero

Llama Guard 4

Check if text and images are safe

Running on Zero

ShieldGemma2 VLM

Demo for ShieldGemma 2, multimodal safety model

UDOP

Generate text from document images

Running on Zero

Paligemma2 Vqav2

PaliGemma2 LoRA finetuned on VQAv2

Running on Zero

OWLSAM

State-of-the-art open-vocabulary image segmentation ⚡️

View 106 Spaces

models 94

merve/vjepa2-vitl-fpc16-256-ssv2-ucf101

Video Classification • Updated 12 days ago • 11

merve/test

merve/SmolVLM2-500M-Video-Instruct-video-feedback

Image-Text-to-Text • Updated Feb 20 • 11

merve/SmolVLM2-500M-Video-Instruct-videofeedback

Image-Text-to-Text • Updated Feb 20 • 74

merve/SmolVLM2-500M-Video-Instruct-emotions

Image-Text-to-Text • Updated Feb 20 • 46

merve/colpali_ufo

Updated Dec 20, 2024 • 11

merve/paligemma_vqav2

Image-Text-to-Text • Updated Dec 18, 2024 • 25 • 13

merve/paligemma2-3b-vqav2

Updated Dec 5, 2024 • 52 • 6

merve/google-ckpts

Updated Oct 22, 2024

merve/google-tokenizers

Updated Oct 22, 2024

datasets 29

merve/test2

Updated 5 days ago • 41

merve/vlm_test_images

Viewer • Updated 12 days ago • 15 • 333 • 1

merve/retail-in-the-wild

Viewer • Updated Mar 6 • 20 • 89 • 3

merve/model-test-inputs

Updated Oct 21, 2024 • 70

merve/vqav2-small

Viewer • Updated Aug 8, 2024 • 21.4k • 2.07k • 12

merve/SGinW

Viewer • Updated Jul 11, 2024 • 16.7k • 493 • 1

merve/pascal-voc

Viewer • Updated Jul 6, 2024 • 336k • 210 • 1

merve/YouCook2

Viewer • Updated May 28, 2024 • 2k • 57

merve/faiss_embeddings

Updated Jan 25, 2024 • 51

merve/pokemon-ds-embeddings

Viewer • Updated Jan 10, 2024 • 833 • 80 • 4

View 29 datasets