Image-to-text models Collection of image captioning models Salesforce/blip-image-captioning-large Image-to-Text • Updated Feb 3 • 2.45M • 1.36k microsoft/git-large-coco Image-to-Text • Updated Jun 26, 2023 • 3.22k • 104 Salesforce/instructblip-vicuna-7b Image-Text-to-Text • Updated Feb 3 • 17.3k • 94 Salesforce/blip2-flan-t5-xxl Image-Text-to-Text • Updated Feb 3 • 7.57k • 89
SigLIP release SigLIP improves upon CLIP with a sigmoid loss. Both English-only and multilingual checkpoints are released. Sigmoid Loss for Language Image Pre-Training Paper • 2303.15343 • Published Mar 27, 2023 • 8 google/siglip-base-patch16-224 Zero-Shot Image Classification • Updated Sep 26, 2024 • 284k • 53 google/siglip-base-patch16-256 Zero-Shot Image Classification • Updated Sep 26, 2024 • 5.43k • 6 google/siglip-base-patch16-384 Zero-Shot Image Classification • Updated Sep 26, 2024 • 3.03k • 10
Image-to-text models Collection of image captioning models Salesforce/blip-image-captioning-large Image-to-Text • Updated Feb 3 • 2.45M • 1.36k microsoft/git-large-coco Image-to-Text • Updated Jun 26, 2023 • 3.22k • 104 Salesforce/instructblip-vicuna-7b Image-Text-to-Text • Updated Feb 3 • 17.3k • 94 Salesforce/blip2-flan-t5-xxl Image-Text-to-Text • Updated Feb 3 • 7.57k • 89
SigLIP release SigLIP improves upon CLIP with a sigmoid loss. Both English-only and multilingual checkpoints are released. Sigmoid Loss for Language Image Pre-Training Paper • 2303.15343 • Published Mar 27, 2023 • 8 google/siglip-base-patch16-224 Zero-Shot Image Classification • Updated Sep 26, 2024 • 284k • 53 google/siglip-base-patch16-256 Zero-Shot Image Classification • Updated Sep 26, 2024 • 5.43k • 6 google/siglip-base-patch16-384 Zero-Shot Image Classification • Updated Sep 26, 2024 • 3.03k • 10