Commit History

use all cpu cores
be5c239

Luigi commited on

show cpu count in debug message
b56b6ec

Luigi commited on

add q2_k precsion weights
07f3263

Luigi commited on

add rich debug message and dedicated display ui
34cd1e5

Luigi commited on

apply in-memory encoding instead of temp files
45c2159

Luigi commited on

avoid memory leak
238a95a

Luigi commited on

use more thread for inference
bd12f6b

Luigi commited on

remove interval ui doublon
bdd1478

Luigi commited on

bugifx on ui about model selection
e1ad065

Luigi commited on

increase interval default to 3s
c9c43a8

Luigi commited on

1. add more models,
5c50991

Luigi commited on

reduce ctx and max tokens for performance
76a0b57

Luigi commited on

minor update then add todos
65b3c3a

Luigi commited on

resize frame to 384 x384 resolution
c1d8038

Luigi commited on

add debug messages
36dacc6

Luigi commited on

Update README.md
d05da82
verified

Luigi commited on

Update README.md
5234d12
verified

Luigi commited on

switch to gradio implementation as streamlit + webrtc requires turn server
970f416

Luigi commited on

decouple inference from streaming
292fb3c

Luigi commited on

set default interval to 3s
2529cb3

Luigi commited on

slightly increase repeat_penalty to reduce token repetition
636baf9

Luigi commited on

bugfix on 'NoneType' object has no attribute 'caption'
7b7ed26

Luigi commited on

update readme
4d88fce

Luigi commited on

Revert "update readme"
ef6f278

Luigi commited on

update readme
3e01b8a

Luigi commited on

update
221e4b6

Luigi commited on

update
60e423d

Luigi commited on

update requirements
9eb6ac5

Luigi commited on

add debug
abec2c1

Luigi commited on

update requirements
435fd68

Luigi commited on

update
e4c3679

Luigi commited on

update requirements
c171c96

Luigi commited on

update requirement
8b6c0d5

Luigi commited on

add fastapi & uvicorn
8b4688f

Luigi commited on

pin llama-cpp-python to a version whose wheel is available
623be25

Luigi commited on

add wheel source to llama_cpp_python
8acd4a6

Luigi commited on

add cv2
8638b7e

Luigi commited on

update requirements
e4445ea

Luigi commited on

Delete vlm/requirements.txt
9515832
verified

Luigi commited on

Update README.md
6e8c8a3
verified

Luigi commited on

Update README.md
25cea3b
verified

Luigi commited on

Update README.md
31bcb2d
verified

Luigi commited on

add steamlit
f7058ee

Luigi commited on

add streamlit
19a401e

Luigi commited on

update
dd0d47d

Luigi commited on

initial commit
ca97f63

Luigi commited on

initial commit
62ed9f9
verified

Luigi commited on