sabafallah commited on
Commit
dbe419f
·
verified ·
1 Parent(s): a23d74d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +31 -3
README.md CHANGED
@@ -1,3 +1,31 @@
1
- ---
2
- license: gemma
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: gemma
3
+ base_model:
4
+ - google/embeddinggemma-300m
5
+ tags:
6
+ - sentence-transformers
7
+ ---
8
+ # embeddinggemma-300M Sentence-Transformers GGUF
9
+
10
+ This GGUF Model includes all sentence-transformers (dense) modules.
11
+
12
+ Recommended way to run this model:
13
+
14
+ ```sh
15
+ llama-server -hf sabafallah/embeddinggemma-300m-sentence-transformers-gguf --embeddings
16
+ ```
17
+
18
+ Then the endpoint can be accessed at http://localhost:8080/embedding, for
19
+ example using `curl`:
20
+ ```console
21
+ curl --request POST \
22
+ --url http://localhost:8080/embedding \
23
+ --header "Content-Type: application/json" \
24
+ --data '{"input": "task: sentence similarity | query: Hello embeddings"}' \
25
+ --silent
26
+ ```
27
+
28
+ Alternatively, the `llama-embedding` command line tool can be used:
29
+ ```sh
30
+ llama-embedding -hf sabafallah/embeddinggemma-300m-sentence-transformers-gguf --verbose-prompt -p "task: sentence similarity | query: Hello embeddings"
31
+ ```