Update README.md
Browse files
README.md
CHANGED
|
@@ -38,7 +38,7 @@ For more details about the training protocol of this model, please refer to the
|
|
| 38 |
|
| 39 |
# Usage
|
| 40 |
|
| 41 |
-
Currently to use this model you can either rely on Hugging Face `transformers`, `vLLM` or
|
| 42 |
|
| 43 |
## Inference
|
| 44 |
|
|
@@ -84,8 +84,7 @@ vllm serve tiiuae/Falcon-H1-1B-Instruct --tensor-parallel-size 2 --data-parallel
|
|
| 84 |
|
| 85 |
### `llama.cpp`
|
| 86 |
|
| 87 |
-
|
| 88 |
-
Use the same installing guidelines as `llama.cpp`.
|
| 89 |
|
| 90 |
# Evaluation
|
| 91 |
|
|
|
|
| 38 |
|
| 39 |
# Usage
|
| 40 |
|
| 41 |
+
Currently to use this model you can either rely on Hugging Face `transformers`, `vLLM` or `llama.cpp` library.
|
| 42 |
|
| 43 |
## Inference
|
| 44 |
|
|
|
|
| 84 |
|
| 85 |
### `llama.cpp`
|
| 86 |
|
| 87 |
+
You can find all GGUF files under [our official collection](https://huggingface.co/collections/tiiuae/falcon-h1-6819f2795bc406da60fab8df)
|
|
|
|
| 88 |
|
| 89 |
# Evaluation
|
| 90 |
|