Update README.md
Browse files
README.md
CHANGED
|
@@ -120,6 +120,9 @@ output = model.generate_from_batch(
|
|
| 120 |
```
|
| 121 |
Note that we have observed that this can change the output of the model compared to running with float32 weights.
|
| 122 |
|
|
|
|
|
|
|
|
|
|
| 123 |
## Evaluations
|
| 124 |
|
| 125 |
| Model | Average Score on 11 Academic Benchmarks | Human Preference Elo Rating |
|
|
|
|
| 120 |
```
|
| 121 |
Note that we have observed that this can change the output of the model compared to running with float32 weights.
|
| 122 |
|
| 123 |
+
## vLLM
|
| 124 |
+
Molmo is supported in vLLM, however please use version <=0.7.2 until a [prepreprocessing bug](https://github.com/vllm-project/vllm/issues/26451) is fixed.
|
| 125 |
+
|
| 126 |
## Evaluations
|
| 127 |
|
| 128 |
| Model | Average Score on 11 Academic Benchmarks | Human Preference Elo Rating |
|