Update README.md
Browse files
README.md
CHANGED
|
@@ -290,7 +290,7 @@ Current version: parakeet-tdt-0.6b-v2. Previous versions can be [accessed](https
|
|
| 290 |
|
| 291 |
This model was trained using the NeMo toolkit [3], following the strategies below:
|
| 292 |
|
| 293 |
-
- Initialized from a FastConformer SSL checkpoint that was pretrained with a
|
| 294 |
- Trained for 150,000 steps on 64 A100 GPUs.
|
| 295 |
- Dataset corpora were balanced using a temperature sampling value of 0.5.
|
| 296 |
- Stage 2 fine-tuning was performed for 2,500 steps on 4 A100 GPUs using approximately 500 hours of high-quality, human-transcribed data of NeMo ASR Set 3.0.
|
|
|
|
| 290 |
|
| 291 |
This model was trained using the NeMo toolkit [3], following the strategies below:
|
| 292 |
|
| 293 |
+
- Initialized from a FastConformer SSL checkpoint that was pretrained with a wav2vec method on the LibriLight dataset[7].
|
| 294 |
- Trained for 150,000 steps on 64 A100 GPUs.
|
| 295 |
- Dataset corpora were balanced using a temperature sampling value of 0.5.
|
| 296 |
- Stage 2 fine-tuning was performed for 2,500 steps on 4 A100 GPUs using approximately 500 hours of high-quality, human-transcribed data of NeMo ASR Set 3.0.
|