Fix incorrect unk_id assignment
#16
by
codecho
- opened
self.unk_id is currently incorrectly assigned the ID of pad_token. Inferring from the original comment, the intention was likely to use self.unk_token (the second-to-last special token) to fetch its correct ID; this PR applies this correction.
However, I think this fix might affect model performance without retraining.