ViTucano is our first attempt at creating a vision assistant natively pretrained in Portuguese. ViTucano is built on top of the Tucano series.
AI & ML interests
Developing foundation models for low-resource languages.
Recent Activity
View all activity
TeenyTinyLlama is a pair of compact language models based on the Llama 2 architecture trained on a Brazilian Portuguese corpus.
-
TeenyTinyLlama: open-source tiny language models trained in Brazilian Portuguese
Paper • 2401.16640 • Published • 10 -
4
TeenyTinyLlama-Chat
🦙Generate text responses to questions or instructions
-
nicholasKluge/TeenyTinyLlama-460m
Text Generation • 0.5B • Updated • 3.5k • 11 -
nicholasKluge/TeenyTinyLlama-460m-awq
Text Generation • 0.1B • Updated • 12 • 1
ViTucano is our first attempt at creating a vision assistant natively pretrained in Portuguese. ViTucano is built on top of the Tucano series.
Tucano is a series of decoder-transformers based on the Llama 2 architecture, natively pre-trained in Portuguese.
TeenyTinyLlama is a pair of compact language models based on the Llama 2 architecture trained on a Brazilian Portuguese corpus.
-
TeenyTinyLlama: open-source tiny language models trained in Brazilian Portuguese
Paper • 2401.16640 • Published • 10 -
4
TeenyTinyLlama-Chat
🦙Generate text responses to questions or instructions
-
nicholasKluge/TeenyTinyLlama-460m
Text Generation • 0.5B • Updated • 3.5k • 11 -
nicholasKluge/TeenyTinyLlama-460m-awq
Text Generation • 0.1B • Updated • 12 • 1