Note FineMath datasets

HuggingFaceTB/FineMath-Llama-3B

3B • Updated Jan 6 • 184 • 15

Note Llama 3B trained on a mix of FineMath and FineWeb-Edu: better at math and similar to Llama in reasoning, knowledge and common sense

HuggingFaceTB/finemath-classifier

Text Classification • 0.1B • Updated Dec 19, 2024 • 9.15k • • 12

Note FineMath text classifier to score the mathematical reasoning and educational content

HuggingFaceTB/finemath-ablation-infiwebmath-3plus

3B • Updated Dec 19, 2024 • 72

Note Ablations on FineMath subsets (continual pre-training of base Llama 3.2 3B on 60B tokens)

HuggingFaceTB/finemath-ablation-finemath-infimath-4plus

3B • Updated Dec 19, 2024 • 70 • 2

Note Ablations on FineMath plus3 and plus4 (continual pre-training of base Llama 3.2 3B on 60B tokens)

HuggingFaceTB/finemath-ablation-owm

3B • Updated Dec 19, 2024 • 64

Note Ablations on public math datasets and FW-Edu as a baseline (continual pre-training of base Llama 3.2 3B on 60B tokens)

HuggingFaceTB/finemath-ablation-4plus-160B

3B • Updated Dec 19, 2024 • 67

Note Longer ablation for 160B on a mix of 40% fineweb-edu 60% FineMath and Infiwebmath 3plus / 4plus