Just trained a 2B coding model to rank candidate AI/ML research ideas against the implicit preferences in a code repository's merge history.
The training data comes from a Gaussian Process fit on the accumulated dispositions in VQASynth, where each PR against a deployed project yields a pairwise comparison between the feature branch preferred and the baseline at main.
The GP scores candidate papers to synthesize preference pairs, and DPO with LoRA bakes the ranking pipeline into the model's weights.
After 1 epoch the model reaches 87.4% reward accuracy on the held-out eval split against 92.3% on training, consistent with learning the task without overfitting.
Now, I'm scaling the pipeline to thousands of repos for a generalization test.
Turns out : if we predict π earth we can save a lot of time looking for interesting things and less time looking at things that we expect to see.
Sentinel-2 imagery π°οΈbasically takes a long time to download towards earth. so our "near real time" systems are quite far from that in practical terms.
meanwhile , if we "predict" what we will see , based on what we do see , we can send down much less data in a timely way , and prioritize π‘earth-bound response .
I'm talking about illegal fishing , logging , mining or building in nature reserves , the more of that we predict early the more we're able to stop it on time.
Weβre excited to announce that Unsloth has joined the PyTorch Ecosystem! π₯π¦₯
Unsloth is an open-source project that makes training & running models more accurate and faster with less compute. Our mission is to make local AI accessible to everyone. Thanks to all of you for making this possible! π
Just published: how we built production Sango (Central African Republic) translation without fine-tuning, parallel corpus, or training compute.
The method β vocabulary-augmented prompting with a 581-entry native-speaker-verified lexicon β generalizes to any of the ~2,000 African languages at the same data-poverty level. Recipe, dataset, and code template all included.