Long Context Pre-Training with Lighthouse Attention
Paper • 2605.06554 • Published • 29
Bot PRO
inflatebot
AI & ML interests
"Potentially one of my biggest flaws is that I genuinely think that the science appreciates when you commit to a bit." - Tom ExtractionsAndIre
Recent Activity
new activity 2 days ago
inflatebot/anima-is-fine-actually:loras? liked a model 2 days ago
circlestone-labs/Anima liked a model 2 days ago
NemoStation/Marlin-2BOrganizations
upvoted a paper 7 days ago
upvoted a collection about 1 year ago
upvoted a collection over 1 year ago