Public model checkpoints for our paper Information Entropy Invariance: Enhancing Length Extrapolation in Attention Mechanisms.

Code is accessible at GitHub.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support