Public model checkpoints for our paper Information Entropy Invariance: Enhancing Length Extrapolation in Attention Mechanisms.
Code is accessible at GitHub.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support