No attribute `sliding_window`?
#59
by
farzadab
- opened
Has anybody run into these errors, trying to look up Llama4TextConfig.sliding_window when doing inference?
ValueError: Setting cache_implementation to 'sliding_window' requires the model config supporting sliding window attention, please check if there is a sliding_window field in the model config and it's not set to None
Or
AttributeError: 'Llama4TextConfig' object has no attribute 'sliding_window'
Fixed!
This comment has been hidden (marked as Off-Topic)