#Head size 160 is not supported by PagedAttention

2 messages · Page 1 of 1 (latest)

shrewd marsh
#

Hello, I hope everyone is doing great! I am stuck with this error: ValueError: Head size 160 is not supported by PagedAttention. Supported head sizes are: [64, 80, 96, 112, 128, 256]

Does it mean I have to RETRAIN MY MODEL?
Full logs are in attachment

📎 message.txt
south cairn