koko210Serve c0aaab0c3a Disabled KV cache offloading on llama-server and enabled Flash Attention. Performance gains in the tens.

2026-01-27 19:11:49 +02:00

1.4 KiB

Raw Blame History

View Raw