Exllama cache 8bit#2719

merrymercy merged 3 commits intolm-sys:mainlm-sys/FastChat:mainfrom

K-tec-UK:exllama-cache-8bitK-tec-UK/FastChat:exllama-cache-8bitCopy head branch name to clipboard