Is there plan to support AMD ROCm? I am interesting in using LLMs with qtip 3 bit quantization. I have 2xAMD MI60. If there is a way to compile this repo with AMD ROCm, please, let me know. Thanks!
Is there plan to support AMD ROCm? I am interesting in using LLMs with qtip 3 bit quantization. I have 2xAMD MI60.
If there is a way to compile this repo with AMD ROCm, please, let me know.
Thanks!