You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Jul 20, 2025. It is now read-only.
I attempted to load up flan-ul2 4-bit 128g gptq, but it looks like T5ForConditionalGeneration isn't supported, or perhaps Encoder/Decoder type LLMs in general.
In particular, https://github.com/qwopqwop200/transformers-t5 would also likely be needed to provide support for quantized T5.
I attempted to load up flan-ul2 4-bit 128g gptq, but it looks like
T5ForConditionalGenerationisn't supported, or perhaps Encoder/Decoder type LLMs in general.In particular, https://github.com/qwopqwop200/transformers-t5 would also likely be needed to provide support for quantized T5.