none of the demos work on a 3090

[emersonium]

was able to downgrade transformers and get the CLI to work, the gradio app still not working for 4 bit quantization.

[S-15-77]

@emersonium
Try to fork the whole repo and install the req docs in requirement.txt, It works fine for me in colab

[emersonium]

thanks, all good, was able to do that, and then rewrite the webdemo to work with hf and some other things, its great