Run models on a desktop computer?

shikhardadhich
Tue, 29 Aug 2023 11:29:58 +0000

I tried installing “HuggingFaceH4/starchat-beta” but it did not work, the above code worked but for Starchat model I am getting multiple memory issues. I have 1 GPU 15GB with 64GB RM Ubuntu.