Run models on a desktop computer?

bugslife
Tue, 05 Dec 2023 03:42:14 +0000

is there any suggestion to simply assess local GPU performance againt the target model that run via pipeline?
I believe the most choice of GPU for individual developers are Nvidia RTX serials, just want to make sure the GPU can run the model before downloading from hf.