About the Amazon SageMaker category

m-ali-awan
Tue, 22 Jun 2021 09:30:14 +0000

Hi @philschmid, hope you are fine.
I have a model that is huge it requires 50GB of system Ram and after loading it to gpu it requires 14 Gb of gpu ram, and we will most likely go with g4dn.4xlarge which has 4 gpu’s and we will deploy one model on each gpu and make 1 api to interact with them.
So, is it possible to import huggingface pretraiend model in sagemaker, and then deploy it.

Thanks for any help.