About the Amazon SageMaker category

m-ali-awan
Tue, 22 Jun 2021 13:26:33 +0000

Hi @philschmid , thanks alot, as you always respond to my queries.

It would be great if you can share with me the link of PyTorch deployment.

Further, my model is a conversion from jax to pytorch, and it is GPT-J.Now as you know that with AWS inferentia chips, the deployment becomes cheap, and more efficient.
So, is it possible for GPT-J to be compiled with neuron sdk.As there is an example for huggingface bert, but I am not sure for GPT.As I know that neuron compilation does not work for all kinds of models.

Thanks again, for all your help.