Deployment of Meta Llama 3.1 70B Instruct

karim707
Thu, 09 Jan 2025 18:26:32 +0000

As it is mentioned in the huggingface website that there are certain models that could be used for inferencing if anyone purchases the pro subscription. Supported Models
I am interested in deploying Meta-Llama-3.1-70B-instruct. I wanted to confirm before purchasing the pro subscription that will it going to work? The reason for asking this is as i have gone through some of the previous chats where people are getting issue while inferencing this type of large model.

Your response will help me alot.
Thank you

Read full topic