Looking for a solution on training my own LLM

danielritchie
Thu, 01 Jun 2023 07:18:03 +0000

abhishek00:

Can anyone help me out here with some insights on this matter, like which base model should i try ? how much data would i need ?

I’m also new to and interested in training a model.

Somewhat related, I wrote a short article which disambiguated the different methods for me. Very basic, but maybe it might be useful:
https://brainwavelabs.substack.com/p/what-does-it-mean-to-train-an-ai

I wonder if you might find fine-tuning to be helpful? I’m sure there are much better (and probably cheaper) options here with . Maybe the training isn’t that difficult, but OpenAI has a pretty straightforward approach for fine tuning:
https://platform.openai.com/docs/guides/fine-tuning

Lots of tutorials out there depending on what your favorite language is, and I’ve seen no-code options also.