#Questions about LLM
1 messages · Page 1 of 1 (latest)
As long as the hardware you have is powerful enough, it should work. I know from testing. I can help you with setting things up if you want
Thank you very much for your reply, but for now it's just to make sure it's theoretically feasible, and I'm not preparing anything other than that
Alright then, feel free to DM me if you decide to do it and want help
Can you take a look at my plans?
1.I'll rent a 4090 for training models(Because the best is only 4090)
2.I'll collect the lines of cheerful girls in a lot of anime, manga, and novels,
and thank you very much for your reply
You could do up to a 24b model with a 4090 with it still fitting in VRAM, but it depends really on how good you want the model to be. The dataset does sound like it could work though. Again, I think we should move this to DMs since it's really not that much Neuro related. I'm just happy to help with technical stuff, I run LLMs myself with a 4070Ti, so I have some experience with them
But the cost is larger,so I'll spend some time learning to reduce costs
Thank you very much for the suggestion,what can I say,You're such a nice guy
I can help you with anything you need for this, DM me if you need more help
OK,I‘m grateful to have you by my side