Finetune on new language on pretrained model llm | Learn AI Together | Page 1

topaz osprey Aug 26, 2024, 7:12 PM

#

Hello, can anyone help me out to find a perfect resource or suggestions on how to train a pretrained model on new language ・

twin island Aug 28, 2024, 3:13 AM

#

Use multilingual pretrained model as base. Also what are you trying to achieve specifically?

novel jewel Aug 28, 2024, 3:33 AM

#

@topaz osprey , you can try this open source: https://github.com/hiyouga/LLaMA-Factory

GitHub

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024) - hiyouga/LLaMA-Factory

topaz osprey Aug 28, 2024, 5:14 AM

#

i want that many model dont understand in that good on the historic language so i want to train it on one of the pre trained llm on new language

#Finetune on new language on pretrained model llm