Quote:
Originally Posted by astrogeek
Moved: This thread is more suitable in Linux General and has been moved accordingly to help your thread/question get the exposure it deserves.
|
Thanks. I think it might not be feasable or possible at the current time, for most people without cloud computing/supercomputers, as LLM's require training for about 100 days so far from researching..... I'll try to work on this later, maybe technology will change, posting on blog. found psmathur_orca_mini_3B that is 2/3 faster but has different license. will try to give works cited , security permitting. [subject to change]
the h2o studio supposedly lets you fine tune without programming.
This appears to be differant than cutting uneeded parts out and reformating the config files. Such as removing bin files. SIMPLY CUTTING PARTS OUT This was a waste of time as it was still slow. tried with a different model.
https://www.youtube.com/watch?v=u48QaIAIFw4
Discovering the Potential of LLMs: A Journey through H2O.ai's LLM Studio!
watched at about 23 minutes...
BigScience model, book not found
but license info:
https://bigscience.huggingface.co/bl...e-rail-license
too big for me, here is link:
https://bigscience.huggingface.co/bl...e-rail-license
for mini orca model, the developers may work on making 4bit:
https://huggingface.co/psmathur/orca_mini_3b
also found:
https://huggingface.co/TheBloke/orca_mini_3B-GGML
Other info:
fine-tuning:
https://dzone.com/articles/custom-tr...dels-a-compreh
vs.
building your own:
https://www.databricks.com/resources...ge-model-dolly
other better link for beginners:
http://A jargon-free explanation of ...ge models work
info on orca language model:
https://huggingface.co/psmathur/orca_mini_3b; worked well, may be based on GPT4
web ui, used one click installer (Windows/multiplatform) on about middle of page:
https://github.com/oobabooga/text-generation-webui
page with install view llm model on ubuntu, view and manage dataset:
https://docs.h2o.ai/h2o-llmstudio/gu...s/view-dataset
Security: Should avoid personal info, follow proper guidlines, laws.... who defines what is ultimately good ?the supreme lawgiver of the universe.// fix spelling grammer, update