Easy Install Llama-Vicuna AI local on your Computer. Only 8 GB Harddisk needed.

Started by Theo Gottwald, April 11, 2023, 08:38:37 AM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Theo Gottwald

The GPT4-x-Alpaca is a remarkable open-source AI LLM model that operates without censorship, surpassing GPT-4 in performance. In this video, I will demonstrate the capabilities of this extraordinary LLM model. I will guide you through the process of installing GPT4-x-Alpaca on your computer using the llama.cpp package.

Vicuna is an open-source AI project that purportedly provides 90% of the power of ChatGPT. I will also demonstrate how to install Vicuna on your PC using the llama.cpp package for CPU.

Llama.cpp: https://github.com/ggerganov/llama.cpp
Vicuna: https://vicuna.lmsys.org/
Vicuna Weights: https://huggingface.co/anon8231489123...
GPT4 x Alpaca Model Weights: https://huggingface.co/anon8231489123...
GPT4 x Alpaca Dataset: https://github.com/teknium1/GPTeacher

Contents of run.bat file (copy below the line):
I have increased the number of threads to 32 this will speed up the answering a lot.

title llama.cpp
main -i --interactive-first -r "### Human:" --memory_f32 --mlock --top_k 120  --top_p 0-9 --keep -1 --threads 30 --color --temp 0 -c 2048 -n -1 --repeat_penalty 1.2 --instruct -m ggml-model-q4_1.bin

echo -- DONE --
goto start