In times of yore, we embarked on a journey to show thee how to train thine own custom AI chatbot utilizing the wondrous ChatGPT API. ‘Twas a feat most noble indeed, yet as the clock ticks and thy free OpenAI credit dwindles, one must needs pay a hefty sum for the continued use of said API, a burden too heavy for many a soul. Moreover, whispers in the wind speak of discomfort in sharing one’s secrets with the likes of OpenAI. Fear not, for a new dawn cometh! Enter PrivateGPT, a project of open-source nature that allows thee to converse with artificial intelligence in privacy, without the need for online connections or coinage. Read on, good friend, as we unveil the secrets of training thine own custom AI chatbot using PrivateGPT in the comfort of thine own abode.
Requirements to Set up PrivateGPT on Thy PC
-
To invoke PrivateGPT locally upon thy machine, a machine of moderate to high stature thou must possess. ‘Tis no task for aged contraptions, as I hath tested PrivateGPT on an entry-level desktop powered by an Intel 10th-gen i3 processor, and lo, it took nigh unto 2 minutes to craft a reply. Take heed, for PrivateGPT shuns the GPU and leans solely upon the CPU, thereby diminishing its performance. But fret not, if curiosity beckons thee, venture forth and explore this project.
- PrivateGPT dances offline, untouched by the whims of online servers or the need for API keys from the likes of OpenAI and Pinecone. ‘Tis a local affair, wherein an LLM model doth reside upon thine very computer. Verily, download a GPT4All-J-compatible LLM model posthaste, and embark on this journey of discovery.
Set Up the Environment to Train a Private AI Chatbot
-
At the outset, install upon thy Windows, macOS, or Linux machine Python 3.10 or newer. Swiftly, procure Python from yonder link, and install it with due haste.
-
Proceed forth and bestow upon thyself Visual Studio 2022, should thy machine be a Windows creation. This shalt provide thee with the C++ CMake tool and UWP components. Seek the “Community” version from this link, and download it freely.
-
Execute the setup, and a wondrous installer shall appear. ‘Tis here thou may select "Desktop Development with C++" and "Universal Windows Platform development." Make thy choice, and let the installation commence.
-
Having completed the installation, restart thy machine. Visual Studio shall remain in the shadows henceforth, but keep its presence as a beacon of hope within thy realm.
- Last but not least, procure the default model known as “groovy” from here. ‘Tis a trove of 3.5GB in size. If thy machine be built of sterner stuff, more models await thee at this link.
May this guide be the key to unlocking the realms of PrivateGPT, a haven where thou may commune with artificial intelligence in the shadows of secrecy, away from prying eyes and grasping hands. Venture forth, intrepid soul, and may the whispers of PrivateGPT echo in the hallowed halls of thine abode.
Support our work ❤️
If you enjoyed this article, consider leaving a tip to help us keep publishing great content.
