In this guide, we will install KoboldAI with Intel ARC GPU's.
Intel PyTorch Library doesn't have native support for Windows so we have to use Native Linux or Linux via WSL.
Update your kernel to at least Linux 6.2 if you are on older Ubuntu builds.
Note: Updating kernel is not neccesary for WSL.
Then add the package lists for Intel OneAPI:
Then install the necessary packages:
Install KoboldAI from Github:
Then enter into the KoboldAI folder:
Then start KoboldAI with this command:
Note: It will install the necessary libraries at the first run so it can take a while depending on your internet.
Intel PyTorch Library doesn't have native support for Windows so we have to use Native Linux or Linux via WSL.
Setup WSL on Windows:
Follow these instructions to setup Linux environment in Windows, then continue with Ubuntu instructions.- Enter "Windows features" in Windows search bar and select "Turn Windows features on or off".
- Enable both "Virtual Machine Platform" and "Windows Subsystem for Linux" and click OK.
- Restart your computer once update is complete.
- Open PowerShell and execute
wsl --update. - Download Ubuntu 22.04 from Windows Store.
- Start Ubuntu 22.04 and finish user setup.
Install Intel OneAPI and Compute Runtime:
Ubuntu:
Use Ubuntu 23.04 or newer because we will need Linux 6.2 kernel or newer.Update your kernel to at least Linux 6.2 if you are on older Ubuntu builds.
Note: Updating kernel is not neccesary for WSL.
Then add the package lists for Intel OneAPI:
Bash:
sudo apt-get install -y gpg-agent wget
wget -qO - https://repositories.intel.com/graphics/intel-graphics.key | \
sudo gpg --dearmor --output /usr/share/keyrings/intel-graphics.gpg
echo 'deb [arch=amd64,i386 signed-by=/usr/share/keyrings/intel-graphics.gpg] https://repositories.intel.com/graphics/ubuntu jammy arc' | \
sudo tee /etc/apt/sources.list.d/intel.gpu.jammy.list
wget -O- https://apt.repos.intel.com/intel-gpg-keys/GPG-PUB-KEY-INTEL-SW-PRODUCTS.PUB \
| gpg --dearmor | sudo tee /usr/share/keyrings/oneapi-archive-keyring.gpg > /dev/null
echo "deb [signed-by=/usr/share/keyrings/oneapi-archive-keyring.gpg] https://apt.repos.intel.com/oneapi all main" | sudo tee /etc/apt/sources.list.d/oneAPI.list
sudo apt update && sudo apt upgrade -yThen install the necessary packages:
Bash:
sudo apt-get install intel-opencl-icd intel-level-zero-gpu level-zero intel-media-va-driver-non-free libmfx1 libgl-dev intel-oneapi-compiler-dpcpp-cpp intel-oneapi-mkl python3-pip python3-venv git unzip libjemalloc-devArch Linux:
Install the necessary packages for Arch Linux:
Bash:
pacman -S git unzip python-pip python-virtualenv jemalloc intel-media-driver intel-oneapi-basekit intel-compute-runtime intel-graphics-compiler intel-opencl-clangInstalling KoboldAI:
Install KoboldAI from Github:
Bash:
git clone https://github.com/henk717/KoboldAIThen enter into the KoboldAI folder:
Bash:
cd KoboldAIThen start KoboldAI with this command:
Bash:
./play-ipex.sh
