Setting up an Intel Arc GPU on Arch Linux for local LLM use (without ReBAR)
TLDR. I was able to run local LLMs using my Intel Arc A750 GPU on a system without ReBAR by using the Vulkan backend and by disabling FP16. Since the launch of Intel’s Arc GPUs I’ve been interest...