Local LLM
Local LLM
Creating a Docker image for running CUDA and llama.cpp
Creating a Docker Image for Local llama.cpp
Local LLM
Local LLM Setup with CUDA, llama.cpp, and Qwen
Linux/Ubuntu install, CUDA install, server specs, and other details for local inference.
Local LLM
Using Aider for connecting to llama.cpp
Connecting Aider usage for making agent-assisted code edits.