Local LLM

Local LLM

Creating a Docker image for running CUDA and llama.cpp

Creating a Docker Image for Local llama.cpp

Local LLM

Local LLM Setup with CUDA, llama.cpp, and Qwen

Linux/Ubuntu install, CUDA install, server specs, and other details for local inference.

Local LLM

Using Aider for connecting to llama.cpp

Connecting Aider usage for making agent-assisted code edits.