DEV Community

#llamacpp

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
llama.cpp vs Ollama in 2026: Which Runtime Should You Run?
rosgluk profile
Rost

llama.cpp vs Ollama in 2026: Which Runtime Should You Run?

#llamacpp #ollama #llm #selfhosting
Comments
18 min read
How to Run GGUF Models Locally: Ollama, llama.cpp & vLLM
mrsaynothing profile

How to Run GGUF Models Locally: Ollama, llama.cpp & vLLM

#ai #gguf #ollama #llamacpp
Comments
5 min read
llama.cpp vs Ollama: Which Should You Run in 2026?
mrsaynothing profile

llama.cpp vs Ollama: Which Should You Run in 2026?

#ai #llamacpp #ollama #localllm
Comments
5 min read
Gemma 4 on an 2021 4 GB Laptop GPU: QAT Takes It From 9.5 GiB to 1.6
xbill profile

Gemma 4 on an 2021 4 GB Laptop GPU: QAT Takes It From 9.5 GiB to 1.6

#gemma #llamacpp #mcp #cuda
10
Comments 3
13 min read
ROCm vs Vulkan for AMD Local LLM Hosting: 2026 Guide
rosgluk profile
Rost

ROCm vs Vulkan for AMD Local LLM Hosting: 2026 Guide

#llm #selfhosting #llamacpp #ollama
Comments 2
20 min read
KV Cache on 16 GB GPUs: Making Long Context Actually Fit
rosgluk profile
Rost

KV Cache on 16 GB GPUs: Making Long Context Actually Fit

#llm #llamacpp #vllm #ollama
Comments 1
22 min read
Running llama.cpp on a 32 GB MacBook Air: A Direct Comparison with Ollama
vishnuhd profile

Running llama.cpp on a 32 GB MacBook Air: A Direct Comparison with Ollama

#ai #localllm #llamacpp #ollama
Comments 1
9 min read
Fix Local LLM Quality: Context Stacking & Rope Freq Tweaks
umair24171 profile

Fix Local LLM Quality: Context Stacking & Rope Freq Tweaks

#localllms #aiagents #ollama #llamacpp
Comments
8 min read
Two Rust Clients for Gemma 4: Calling the Endpoint vs. Calling the MCP Server 🦀
xbill profile

Two Rust Clients for Gemma 4: Calling the Endpoint vs. Calling the MCP Server 🦀

#rust #mcp #gemma #llamacpp
8
Comments 1
17 min read
"V cache quantization requires flash_attn" — the llama.cpp error that quietly halves your context window
dreamdeck profile

"V cache quantization requires flash_attn" — the llama.cpp error that quietly halves your context window

#llamacpp #llm #performance #debugging
Comments
10 min read
Nine ways to talk to a local model
thekilteddev profile

Nine ways to talk to a local model

#localllm #ollama #llamacpp #buildinpublic
Comments
9 min read
Can Qwen 3.8 running on your laptop really replace Claude Opus for Agentic coding?
deepu105 profile

Can Qwen 3.8 running on your laptop really replace Claude Opus for Agentic coding?

#ai #llamacpp #localllm #qwen38
7
Comments 3
20 min read
My inference server decided my second GPU no longer exists. Here is how I got it back without upgrading a driver.
rickeshtn profile

My inference server decided my second GPU no longer exists. Here is how I got it back without upgrading a driver.

#gpu #llamacpp #ollama #homelab
Comments 1
3 min read
GnLOLot Releases MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF for Enhanced Local AI Development
pneumetron profile

GnLOLot Releases MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF for Enhanced Local AI Development

#gguf #llamacpp #quantized #minicpm5
Comments
3 min read
Running a 1.5B-Parameter LLM Entirely On-Device for Mental Health — The NilaMind Architecture
sampathmannam profile

Running a 1.5B-Parameter LLM Entirely On-Device for Mental Health — The NilaMind Architecture

#llamacpp #opensource #android
Comments
5 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.