Gguf - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Sep 18

How to Run GGUF Models Locally: Ollama, llama.cpp & vLLM

#ai #gguf #ollama #llamacpp

5 min read

Aravinda 加阳

Sep 10

How to Import LM Studio Models into Ollama (No Re-Download!) 🚀

#ollama #lmstudio #gguf #modelfile

3 min read

Sep 13

GGUF Quantization: Which Level Should You Use?

#ai #gguf #quantization #localllm

5 min read

Aug 9

GGUF vs GPTQ vs AWQ: Which Quantization Format Should You Actually Use?

#gguf #huggingface #ai #devops

4 min read

Pneumetron

Jul 19

Unsloth Releases Inkling-GGUF: A Multimodal MoE Model for Developers

#aiml #multimodalmodels #mixtureofexperts #gguf

3 min read

Pneumetron

Jul 18

GnLOLot Releases MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF for Enhanced Local AI Development

#gguf #llamacpp #quantized #minicpm5

3 min read

Pneumetron

Jul 15

Bonsai-27B: A 1-Bit LLM for On-Device Inference with Llama.cpp and MLX

#llm #quantization #1bit #gguf

3 min read

Joske Vermeulen

Aug 6

KAT-Coder V2.5 Local Setup Guide: GGUF, vLLM, SGLang

#katcoder #localai #coding #gguf

7 min read

Kunal

Jul 6

LLM Quantization Levels Compared: Q4_K_M vs Q8_0 vs FP16 [2026]

#localllm #quantization #gguf #ollama

15 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.