Localllm - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Sep 14

How I upgrade xiaoai speaker local llm: Sub-200ms AI

#aiagents #localllm #iot #node

10 min read

Sep 18

Best Local LLM for Coding: 8GB to 24GB VRAM Picks

#ai #localllm #coding #ollama

4 min read

Sep 18

llama.cpp vs Ollama: Which Should You Run in 2026?

#ai #llamacpp #ollama #localllm

5 min read

Sep 18

Ollama vs LM Studio: Which Local LLM Tool Should You Use?

#ai #ollama #lmstudio #localllm

4 min read

Vishnu Hari Dadhich

Sep 14

What Happens When You Ask an LLM a Question

#ai #localllm #llmbasics #gpu

8 min read

Vishnu Hari Dadhich

Sep 14

Run vLLM on Kubernetes with Minikube, WSL2 and NVIDIA GPU

#ai #localllm #vllm #kubernetes

13 min read

Kevin Tang

Sep 6

I Ran DeepSeek V4 Flash Across Two DGX Sparks Over Ethernet

#ai #hardware #localllm #networking

11 min read

Tech-Gurunomics

Sep 6

VRAM and RAM for local LLMs — honest planning bands, not a GPU tier list

#localllm #llm #ollama #hardware

4 min read

Vishnu Hari Dadhich

Sep 7

Running Ollama on a 32 GB MacBook Air: A Practical First Setup

#ai #localllm #ollama #applesilicon

6 min read

Vishnu Hari Dadhich

Sep 7

Running llama.cpp on a 32 GB MacBook Air: A Direct Comparison with Ollama

#ai #localllm #llamacpp #ollama

9 min read

Vishnu Hari Dadhich

Sep 7

Running a 35B MoE Model on an 8 GB Laptop GPU: Testing FreeToken

#ai #localllm #freetoken #gpu

7 min read

Sep 5

Temperature 0 is not reproducible. I measured 30 percent of my output changing between identical runs.

#llm #benchmarks #localllm #reproducibility

3 min read

Sep 5

I told the model to separate fields with <TAB>. It did exactly that, and I lost 79 percent of my data.

#llm #prompting #debugging #localllm

3 min read

Sep 5

Our 4B beat Claude Opus on a 440K-token corpus. Then it came last on the public benchmark.

#llm #benchmarks #localllm #privateai

4 min read

Sep 5

A 4B on a 6GB laptop matched frontier-model accuracy on aggregation — except when the answer is a number

#llm #benchmarks #localllm #agents

4 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.