DEV Community

#latency

Posts

đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.
Compliance Evidence Under Load: 500 Local or Hosted PDF API Jobs at Scale

Compliance Evidence Under Load: 500 Local or Hosted PDF API Jobs at Scale

Comments
6 min read
When Better Latency Metrics Hide Worse Reliability

When Better Latency Metrics Hide Worse Reliability

Comments
8 min read
The Slow Lane: Latency Engineering When Your AI Endpoint Is Free

The Slow Lane: Latency Engineering When Your AI Endpoint Is Free

1
Comments
4 min read
Twelve LLMs Played Werewolf. The Real Wolf Was the Thinking Knob.

Twelve LLMs Played Werewolf. The Real Wolf Was the Thinking Knob.

1
Comments
8 min read
Your agent's p99 is a different animal

Your agent's p99 is a different animal

Comments 1
6 min read
When not to build an agent

When not to build an agent

Comments
8 min read
How I tried to write an article about slow Chinese LLMs

How I tried to write an article about slow Chinese LLMs

17
Comments 16
10 min read
Best-of-N is prepaid retries: the cost math of racing parallel attempts

Best-of-N is prepaid retries: the cost math of racing parallel attempts

Comments
5 min read
Your token bill is the cheap part: dimensioning the real cost of an agent

Your token bill is the cheap part: dimensioning the real cost of an agent

Comments
7 min read
How Fast Should Your AI Voice Agent Respond?

How Fast Should Your AI Voice Agent Respond?

2
Comments 2
4 min read
How we slashed an AI Agent's latency by 80% in 60 minutes

How we slashed an AI Agent's latency by 80% in 60 minutes

13
Comments 3
1 min read
The caller heard silence for two seconds before the agent spoke

The caller heard silence for two seconds before the agent spoke

Comments
6 min read
đź‘‹ Sign in for the ability to sort posts by relevant, latest, or top.