DEV Community

Ward Ed profile picture

Ward Ed

404 bio not found

Joined Joined on 
SWE-bench Verified on Hugging Face: 9 Self-Reported Rows Top the Official Table's Best, and 6 Repos Fill 16 of 78 Rows

SWE-bench Verified on Hugging Face: 9 Self-Reported Rows Top the Official Table's Best, and 6 Repos Fill 16 of 78 Rows

Comments 1
14 min read
GSM8K on Hugging Face: 4 of the Top 12 Rows Show a Sibling Checkpoint's Score, and 20 of 28 Rows Are Unmerged PRs

GSM8K on Hugging Face: 4 of the Top 12 Rows Show a Sibling Checkpoint's Score, and 20 of 28 Rows Are Unmerged PRs

Comments
14 min read
Terminal-Bench 2.0 vs 2.1 on Hugging Face: A 2.1 Score Is Ranked First on the 2.0 Board

Terminal-Bench 2.0 vs 2.1 on Hugging Face: A 2.1 Score Is Ranked First on the 2.0 Board

Comments
15 min read
Humanity's Last Exam on Hugging Face: At Least 23 of the Top 24 Rows Use Tools, and the Board Has No Column for It

Humanity's Last Exam on Hugging Face: At Least 23 of the Top 24 Rows Use Tools, and the Board Has No Column for It

Comments
15 min read
SWE-Bench Pro Has Two Versions: What the Hugging Face Leaderboard's 47 Rows Mix Together

SWE-Bench Pro Has Two Versions: What the Hugging Face Leaderboard's 47 Rows Mix Together

Comments
14 min read
Reading a Hardware-Equivalence Claim Like an Evaluator: A Checklist Applied to an NPU vs GPU Pretraining Twin

Reading a Hardware-Equivalence Claim Like an Evaluator: A Checklist Applied to an NPU vs GPU Pretraining Twin

Comments 1
2 min read
What a Youden index of 77 actually means on the OWASP Benchmark

What a Youden index of 77 actually means on the OWASP Benchmark

Comments
1 min read
GPQA Diamond Has 198 Questions: What the Hugging Face Leaderboard's 115 Rows Can and Cannot Rank

GPQA Diamond Has 198 Questions: What the Hugging Face Leaderboard's 115 Rows Can and Cannot Rank

Comments
14 min read
Do 66 Terminal Tasks and a 45% Private Weight Settle AI Rankings? Reading Artificial Analysis Index v4.3

Do 66 Terminal Tasks and a 45% Private Weight Settle AI Rankings? Reading Artificial Analysis Index v4.3

Comments
12 min read
Best Open-Weight LLM in October 2026? Auditing Two Leaderboards Row by Row

Best Open-Weight LLM in October 2026? Auditing Two Leaderboards Row by Row

1
Comments
12 min read
How to Read a Public Leaderboard Without Fooling Yourself

How to Read a Public Leaderboard Without Fooling Yourself

Comments
3 min read
Benchmark Contamination 101: How Train/Test Overlap Inflates Leaderboard Scores (and How to Catch It)

Benchmark Contamination 101: How Train/Test Overlap Inflates Leaderboard Scores (and How to Catch It)

1
Comments 3
7 min read
When a 0.4-Point Lead Means Nothing: Reading Open-Model Leaderboard Margins Like a Statistician

When a 0.4-Point Lead Means Nothing: Reading Open-Model Leaderboard Margins Like a Statistician

Comments
7 min read
How Hugging Face Official Benchmark Leaderboards Actually Work: .eval_results YAML, the base_model Filter, and the 30% the Default View Hides

How Hugging Face Official Benchmark Leaderboards Actually Work: .eval_results YAML, the base_model Filter, and the 30% the Default View Hides

Comments 1
10 min read
loading...