Deduplication - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

InApp

Nov 5

Deduplicating 12,000 job postings taught me the same job is posted five times

#jobsearch #deduplication #api #ai

1 min read

EngelbertPierce7942

Oct 31

5 Source Deduplication Fixes for Semantic Listing Retrieval in Node.js (and What I Kept)

#rag #retrieval #deduplication #healthtech

6 min read

QuentinBarrett5281

Oct 29

Node.js Catalogue Intake — Supplier Image Metadata and Hash Identity Before Processing

#imageprocessing #deduplication #edtech #sre

8 min read

mattleeee

Oct 11

Notification Deduplication: A Five-Minute Title Window

#deduplication #idempotency #notifications #timewindow

7 min read

InApp

Oct 9

My jobs search API returned the same posting five times — syndication broke my URL dedup

#jobsearch #deduplication #datacleaning #ai

2 min read

grahamprice3746

Aug 31

Notification Deduplication for a Go Gaming Voice Lobby Fan-Out Path

#go #realtime #deduplication

7 min read

Sep 3

Crawling at Scale: Scheduling, Deduplication, and Storage

#webcrawling #scraping #pipelines #deduplication

2 min read

Aug 25

When RAG Says Duplicate but the LLM Disagrees: Building an Adjudication Layer

#rag #llm #typescript #deduplication

6 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.