Semantic Deduplication
Find entries with similar meanings so you can review possible duplicates.
This tool needs server processing
The public server is not connected yet. File selection and processing are unavailable on this website.
Browse other tools in this categoryHow to use Semantic deduplication
- Choose a file in CSV.
- Review the settings, then choose Run Semantic deduplication.
- Review the result, then use Copy result or a download link when available.
What to expect
Local MiniLM embeddings propose similarity groups. Local MiniLM embeddings propose similarity groups. At most 500 rows with 1,000 characters per text value. All rows are retained for review; no automatic deletion.