Semantic deduplication
Local MiniLM embeddings propose similarity groups.
No files selected
Accepted files: .csv. Choose one file. Up to 20 MiB in total.
Local MiniLM embeddings propose similarity groups. At most 500 rows with 1,000 characters per text value. All rows are retained for review; no automatic deletion. Up to 1,000,000 characters. Review the settings before running.
Your result
How to use Semantic deduplication
- Choose a file in CSV.
- Review the settings, then choose Run Semantic deduplication.
- Review the result, then use Copy result or a download link when available.
What to expect
Local MiniLM embeddings propose similarity groups. Local MiniLM embeddings propose similarity groups. At most 500 rows with 1,000 characters per text value. All rows are retained for review; no automatic deletion.