All Tools
Remove Duplicates
Remove duplicate lines, words or numbers from your text with customizable filtering options. Keep first, keep last, or remove all duplicates.
Input
Output
Options
About duplicate remover
How it works
The Duplicate Remover eliminates repeated lines, words, or numbers from your text while preserving the original order. It supports three modes: remove duplicate lines, remove duplicate words, and remove duplicate numbers.
Use cases
- Clean up contact lists — remove duplicate phone numbers or email addresses
- Organize playlists — eliminate重复 songs from your music library
- Process survey data — remove duplicate responses for accurate analysis
- Clean CSV/Excel data — deduplicate before importing to a database
- Organize notes — remove repeated ideas or phrases
Configuration options
The tool offers several settings to control how duplicates are identified:
- Case sensitive — treat "Hello" and "hello" as different items
- Whitespace handling — ignore leading/trailing spaces
- Empty line removal — skip blank lines in the output
- Preserve order — keep the first occurrence and remove later duplicates
Input formats
You can paste text from any source:
- Plain text from Notepad or TextEdit
- Copied from websites or emails
- Exported from spreadsheets (CSV, TSV)
- Code lists or configuration files