Remove duplicate lines from any list
Paste a list to keep each line once. Choose how strictly lines are compared and whether the first or last copy stays.
How to remove duplicate lines
- 1Paste your list with one item per line.
- 2Choose whether capitals and surrounding spaces count as different.
- 3Keep the first or the last copy of each line; order is otherwise unchanged.
- 4Press Copy result to take the unique lines.
Common uses
- Email and contact lists: merge two exports and keep each address once.
- Keyword and tag lists: clean up SEO keyword research or hashtag sets.
- URLs and log lines: reduce a crawl or log export to unique entries.
- Names and inventories: spot repeated entries before importing into a spreadsheet or database.
How lines are compared
Two lines are duplicates when they match after the options are applied. With the defaults, capitals and spaces at either end are ignored, so "Apple", "apple" and " apple" are one line. Spaces inside a line always count, as do punctuation and accents: "café" and "cafe" stay separate. Tick "Match case" and untick "Ignore surrounding spaces" for an exact, character-for-character comparison.
Frequently asked questions
How do I remove duplicate lines from a list? +
Paste the list on the left. Every repeated line is removed and only the first copy is kept, in the original order. The count of duplicates removed appears under the boxes.
Does it keep the original order? +
Yes. Lines stay in the order they first appear. Choose "Keep last" to keep the final copy of each line instead, which is useful when later entries are more up to date. To sort the list as well, use the alphabetical order tool afterwards.
Are "Apple" and "apple" treated as duplicates? +
By default, yes: capitals are ignored when comparing lines, and the first spelling is kept. Tick "Match case" to treat them as different lines.
What about extra spaces at the start or end of a line? +
"Ignore surrounding spaces" is on by default, so " apple " and "apple" count as the same line, and the result is trimmed. Turn it off to compare lines exactly as they are.
How do I remove duplicates in Excel or Google Sheets? +
In Excel, select the column and choose Data > Remove Duplicates. In Google Sheets, choose Data > Data cleanup > Remove duplicates, or use =UNIQUE(A:A). For a quick list outside a spreadsheet, paste it here.
Is there a limit to how many lines I can paste? +
The tool handles tens of thousands of lines in the browser (up to 200,000 characters). Nothing is uploaded, so email lists and customer data stay on your device.