Remove Duplicate Lines

Clean up email lists, keyword lists, log extracts or exported spreadsheet columns. Paste one item per line and get back a list where every line appears only once, in its original order.

How to use Remove Duplicate Lines

  1. Paste your list into the left box, one item per line.
  2. Choose whether “Apple” and “apple” count as the same line, and whether to trim spaces and drop empty lines.
  3. Optionally pick a sort order for the result.
  4. Copy the cleaned list or download it as a text file. The summary shows how many duplicates were removed.

About this tool

The tool keeps the first occurrence of each line and removes later repeats, so the order of your list is preserved unless you choose to sort it. With “Ignore upper/lower case” on, the first spelling wins: if “Paris” appears before “paris”, you keep “Paris”.

Invisible differences are the most common reason duplicates survive: a trailing space, a tab, or Windows line endings. “Trim spaces” removes spaces and tabs at the start and end of each line before comparing, and Windows (CRLF) and old Mac (CR) line endings are normalised automatically. Spaces inside a line still matter, so “New York” with two spaces is different from “New York”.

Everything runs in your browser and handles lists of hundreds of thousands of lines in a fraction of a second, because each line is looked up in a hash set rather than compared with every other line.

Frequently asked questions

Does it keep the original order?

Yes. With sorting set to “Keep original order”, lines stay where they first appeared and only later repeats are removed.

Can I remove duplicates from an Excel column?

Yes. Copy the column in Excel or Google Sheets, paste it here, then copy the result and paste it back. Each cell becomes one line.

How do I find which lines were duplicates?

Use the Text Diff tool: paste the original list on the left and the cleaned list on the right to see exactly which lines were removed.

Are my texts uploaded to a server?

No. The whole process runs inside your browser with JavaScript. Your texts never leave your device, which also means the tool keeps working if you go offline after the page has loaded.

Is this tool really free?

Yes. There is no sign-up, no daily limit, no watermark and no paid tier. The site is supported by advertising shown on the page, not by charging for the tools.