Skip to content
utilnest

Remove duplicate lines

Paste a list of emails, keywords, URLs or names and keep each line only once.

  • Works in your browser
  • No sign-up
  • Free to use

How to use Remove duplicate lines

  1. 1

    Paste your list into the Input box, one item per line.

  2. 2

    Choose whether the first or the last copy of a repeated line stays, and whether case and spaces count.

  3. 3

    Copy the unique lines or download them as a .txt file. The counter shows how many lines were removed.

What this tool does

This tool removes repeated lines from any text, so every line appears once. It is the quick fix for mailing lists with double entries, keyword lists merged from several sources, log files and exported spreadsheet columns.

Features

  • Keep first or last copy, with the original order preserved either way.
  • Case-insensitive matching when "Apple" and "apple" should count as one.
  • Space-tolerant matching that ignores leading and trailing spaces and tabs.
  • Empty-line removal in the same pass.
  • Live counts of lines in, lines out, duplicates and empty lines removed.

Limits

  • Lines are compared as whole lines. To remove repeated words inside a line, or near-duplicates that differ by a typo, use another method.
  • Line breaks in the output are always plain line feeds (\n). Most editors and spreadsheets accept this.
  • To sort the list too, run the result through the text sorter.

Where your text is processed

This tool works in your browser: what you paste is processed on your own device, so it isn't sent to our server for this tool. Some other tools on UtiloNest do use our server, and their pages say so.

Frequently asked questions

Does it keep the original order?

Yes. Lines stay in the order they appear. With "First copy" each line stays where it first appears; with "Last copy" it stays where it last appears, which is useful when later entries are the most recent.

Are "Apple" and "apple" treated as the same?

Only if you tick "Ignore upper/lower case". Then the first (or last) spelling is the one kept. Without it, lines must match letter for letter.

What does "Ignore spaces at line ends" do?

Lines that differ only by spaces or tabs at the start or end, which often sneak in when copying from spreadsheets, count as duplicates, and the extra spaces are removed from the result.

How large a list can I paste?

Hundreds of thousands of lines work in a modern browser. Very large pastes, many megabytes, can make the page slow while it updates.

Where is my list processed?

In your browser. This tool works on your own device, so the list you paste isn't sent to our server.

Was this tool helpful?