Duplicate Highlighter
Paste any list to highlight every line that appears more than once, including lines that are almost the same. Or compare two lists to see what is in both and what is missing from each.
Paste your list
One item per line. Duplicates are highlighted as you paste.
Your data has columns. Tick the ones to check. Tick more than one to find rows where all of them match.
Options
Result
What it does
It finds lines that appear more than once in a list and highlights them. Each set of duplicates gets its own colour, and every line says how many times it appears or which earlier line it repeats.
The first time a line appears is kept as the original. Every later copy is marked as a repeat, and that is the one left out when you copy the list without duplicates.
Exact, loose and almost the same
- Exact. Open Options and untick everything, and the lines must be identical, character for character.
- Loose. Ignore case, spaces, punctuation or word order, so "SEO Services, Colombo" and "colombo seo services" count as the same line.
- Almost the same. Tick "Also find lines that are almost the same" to catch a singular and a plural, or one small word added. The words that differ are underlined, so you can decide whether they really are duplicates.
Compare two lists
Paste one list in each box to see which lines are in both, which are only in the first and which are only in the second. The same options apply, and lines that are almost the same are shown side by side with the difference underlined.
Things it is useful for
- Page titles and meta descriptions. Paste the column from a crawl to see which pages share the same one, or almost the same one.
- Keyword lists. Merge lists from several tools and find the keywords that came up more than once, in any word order.
- Before and after. Compare last month's list with this month's to see what was added and what dropped out.
- Anything you are about to import. Check for repeats before they end up in a sheet or a database.
Limits
- Up to 100,000 lines are checked. The first 2,000 are shown on the page; the copy and CSV buttons include all of them.
- "Almost the same" compares letters, not meaning. "Cheap" and "affordable" are not matched. It turns off above 20,000 different lines.
- Everything runs in your browser. Nothing is uploaded or stored.
Duplicate titles and descriptions are one of the first things a technical SEO audit picks up. If you want the full review of your site, that's part of my work.