About Find Unique Values

Deduplicate any list and see frequency counts, entirely in your browser.

🐕

Why Nobu Tools?

Nobu is my dog, and the inspiration behind these tools. Life is short, so we should spend less time on tedious tasks and more time with the ones we love.

Nobu Tools are built to save you time. Fast, private, no-nonsense utilities that just work, so you can get back to what matters.

🔒 Privacy First

Your data stays yours. Everything runs locally in your browser using plain JavaScript:

No data is ever sent to any server. Your list stays on your device
No data is logged or stored. We can't see what you deduplicate
Works completely offline. Once loaded, no internet needed
Handle thousands of items. Fast performance with large lists

⚡ How It Works

Find Unique Values parses your input, builds a frequency map counting every occurrence, then presents the results in three views: unique values, duplicated values, and a full frequency table.

Output Panels

Stats Banner At a glance: total items, unique count, duplicates removed, and the most frequently occurring value.

Unique Values The deduplicated list — every distinct value appears exactly once. Copy it with one click.

Duplicated Values Only the values that appeared more than once. Useful for spotting repeated entries you may need to investigate.

Frequency Table Every value with its occurrence count and a visual bar chart. Click the column headers to re-sort by value or count. Rows with duplicates are highlighted. Copy as TSV for pasting into a spreadsheet.

Input Formats

Endline separated (default): Each line is one item
Tab separated: Items split by tab characters
Comma separated: Items split by commas
Semicolon separated: Items split by semicolons
Pipe separated: Items split by | characters
Bulleted list: Lines starting with -, •, or *
Numbered list: Lines starting with 1., 2), etc.
Whitespace separated: Items split by spaces or tabs
Quoted CSV: Standard CSV with quoted fields

The tool also auto-detects your input format and shows a suggestion banner if a different setting would parse your data better.

Comparison Options

Case insensitive: Treat "Apple" and "apple" as the same value
Trim whitespace: Remove leading/trailing spaces before comparing
Skip empty items: Ignore blank entries
Ignore all whitespace: Strip all spaces and tabs when comparing
Ignore punctuation: Strip punctuation characters when comparing

Sort Options

First occurrence: Preserve the original order items appeared in
Ascending / Descending: Alphabetical sort with natural number handling
Most / Least frequent first: Order by how often each value appears

💼 Use Cases

📧

Email Deduplication

Paste a list of email addresses and instantly find which ones appear more than once. Copy the unique list for a clean import.

📊

Survey Responses

Find the most common answers in free-text survey data. The frequency table shows you what respondents said most often.

🏷️

Tag Cleanup

Deduplicate tags, categories, or labels from a CMS export. Use case-insensitive mode to catch near-duplicates.

🔍

Log Analysis

Paste error messages or log entries to find which ones recur most frequently, sorted by count.

📦

Inventory Audit

Compare a list of SKUs or product names to find accidental duplicates in your catalog.

💻

Code & Config

Find duplicate entries in configuration files, dependency lists, or environment variables.

⌨️ Keyboard Shortcuts

Ctrl+Enter: Run deduplication

❓ FAQ

Is my data sent to a server?

No. All processing happens locally in your browser. Your data never leaves your device.

How many items can I deduplicate?

The tool handles thousands of items with ease. The frequency table caps at 500 rows for display, but the full unique and duplicate lists are always generated.

What does "case insensitive" do exactly?

When enabled, "Apple", "apple", and "APPLE" are all treated as the same value. The first occurrence's original casing is used for display.

Can I sort the frequency table?

Yes! Click the "Value" or "Count" column headers in the frequency table to sort. Click again to reverse the direction.

How do I export the frequency data?

Click "Copy as TSV" on the frequency table. This copies a tab-separated version (with headers) that you can paste directly into Excel or Google Sheets.

Does it work offline?

Yes! Once loaded, no internet connection required.

Ready to Deduplicate?

Try Find Unique Values now. No signup required.

Start Finding Unique Values →