DeDuplicate is a utility to identify and remove duplicate items from a list of text. Type or paste the list of text items you want de-duplicated into the top box. Click the OK button to remove all duplicate occurrences from the list of items.
DeDuplication types include:
Remove Duplicates — sorts the list then removes the excess occurrences. Unique items will always be included, but only one occurrence of each duplicate will be included.
Show only Duplicates — sorts the list then shows only those items that occur two or more times.
Show only Uniques — Sorts the list then shows only those items that occur once.
The DeDuplication takes into account accented and foreign characters.
Options
If you want to DeDuplicate by words (rather than paragraphs) you will need to check the DeDuplicate by Words checkbox.
Note that Case is not taken into account so ABC and Abc are considered duplicates.
