How to deal with duplicates?
The DQ Assistant identifies duplicates:
It also allows adjusting the sensitivity to identify duplicates (in the settings menu). This means, the required percentage of similar characters between two different rows to be identified as a duplicate can be adapted:
Before removing a duplicate, please check for redundancy of the row (e.g., if two similar products are sold the same day to the same company, a duplicate might be justified in rare cases).
​
The best way to remove a duplicate is by deleting one of the respective rows (please check before if there is any other important information in the respective row that is outside the assessment range). The DQ Assistant also provides the option to automatically delete duplicates by clicking on the button "Delete duplication" (to delete one specific duplicated row) or "Delete all duplications" (to delete all duplicated rows).
