Home / Tools / Duplicate remover

Clean · Browser based

Duplicate remover

Find duplicates using one or more key columns. Keep the first or last occurrence, review the decisions, and export kept and removed records separately.

Fictional sample loaded for demonstration. Your file is not sent to a Rowlane server.

1. Bring in a table

CSV or TSV · UTF-8 text · up to 5 MiB, 20,000 records, and 100 columns

All values stay text, including IDs like 0017.
Quoted commas, quotes, and line breaks are preserved. Choose the delimiter if detection is wrong.
Match records using key fields
Position is not the same as the newest or best record. Sample data starts with customer_id as its key.

Loading table…

What this tool does

A duplicate group contains records whose selected key fields match. By default comparison is exact: letter case and surrounding spaces matter. You can explicitly ignore case or trim key whitespace for matching; the exported values are still the original text. The original record order determines first and last.

How to use it

  1. Read the table and select one or more fields that identify the same entity.
  2. Choose first or last occurrence and any optional matching normalization.
  3. Review the change log. Download kept and removed records as separate CSV files.

2. Check the input

Confirm the header and a few records before applying a rule.

Questions

What to expect

Can I match on multiple columns?

Yes. Select a combination such as customer_id and product_id. Every selected field must match.

What happens to a blank key?

That record stays in the kept file and receives a manual-review finding. Missing identifiers are not treated as proof of duplication.

Review the destination rules. A valid CSV or a clean report does not guarantee that another system will accept the file. Keep your original and verify any export before importing it.