# Remotely cleaning a disk filled with duplicate files

**URL:** https://forum.syncthing.net/t/remotely-cleaning-a-disk-filled-with-duplicate-files/26151
**Category:** User Stories
**Created:** [February 14, 2026, 10:14am UTC](https://forum.syncthing.net/t/remotely-cleaning-a-disk-filled-with-duplicate-files/26151 "2026-02-14T10:14:51Z")
**Posts on this page:** 7
**Page:** 1

<div class="post-metadata">

### Author: ![cosas](https://forum.syncthing.net/user_avatar/forum.syncthing.net/cosas/32/14159_2.png) [@cosas](https://forum.syncthing.net/u/cosas)
#### Post date: [February 14, 2026, 10:14am UTC](https://forum.syncthing.net/t/remotely-cleaning-a-disk-filled-with-duplicate-files/26151/1 "2026-02-14T10:14:51Z")

</div>

We have a shared folder for rehearsals recordings with several friends.

Some days ago one of them began to have issues because of its (windows laptop) disk was nearly full. Fortunately I remembered I installed for him the [Duplicate File Finder true freeware](https://sourceforge.net/projects/doubles/files/Duplicate%20Files%20Finder/0.8.0/) and told him to roll up his sleeves to clean his disk from multiple duplicates of unsorted manual backups of smartphones pictures and spouse & children files. Some hours later I realized he would sweat like a pig with this tool that can only manually delete dups inside one single group, so I proposed him to setup 3 temporary shared folders will break in the end from his computer to mine (Documents, Pictures and Music only to a mirror in mine, Sync/Friend/Docs, Pics & Mus, and **move** anything but links from his Desktop directory to a new dedicated empty dir in his Documents), where I have a more powerful tool (fslint or equivalent)… and no time/courage to learn and tame the power of _find_ command line. Lets run ST several days for ~150Gb through his ~1Mb/s UL DSL… 🙄…

In the hurry to reclaim some free storage on his disk I couldn’t wait for the full sync to finish so I had the idea to begin with smallest files as they are the culprits and fortunately ST shared folders advanced settings allows (thanks devs 👍) to sync the “Smallest first”, so I can begin to run my fslint against my side, slowly cleaning my friend’s one and recovering free room.

Yet another cool experience with Syncthing.

Just a caveat, I know ST is able to quickly sync files (and/or chunks?) without having them transferred by performing local copies of yet available local chunks, but is seems this does not occur when several candidate files are being transferred at the same time (remember, smallest first, i.e. same size roughly at the same time): in the picture below I know the marked files are true dups, not only size/name. This would have saved a lot of time, mainly when dups are many, sometimes 40, and/or big (in this use case 500kB is big yet). I have no idea if it’s worth the effort to implement such a behaviour or tweak the yet embedded one.

 ![Capture d’écran du 2026-02-14 10-01-25](https://forum-uploads.syncthingcdn.net/original/3X/9/f/9f2567efebbae1d0b5764c33596cf0f2e471f657.jpeg)

Whatever, one other reason to enjoy this soft and the cool devs and involved skilled users that are always here for assistance.

Enjoy

---

<div class="post-metadata">

### Author: ![acolomb](https://forum.syncthing.net/user_avatar/forum.syncthing.net/acolomb/32/11343_2.png) [@acolomb](https://forum.syncthing.net/u/acolomb)
#### Post date: [February 14, 2026, 11:04am UTC](https://forum.syncthing.net/t/remotely-cleaning-a-disk-filled-with-duplicate-files/26151/2 "2026-02-14T11:04:19Z")

</div>

I don’t know exactly whether sharing blocks from partially downloaded files is possible. But probably not I suppose.

In this case, the problem could be avoided by actually going back to random pull order. This way, the chances of a duplicate already having downloaded completely are much higher than if each duplicate is sorted by size to sit closely in the queue.

---

<div class="post-metadata">

### Author: ![cosas](https://forum.syncthing.net/user_avatar/forum.syncthing.net/cosas/32/14159_2.png) [@cosas](https://forum.syncthing.net/u/cosas)
#### Post date: [February 14, 2026, 11:05am UTC](https://forum.syncthing.net/t/remotely-cleaning-a-disk-filled-with-duplicate-files/26151/3 "2026-02-14T11:05:42Z")

</div>

For sure, but I’d need to wait for the full sync.

---

<div class="post-metadata">

### Author: ![cosas](https://forum.syncthing.net/user_avatar/forum.syncthing.net/cosas/32/14159_2.png) [@cosas](https://forum.syncthing.net/u/cosas)
#### Post date: [February 15, 2026, 3:06pm UTC](https://forum.syncthing.net/t/remotely-cleaning-a-disk-filled-with-duplicate-files/26151/4 "2026-02-15T15:06:44Z")

</div>

> [@cosas](#):
>
> but I’d need to wait for the full sync.

Not that sure : setting all 3 shared folders back to random download, it seems there is a background job that searches potential same file or block as soon as a [block?] download completes, that nearly immediately makes any duplicate file written to disk even if it was deep in the download queue of this very shared folder or another one.

---

<div class="post-metadata">

### Author: ![calmh](https://forum.syncthing.net/user_avatar/forum.syncthing.net/calmh/32/15311_2.png) [@calmh](https://forum.syncthing.net/u/calmh)
#### Post date: [February 15, 2026, 8:22pm UTC](https://forum.syncthing.net/t/remotely-cleaning-a-disk-filled-with-duplicate-files/26151/5 "2026-02-15T20:22:24Z")

</div>

Block reuse happens from fully synced files only, at the moment, as that is when the information is entered in the database.

---

<div class="post-metadata">

### Author: ![cosas](https://forum.syncthing.net/user_avatar/forum.syncthing.net/cosas/32/14159_2.png) [@cosas](https://forum.syncthing.net/u/cosas)
#### Post date: [February 16, 2026, 8:22am UTC](https://forum.syncthing.net/t/remotely-cleaning-a-disk-filled-with-duplicate-files/26151/6 "2026-02-16T08:22:32Z")

</div>

Thank you Jakob. This answer definitively induced the “Random” File Pull Order is the faster when duplicate files exist, preventing duplicate blocks amongst files to be downloaded several times before one file from a duplicate group is full available… Good to remember. Reading yesterday the BEP documentation led me to guess something like this behaviour at block level, but I couldn’t guess this happens only once a full file is dl’d.

---

<div class="post-metadata">

### Author: ![Arneko](https://forum.syncthing.net/letter_avatar_proxy/v4/letter/a/57b2e6/32.png) [@Arneko](https://forum.syncthing.net/u/Arneko)
#### Post date: [February 24, 2026, 2:23am UTC](https://forum.syncthing.net/t/remotely-cleaning-a-disk-filled-with-duplicate-files/26151/7 "2026-02-24T02:23:55Z")

</div>

@cosas Another cool feature of Syncthing worth mentioning in this context is the built-in deduplication - it comes with quite a few conditions though.

> **[copyRangeMethod — Syncthing documentation](https://docs.syncthing.net/advanced/folder-copyrangemethod.html)**

It basically means, that if you run a filesystem that supports it (none of the mainstream ones like NTFS and Ext4 as far as I know, even though it says “Tested on EXT4”; I suppose that just means “Tested to not cause harm”), not only will Syncthing skip the download, it will also save disk space by having identical files/blocks reference the same space on your disk.

Not default behavior, and certainly does not guarantee that duplicate files won’t be duplicated even if you DO indeed check all the boxes for this to work, as you discovered a corner case yourself.
