Slow scanning on new large files (30-50gb)

Support
1

I have been a long time user and one thing that bugs me is when adding a new large file , ST runs a scan for 5-10 mins (depending on size) before initiating the transfer.

Is this by design? Ive messed with some settings and cant find a way to stop it.

Its detecting there is a new file and running an initial scan- i understand if there was another version of the file why it would check but if it knows there is no version at the other end, does it NEED to scan?

I find the scan can take longer than the actual transfer which can be frustrating

Any help would greatly appreciated thanks!

2

Yes, it needs to do the scan, because it needs to tell the other side the block hashes of all contents in the file.

3

Is there anyway to speed it up?

4

If the OS is Windows/macOS/Android, you could try increasing the number of hashers for the folder in question (see https://docs.syncthing.net/users/config.html#config-option-folder.hashers), because normally it defaults to 1 there. You will need a fast disk that keeps up with the CPU to see any difference though.

5

It’s Linux, I tried that already and went up to 4 and saw no difference

6

On Linux, the number of hashers will default to the number of your CPU cores. This likely means that you can’t speed up the hashing process more (except for upgrading the hardware to something very beefy, etc.).

7

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.