I need to sync the files of this windows server to linux!
After I added the task, this task has been in the scan! It has been 2 days!
When scanning, the memory usage is very high, and even all the memory is full!
In the past two days, syncthing has performed an automatic restart at least 3 times!
Progress updates (for the percentage info in the gui) safe all filenames to be hashed, which in your case is huge. Set progressUpdateIntervalS to -1 to disable those progress updates, that should get your memory usage down (https://docs.syncthing.net/users/config.html#options-element).
EDIT: Itâs ScanProgressIntervalS which is relevant for scanning, the progress one is for pulling. Both are probably relevant to you.
@xkwy521 See my edit above: I mixed up the names, itâs scanProgressIntervalS thatâs relevant to scanning, but you probably want to set both to -1 (the other is for syncing).
As a side note: @AudriusButkevicius Do you remember the argument for buffering a list of files to hash instead of walking the filesystem twice and just counting the files to be hashed on first walk? Thereâs the overhead of walking twice but there could then be an option to switch between walking twice (low mem, higher disk usage) and walking once (high mem, lower disk usage).
NO, not a firewall error, I will still have this error when I close the firewall!
Also, according to the above method, after setting the âprogressUpdateIntervalSâ and âScanProgressIntervalSâ parameters, the windows server that needs to be synchronized, âsyncthingâ only scans 8,841,021 files, it has been 6 hours, and no number has been increased!
How to solve this? please help me!
That error originates from decoding json, I donât understand how tcp comes into that. Ignoring the concrete error I could imagine that your config changes timed out due to the high load of scanning. So maybe the progress settings didnât even take effect (check the config.xml directly).
These settings mean there is no status update on how far the scan has progressed. If you have 40 million files that all need to be hashed and compared between devices, thatâs going to take more than 6h. Have some patience.
Can you switch off syncthing, set the two settings manually by modifying the config, and start it again? I am not convinced the settings were applied based on the errors you posted.