CPU at max. Sync stucked at 98% and Folders being scanned all the time

Support
1

Hello guys, I’ve been having this issue and I’m not sure how to fix it:

Work environment has 7 laptops (2 bosses 5 employees), they are all connected together and just 2 folders are being shared with PDFs, xls and docs files (23Gb). Thing is, now Syncthing is stucked at 98% and the Output daemon keeps telling “peers who had this file went away, or the file has changed while syncing”

One of the laptop’s (Boss 1) CPU is always at max because another laptop (employee 1) is constantly scanning those folders but does not seem to get all the files, according to Syncthing there are 1453 files not being synced from one folder and 255 from the other. ~syncthing temp files in every laptop matching with the Output Daemon description, but in the original laptop’s folders those files are there.

Is there any solution to this? Should I clean all the temps in the original folders, copy the files to a USB stick and do again the Syncthing setup in every laptop?

Hope I was clear enough I don’t speak english very well. Thanks!

2

Your expression is totally clear, I am still not exactly sure what your setup/problem is. If that error is persistent, most likely the files in question are not accessible on the device of origin. For example if a program holds locks on the files or permission have changed. What you need to do is to determine which device is the origin of the troubles and then look at the files that are reported as out of sync on other devices. If that “generic advice” doesn’t help you, more details (screenshots, logs) may help to understand the problem better.

3

Thanks, I’ll look into it and then take SS/Logs and post them here. By setup problem you mean how the synchronization is arranged?

4

Here’s one Daemon output log. Some words are in spanish but I can translate them if you want me to.

[AYRSF] 20:42:40 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201701 - WPS.xls"): peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:42:40 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201704 - WPS.xls"): peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:42:40 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201705 - WPS.xls"): peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:42:40 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Sucesion LESTA\\WPS"): remove \\?\D:\Estudio Ezequiel\PERSONAS FISICAS\Sucesion LESTA\WPS: El directorio no est?? vac??o.
[AYRSF] 20:42:40 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Sucesion LESTA\\WPS\\2017-08"): remove \\?\D:\Estudio Ezequiel\PERSONAS FISICAS\Sucesion LESTA\WPS\2017-08: El directorio no est?? vac??o.
[AYRSF] 20:42:40 INFO: Folder "Estudio Ezequiel" (Estudio) isn't making progress. Pausing puller for 1m0s.
[AYRSF] 20:43:43 INFO: Folder "Estudio Federico" (Estudio Fede) isn't making progress. Pausing puller for 1m0s.
[AYRSF] 20:43:53 INFO: Puller (folder "Estudio", file "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201705 - WPS.xls"): pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:43:53 INFO: Puller (folder "Estudio", file "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201704 - WPS.xls"): pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:43:53 INFO: Puller (folder "Estudio", file "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201701 - WPS.xls"): pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:43:56 INFO: Puller (folder "Estudio", file "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201705 - WPS.xls"): pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:43:56 INFO: Puller (folder "Estudio", file "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201704 - WPS.xls"): pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:43:56 INFO: Puller (folder "Estudio", file "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201701 - WPS.xls"): pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:44:08 INFO: Puller (folder "Estudio", file "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201705 - WPS.xls"): pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:44:09 INFO: Puller (folder "Estudio", file "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201704 - WPS.xls"): pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:44:09 INFO: Puller (folder "Estudio", file "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201701 - WPS.xls"): pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:44:09 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201701 - WPS.xls"): peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:44:09 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201704 - WPS.xls"): peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:44:09 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Schwarz, Mario\\Wps\\IVA 201705 - WPS.xls"): peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 20:44:09 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Sucesion LESTA\\WPS"): remove \\?\D:\Estudio Ezequiel\PERSONAS FISICAS\Sucesion LESTA\WPS: El directorio no est?? vac??o.
[AYRSF] 20:44:09 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Sucesion LESTA\\WPS\\2017-08"): remove \\?\D:\Estudio Ezequiel\PERSONAS FISICAS\Sucesion LESTA\WPS\2017-08: El directorio no est?? vac??o.
[AYRSF] 20:44:09 INFO: Folder "Estudio Ezequiel" (Estudio) isn't making progress. Pausing puller for 1m0s.
[AYRSF] 20:44:41 INFO: Connection to QCVLYUZ-7PZK23M-6RB4ASB-DXFCKUO-F57WKJ7-XFPUKPQ-YRB2PR4-WDKRVQR closed: writing message: write tcp [2800:810:463:21a:ac01:ded0:b24f:dc6]:54999->[2800:810:463:21a:5914:66d0:17ce:2776]:22000: wsasend: Se ha forzado la interrupci??n de una conexi??n existente por el host remoto.
[AYRSF] 20:45:06 INFO: Established secure connection to QCVLYUZ-7PZK23M-6RB4ASB-DXFCKUO-F57WKJ7-XFPUKPQ-YRB2PR4-WDKRVQR at 192.168.0.4:55433-192.168.0.6:22000 (tcp-client) (TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305)
[AYRSF] 20:45:06 INFO: Device QCVLYUZ-7PZK23M-6RB4ASB-DXFCKUO-F57WKJ7-XFPUKPQ-YRB2PR4-WDKRVQR client is "syncthing v0.14.39" named "nys01-laptop (Melanie)"
[AYRSF] 20:45:06 INFO: Connection to QCVLYUZ-7PZK23M-6RB4ASB-DXFCKUO-F57WKJ7-XFPUKPQ-YRB2PR4-WDKRVQR closed: writing message: write tcp 192.168.0.4:55433->192.168.0.6:22000: wsasend: Se ha forzado la interrupci??n de una conexi??n existente por el host remoto.
[AYRSF] 20:45:24 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Sucesion LESTA\\WPS"): remove \\?\D:\Estudio Ezequiel\PERSONAS FISICAS\Sucesion LESTA\WPS: El directorio no est?? vac??o.
[AYRSF] 20:45:24 INFO: Puller (folder "Estudio Ezequiel" (Estudio), dir "PERSONAS FISICAS\\Sucesion LESTA\\WPS\\2017-08"): remove \\?\D:\Estudio Ezequiel\PERSONAS FISICAS\Sucesion LESTA\WPS\2017-08: El directorio no est?? vac??o.
[AYRSF] 20:45:24 INFO: Folder "Estudio Ezequiel" (Estudio) isn't making progress. Pausing puller for 1m0s.
[AYRSF] 20:45:49 INFO: Established secure connection to QCVLYUZ-7PZK23M-6RB4ASB-DXFCKUO-F57WKJ7-XFPUKPQ-YRB2PR4-WDKRVQR at 192.168.0.4:22000-192.168.0.6:61747 (tcp-server) (TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305)
[AYRSF] 20:45:49 INFO: Device QCVLYUZ-7PZK23M-6RB4ASB-DXFCKUO-F57WKJ7-XFPUKPQ-YRB2PR4-W

Clipboard01
Clipboard01.jpg1366×768 145 KB

5

Yeah, well…things got kinda worse…now it does not sync at all, just random bits of info then it goes like this

[AYRSF] 17:52:46 INFO: Puller (folder "\"Test Estudio\: finisher: pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 17:52:46 INFO: Puller (folder "\"Test Estudio\: finisher: pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 17:52:46 INFO: Puller (folder "\"Test Estudio\: finisher: pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 17:52:46 INFO: Puller (folder "\"Test Estudio\: finisher: pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 17:52:46 INFO: Puller (folder "\"Test Estudio\: finisher: pull: peers who had this file went away, or the file has changed while syncing. will retry later
[AYRSF] 17:52:47 INFO: Failed to exchange Hello messages with QCVLYUZ-7PZK23M-6RB4ASB-DXFCKUO-F57WKJ7-XFPUKPQ-YRB2PR4-WDKRVQR (192.168.0.6:55892): read tcp 192.168.0.4:22000->192.168.0.6:55892: wsarecv: Se ha forzado la interrupci??n de una conexi??n existente por el host remoto.
[AYRSF] 17:52:47 INFO: Established secure connection to QCVLYUZ-7PZK23M-6RB4ASB-DXFCKUO-F57WKJ7-XFPUKPQ-YRB2PR4-WDKRVQR at [2800:810:463:21a:9c9f:da19:479d:74fb]:22000-[2800:810:463:21a:608f:86ad:ff3d:a3ae]:55893 (tcp-server) (TLS_ECDHE_ECDSA_WITH_CHACHA20_POLY1305)
[AYRSF] 17:52:47 INFO: Device QCVLYUZ-7PZK23M-6RB4ASB-DXFCKUO-F57WKJ7-XFPUKPQ-YRB2PR4-WDKRVQR client is "syncthing v0.14.41-rc.2+2-g72d6458" named "nys01-laptop (Melanie)"

I just don’t get it, Syncthing was working perfecly fine 2 weeks ago, nothing was changed.

6

This might an issue that is fixed in v0.14.41. You could update to the RC to check.

7

I don’t think so, this usually means that either the file has changed since it was announced, or the device that provides this has disconnected, which I don’t think is handled yet.

8

No luck so far. Meanwhile I’m uploading stuff to Gdrive, I can foresee this being a long term issue. I guess the next thing is completely erase Syncthing and install it from scratch

9

I mixed this up with another issue, as Audrius said.

Did you check the reported files on the other machine(s)? Doing this and finding the device causing the issue is the first step to solving your problem.
I get the same logging lines when I sync a database while it is in use. As most of your files are xls, there could be a device that locks them (opened files and never closed them). In general you need to

10

I don’t think its a per device problem, because I begun testing it with 2 different laptops, a copy of those 2 main folders with:

  • sync-conflict files removed
  • ~syncthing temp files removed
  • updated timestamps with FolderTimeUpdate (Nirsoft)
  • changed upper/low case names

Just those two, nothing else open nor being accessed. Only thing I didn’t try, yet, is reinstalling everything from scratch

11

Did you also try changing the name to something completely different? I am unsure, but I think I remember something about the case problem being persistent even after bringing all to the same case. If this is the case, you either need to rename all files or, probably better, reset the database.

12

This may sound dumb, but how do I reset the database? I changed the name of the folders being synchronized, as in, setting a new folder…share it with the other peer, etc.

13

It is not about the names of syncthing folders, it is about the actual names of files your are sharing.

To reset the db, use syncthing -reset-database (that means a full rescan of all your data).

14

Oh. No, I did not rename the files, they are like 98.600 files or so. I’ll try it too, add a 1 or an A at the beginning. Where should I input that command? I’m on windows

15

The alternative is to go to the location where your config is stored and remove the index-v0.14.0.db directory. You can just rename it in case you want to go back to it.
For the command: I assume in the cmd thing it will work - I am not on windows :wink:

16

I’ll try it and see how it goes. Thanks!

17

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.