Sync not completing, out of sync/scanning rapidly

Server: Arch Linux, syncthing 1.7.0 Laptop: Mac-OS 10.15.6, syncthing-macos 1.7.0-1

Server has global state of 9,779 files, 1,896 folders, ~21.9GiB. Being logged into the html gui it’s rapidly flashing between Scanning, Waiting to Update, Scanning, Up to Date, and back 10s of times a second. The Rescan button is flickering dark/light grey constantly.

Other syncs with other machines appears to be fine.

Laptop is showing same global state, and a local state of: 9,553 files, 1,896 folders, 21.2 GiB. Out of sync: 226 items, ~751MiB

Failed items appears to be a rapidly incrementing number which keeps dropping back to (near) zero and then looping around again.

If I turn on all the logs, then pick a file that is failing:

% grep DSCF2013 serverlog
2020-08-08 18:05:03 Walk [Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG] Matcher/[]@0xc007bf66c0
2020-08-08 18:05:03 rescan: File{Name:"Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG", Sequence:69443, Permissions:0755, ModTime:2011-12-26 11:04:38 +0000 GMT, Version:{[{D75YGLZ 1596863605} {ER2BSBG 1596906303}]}, Length:0, Deleted:false, Invalid:false, LocalFlags:0x4, NoPermissions:false, BlockSize:131072, Blocks:[]} 1324897478 -rwxr-xr-x
2020-08-08 18:05:03 to hash: Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG File{Name:"Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG", Sequence:0, Permissions:0755, ModTime:2011-12-26 11:04:38 +0000 GMT, Version:{[{D75YGLZ 1596863605} {ER2BSBG 1596906303}]}, Length:3105969, Deleted:false, Invalid:false, LocalFlags:0x0, NoPermissions:false, BlockSize:131072, Blocks:[]}
2020-08-08 18:05:03 real to hash: Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG
2020-08-08 18:05:03 Walk progress done bpnqy-r3f6j [Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG] Matcher/[]@0xc007bf66c0

On the laptop I’m seeing:

% grep DSCF2013 laptop
2020-08-08 18:38:58 sendreceive/bpnqy-r3f6j@0xc0000f8380 need file Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG; copy 24, reused 0
2020-08-08 18:38:58 log 29197 ItemStarted map[action:update folder:bpnqy-r3f6j item:Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG type:file]
2020-08-08 18:38:58 progress emitter: registering bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 1
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 2
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): ER2BSBG-OMQCEPB-MKFTTAC-<SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=131072 s=131072 h=1f936ae02a26bf957ddb88d67a8de3746209a2a718116b1c7b2d3770fada258c wh=22ace515 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=0 s=131072 h=5d88b21607573aab4d9eb7adc87171b25d4aa46652bf9ac8a21717383a425bd4 wh=7cd48711 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 3
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 4
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=393216 s=131072 h=c571a1babda3b7b7fa3aecb3dbec51b7670a91d4f7b9579402cbf3257318f627 wh=62b1fe6e ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=262144 s=131072 h=efa1fe011d5c07d847e10ce4ab7f451590788a59f25d292ca23ffd7999e1864e wh=a174b6c4 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 5
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 6
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=655360 s=131072 h=eaa49a2bd30fd8e9904233285e9404d896c2cfe3524096daae4a525f44b687f3 wh=20b1cf99 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=524288 s=131072 h=9cefd50a2d03da945ef0d55cf540d4279b8dc05a0a7a92a98579b090fdc7bd34 wh=6ce2b624 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 7
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 8
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=917504 s=131072 h=300b168e6710c473b1288a65b38af72a10cc977987fffdb6f99261802d4fe916 wh=312c6e36 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=786432 s=131072 h=2c5f537bf63364d32051e44a639eb7fe2246b72c817755eb8f19dc81a045f6ba wh=8203ea9d ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 9
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 10
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2228224 s=131072 h=afa61de1302947f57a5453b635a639b536f8105268561c31e52c9076ed5791c8 wh=e34ce58 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2097152 s=131072 h=9f6a802c226d25b5b32b7a0a600ab1b0e9b7d8298cac6ddb8ea6fd198207d7b2 wh=50b52a4b ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 11
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 12
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2490368 s=131072 h=c30190d72309e16648c277091dd654ad3bf8138d408a6f639e9366adbaa45cfe wh=2da6bb1f ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2359296 s=131072 h=63099ed8ecac477af210f6c59f5608b80794fe7062dfc05e03bd53107ebf68d4 wh=6f6e028b ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 13
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 14
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2752512 s=131072 h=32069909d86696cf8779003d8ef90760211c4ef7458b8bc6a21a7d5dcce47036 wh=59a57366 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2621440 s=131072 h=56d4d6cd22eb864921d07efdf38e9aa03d9d09a48e867c961e28ac4416c51d02 wh=f19d2d62 ft=false
2020-08-08 18:38:58 basic /Users/samantha/restore Watch: Ignoring Documents/dropbackup/more pictures from lindas camera/.syncthing.DSCF2013.JPG.tmp
2020-08-08 18:38:58 basic /Users/samantha/restore Watch: Ignoring Documents/dropbackup/more pictures from lindas camera/.syncthing.DSCF2013.JPG.tmp
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 15
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 16
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=3014656 s=91313 h=6cdf4a8d9b005965ad4ac8ac2cab126d393993c17f1e742a224d275bad3867fd wh=c87fa88 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=2883584 s=131072 h=5a0cfda0b0372090d3ada04d65d382305b54d54cd9588c7f9270403afdc1a7ef wh=50632f84 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 17
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 18
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1179648 s=131072 h=137b5239181333631bdb32be6d4abd1f15c4fbbe97715d9f760bf1b828f498cb wh=1d692408 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 19
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 20
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 21
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 22
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1441792 s=131072 h=8b2da9476e45c1141e31f74f8a1f2f79c6ac003d293210c15fe94fd350c98322 wh=d23635eb ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1310720 s=131072 h=8501ccbb8597b20b0a5bc2ca9b6b2db9d29afafd6bdf1e8e842b59123dc13f94 wh=34015b54 ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 23
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1703936 s=131072 h=87a6f36e4bbd22048a5aa245aea332263f2e5eefe9ccb4f24c113dd2d3ae1aaf wh=5e4d234a ft=false
2020-08-08 18:38:58 sharedPullerState bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG pullNeeded start -> 24
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1966080 s=131072 h=9a6e65a67e201b580f256a9a8909dda01609ef793e9faad92eea50b35e159763 wh=4ac11854 ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1048576 s=131072 h=44126567c316f4680237b16eff60134a38c6927d34c553fbf06245137ded4e82 wh=6f8260cc ft=false
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1572864 s=131072 h=68e824caccb931c59faabd3f9037e5868591e4d67abf6dcf1b4924b692562fed wh=3f407d8a ft=false
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 524288 131072 returned error: no such file
2020-08-08 18:38:58 model@0xc0002d4300 REQ(out): <SNIP>: "bpnqy-r3f6j" / "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG" o=1835008 s=131072 h=5f734ea725c6553e5cdcc74dee2d8b308db3a2b61de5f9b14bbb9b01129c8fa0 wh=bdff4eff ft=false
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 655360 131072 returned error: no such file
2020-08-08 18:38:58 sendreceive/bpnqy-r3f6j@0xc0000f8380 closing Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG
2020-08-08 18:38:58 Repeat error on puller (folder "Samantha-laptop-backup" (bpnqy-r3f6j), item "Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG"): pull: no such file
2020-08-08 18:38:58 progress emitter: deregistering bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 0 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 786432 131072 returned error: no such file
2020-08-08 18:38:58 log 29200 ItemFinished map[action:update error:0xc00091a2b0 folder:bpnqy-r3f6j item:Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG type:file]
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2228224 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 131072 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 262144 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 917504 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2097152 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 393216 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2490368 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2359296 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2621440 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2752512 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 2883584 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 3014656 91313 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 1703936 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 1441792 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 1310720 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 1966080 131072 returned error: no such file
2020-08-08 18:38:58 request: bpnqy-r3f6j Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG 1179648 131072 returned error: no such file
samantha@Samanthas-Air ~ % 

I haven’t tried hard to get an exact timestamp comparison of each side because both are spamming lots of logs with the same content.

If, on the server, I sudo over to the syncthing user I can sha1sum the file without issue so it’s not a permissions problem.

[syncthing@server Samantha-laptop-backup]$ whoami
syncthing
[syncthing@server Samantha-laptop-backup]$ sha1sum Documents/dropbackup/more\ pictures\ from\ lindas\ camera/DSCF2013.JPG 
44a1eac72c1a14f4c7210a565bd019ad4751b789 Documents/dropbackup/more pictures from lindas camera/DSCF2013.JPG

Any suggestions on how to diagnose what is happening?

You are most likely affected by https://github.com/syncthing/syncthing/issues/6825. Stop the affected folder, it will keep hashing the file over and over without any interference.

The symptoms and mod. times in your report match it. Unfortunately the fix isn’t released yet and if I got it right (I am not entirely up-to-speed right now) this months release(s) have been delayed by a week, so the RC with the fix will be out on 18. August.

For mitigation I see three options (all on the “old” device where the scanning is going on).

  • Pause remote devices, move the affected files (dirs) out of the Syncthing directory, let the scan pick up the “deletions” and then move them back (this forces a rehash of the files, thus getting the new weak hash).
  • Cherry-pick https://github.com/syncthing/syncthing/pull/6799 on top of v1.7.1 and build Syncthing yourself (untested).
  • The “heavy course” (I’d really advice the first option over this): Remove the affected folder and readd it to reset the db (or if all folders are affected, reset the entire db).

Perfect.

I had tried moving files in one subfolder on the server, also tried deleting the share on the laptop and recreating, but hadn’t tried forcing the server to reminded the entire tree.

I’ll happily wait for the fix.

Ok, another folder is having the same problem. To the same new client.

Have tried the pause, move out, unpause, wait move back but it still ends up in a loop.

I didn’t notice this:

You might actually be affected by the related https://github.com/syncthing/syncthing/issues/6827. There’s a hotfix 1.7.1 release including that fix. And arch might not be aware of that and waiting a month (regular release cycle) for the next release. Please open an issue there to prompt them to package that.

Looks like the maintainer has started a test branch for it, so I’ll grab that and see what happens.

https://www.archlinux.org/packages/community-testing/x86_64/syncthing/

Thanks btw for taking a look at my issue.

1 Like

And FYI, the upgrade to 1.7.1 on the server fixed it. Hurrah!

I was about to add a new ‘bug’ and this thread came up. It’s happening on 1.9.0 rc2 (if it’s the same issue)

the log is filling up with

[RTF25] 11:01:53 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:01:53 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:01:55 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:01:55 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:01:55 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:01:58 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:01:58 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:01:58 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:00 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:00 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:00 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:02 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:02 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:02 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:04 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:04 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:04 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:06 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:06 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:06 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:09 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:09 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:09 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:11 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:11 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:11 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:13 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:13 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:13 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:15 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:15 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:15 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:17 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:17 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:17 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:20 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:20 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:20 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:22 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:22 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:22 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:24 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:24 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:24 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:26 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:26 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:26 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:28 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:28 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:28 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:31 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:31 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:31 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:33 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:33 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:33 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:35 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:35 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:35 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:37 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:37 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:37 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:40 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:40 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:40 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:42 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:42 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:42 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:44 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:44 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:44 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:46 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:46 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:46 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:48 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:48 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:48 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:51 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:51 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:51 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:53 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:53 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:53 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:55 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:55 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:55 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:57 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:57 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:57 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:02:59 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:02:59 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:02:59 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:03:02 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:03:02 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:03:02 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.
[RTF25] 11:03:04 INFO: Puller (folder "Torrington OS" (torrington-os), item "VebraLive\\eplan\\PSGLive\\system\\support\\eldatasafe.txt"): syncing: pull: generic error
[RTF25] 11:03:04 INFO: "Torrington OS" (torrington-os): Failed to sync 1 items
[RTF25] 11:03:04 INFO: Folder "Torrington OS" (torrington-os) isn't making sync progress - retrying in 1h4m0s.

It’s unlikely to be the same issue, that was a very specific and now fixed problem. And you get pull: generic error while the original problem was pull: no such file. There’s two things to look at here: Firstly pull: generic error is due to the remote it is requesting data from. Enabling the model debug logging there will print lines with the actual underlying problem. Secondly: Why are pulls scheduled so often? model debug logging and if there’s no clue about it, model,db might shed light on it. Also what’s the folder type?

I may be premature in sending the above thread. Seems the remote end in question had an rc3 update, was folder scanning and the onboard raid was also verifying, so imagine the IO was nill, hence the cycling my end.

However, the ‘retrying in 1h4m0s’ was being ignored - if that means anything.

There’s a mechanism to trigger a pull cycle immediately, e.g. if remote indexes come in or if we detect changes scanning. That’s done because this new info might help fix the problems in the last pull cycle. What it was that triggered those pulls for you, is what I hoped to find in your model debug logs. However try rc.4 first, that might have something to do with it.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.