I see this a lot, files this happens to never syncs and it seems to block syncing of other files as well,
For example these are a number of backed up emails in my document folder.
There are lots of strange characters in these but it seems to happen with a lot of other files.
[XTNCP] 14:46:09 INFO: Puller (folder “Documents”, file “Mailbackup/KTH/2010/Daniel Rosik replied to a thread on Facebook… - Facebook notification+olvo6p=z@facebookmail.com - 2010-04-19 0851.eml”): pull: no available source device
[XTNCP] 14:46:09 INFO: Puller (folder “Documents”, file "Mailbackup/KTH/2010/Daniel Rosik invited you to the event “Vilka funderar på att köpa Battlefield Bad Company 2 till PC?.. - Facebook notification+olvo6p=z@facebookmail.com - 2010-02-25 1235-2.eml”): pull: no available source device
[XTNCP] 14:46:10 INFO: Puller (folder “Documents”, file “Mailbackup/KTH/2010/Daniel Rosik sent you a message on Facebook… - Facebook notification+olvo6p=z@facebookmail.com - 2010-05-10 0131.eml”): pull: no available source device
I’ve been having the same problem. This also (but not only) happens when the wifi connection is lost and reconnects. It seems like SyncThing tries to use old connections instead of making new ones. I’m assuming the files that cause problems are the ones that were being synced. But I’m being unscientific, here’s the log that seems to be equaly clarificatory:
[monitor] 17:52:57 INFO: Starting syncthing
[GYAUK] 17:52:58 INFO: syncthing v0.11.0-beta0 (go1.4.2 linux-amd64 default) unknown-user@syncthing-builder 2015-03-22 10:33:10 UTC
[GYAUK] 17:52:58 INFO: My ID: ####
[GYAUK] 17:53:09 INFO: Starting web GUI on http://127.0.0.1:8080/
[GYAUK] 17:53:49 INFO: Starting local discovery announcements
[GYAUK] 17:53:49 INFO: Starting global discovery announcements
[GYAUK] 17:53:49 OK: Ready to synchronize Things (read-write)
[GYAUK] 17:53:53 INFO: Established secure connection to #### at ####> [GYAUK] 17:53:53 OK: Ready to synchronize Music (read-write)
[GYAUK] 17:53:56 INFO: Device #### is “Anvil Xubuntu” at [dynamic]
[GYAUK] 17:53:56 INFO: Device #### is “Terra” at [dynamic ip:####]
[GYAUK] 17:53:56 INFO: Device #### is “Anvil W” at [dynamic]
[GYAUK] 17:53:56 INFO: Device #### is “Petit-Metal” at [dynamic]
[GYAUK] 17:53:56 INFO: Starting usage reporting
[GYAUK] 17:54:04 INFO: Device #### client is “syncthing v0.11.0-beta0”
[GYAUK] 17:54:04 INFO: Device #### name is “Petit-Metal”
[GYAUK] 17:54:08 INFO: Completed initial scan (rw) of folder Music
[GYAUK] 17:54:10 INFO: Completed initial scan (rw) of folder Things
[GYAUK] 17:54:27 INFO: Established secure connection to #### at ####
[GYAUK] 17:54:27 INFO: Device #### client is “syncthing v0.11.0-beta0”
[GYAUK] 17:54:27 INFO: Device #### name is “Terra”
[GYAUK] 17:56:56 INFO: Puller (folder “Music”, file “Jello Biafra & The Guantanamo School Of Medicine/The Audacity of Hype/01. The Terror of Tinytown.mp3”): pull: no available source device
[GYAUK] 17:56:56 INFO: Puller (folder “Music”, file “The Doors/The Doors - The Complete Matrix Club Tapes Box Set (cd3)/304-The_Doors-People_Are_Strange.mp3”): pull: no available source device
[GYAUK] 17:56:56 INFO: Puller (folder “Music”, file “KLF/1991 Doctorin’ The Tardis (TVT 4025-2)(320)/03 What Time Is Love (The KLF Original Version).mp3”): pull: no available source device
This is after restarting SyncThing through a terminal (using: killall syncthing; syncthing) mostly to see the log.
Removing the folder and adding it again seems to help. For big folders it takes quite some time for SyncThing to rescan all files before it can start syncing again though. Still a quite awesome piece of software.
Both Things and Music are shared with Terra without either machine serving as a master nor is fileversioning activated.
The fact that it has no available source is not really an issue.
The device went away while we were in the middle of something, it will resume next time the device is around.
If you have a lot of files, it might take a while to start as they have to exchange indexes.
Plus after it stops due to no source available, it might take a minute for it to start up again.
But looking at your logs I don’t see any disconnection messages though which is strange.
I am seeing these INFO messages after removing files from another node. It is referring to files that no longer exist in these messages, which in turn triggers the Folder isn't making progress warning, so I assume its index is temporarily out of sync with reality?
I had this behavior, too, for my windows pc “one-way-syncing” to my ReadyNAS (read-only on NAS, both running Syncthing 0.11.3, both connected via GBit lan). I think this appears when the files on the windows pc, that syncthing tries to sync, are opened by another application. I my case it could not sync files from my firefox profile when firefox was opened. As soon as i closed firefox, almost all of the files were synced (unfortunately not all of them but maybe there were some open file handles from other applications?)
Firefox uses memory mapped files which don’t get mtimes updated upon writes which prevents syncthing from working correctly. You can try ignoring them as they are usually not temporary and not critical. You can also search the issue tracker and forums as I am sure there are tons of chat about it.
Plus, databases are usually not very syncable to start with as they change many times per second.
I’m not sure if this is related but I was testing how well SyncThing handles larger files (20 Gb). I configured just two nodes, one setup as a master. After SyncThing had been running for a few minutes (I’m assuming it was calculating a checksum for the file) it started synching. While synching, I made a change to the file on the master node. And then the “no available source device” messages started appearing. I noticed then that the master node appeared to be calculating another checksum (based on the amount of cpu being used). While this was happening, the “no available source device” message appeared a few times. Once the checksum calculation was completed, the sync continued.
I don’t know for sure if these observations are correct, but this pattern seemed to happen fairly consistently.
Yes, we ‘pull’ partial blocks of files from other nodes. However, if files change while pulling, we cannot find the required blocks. Thus, if Syncthing has finished calculating the new checksum, the pull process will update itself and only fetch the new information (and reuse the old blocks if possible).
I have the same issue in a setup of two connected machines. I think, the following was the case: locking a .zip file for extraction. Then closing the .zip file and deleting it. syncthing wanted to sync the file after closing (no more locked) and informed the other machine. Then, the file was deleted on the source machine. The target machine still requests the file even though it was deleted.
After restart and rescan, it keeps saying Folder "TEST" isn't making progress - check logs for possible root cause. Pausing puller for 1m0s.without issuing any cause in the log. How can I stop that message?
With syncthing v0.11.13 issues got worse: Syncthing somehow seems to track versions of a file internally. May it be the case that following happens:
Machine M1: V1 -> V2 -> V3 and
Machine M2: has V1, gets notified about V2, tries to sync V2, but when it starts to sync, V2 has gone and V3 is available and it starts complaining, that the file is not available
It says
[4QJNC] 14:37:19 INFO: Puller (folder "BTSync", file "Elephant\\Inbox\\Markdown.md"): pull: no available source device
But on the source device, that file exists and is newer than the file stored on the machine complaining.