hunging and log

Support
1

I am currently working in a Windows 2003 server 32bits environment.

I have 4 nodes that have synced correctly, they are all up to date and syncing the changes in the 4 servers (one is only for copy that is not shared in the network).

I added a new node but I have problems constantly; I am still awaiting for an initial load, before adding files from the office where I added the node.

It hung in random periods, 10-20-40 minuts, in data size, 500MiB, 2GiB, 4,5GiB, its not regular.

I checked the config, its the same that all the other nodes. I added a ping to check the WAN connection. Also, I activated the debuging, but the log seems the same.

How can I try to detect the problem ?? I will change all the servers, for new ones (ubuntu 16 - 64bits), but I need them running fine now, not with the new ones.

I can have both nodes at the same time ? they are compatible (32 and 64) ?

2

If it’s not making progress on scanning the issue is probably with the storage.

Yes all versions and all bit’ness are compatible.

3

yes, it progress (now 1,88GiB downloaded in 48min and runing), but in an undefined moment it hungs.

i have the chrome javascript console, and it’s doing calls constantly. when hungs, it stops doing calls.

there isn’t any way to view the problem ? I have any disc failure o error in the windows event log.

I need to add the new files but I wish to be sure the initial download is completed.

4

the previus progress stoped at 2,64GiB, 1h 2m running time.

5

Javascript has nothing todo with this. It’s not clear to me what hangs, if its the transfers or the scanning. Regardless, check system resources on all boxes, I suspect you’ll find that either disk, cpu or memory is maxed out, hence the issue.

6

I have about 450.000 files and 500GiB in the sync folder (4 nodes up to date, 1 downloading).

I haven’t seen any strange event in any server, all the servers uses 2TB new drives. I have all the servers with a 600s scanning interval.

The node where I am experiencing problems is a Xeon 3040 @ 1,86hz, with 4 GB ram. And yes, syncthing it loading all CPU. (I am preparing a new server to replace it)

7

Well if the CPU is maxed out then thats probably your bottleneck.

8

but it doesn’t explain why hungs

9

just now hungs, I have no problem with time downloading if its for bottleneck, but I cant understant that why is hunging.

Download Rate 516 KiB/s (3.94 GiB) Upload Rate 0 B/s (9.93 MiB) Local State (Total) 391656 items, ~226 GiB RAM Utilization 132 MiB CPU Utilization 0% Listeners 1/1 Uptime 1h 14m Version v0.14.9, Windows (32 bit)

10

Well it’s not exactly hanging, 500Kb/s is still something.

11

yeah, but it is shown as disconnected on the other nodes, and the statictics dont change, I could reload the page, but it nevers responses.

12

Sounds like a deadlock issue we are trying to hunt dow . There is an issue on github (search for deadlock) which provides an instrumented build and vague explanations how to debug.

13

I suspect I’m meeting a similar issue since a couple of days, as I’m adding a new sync server. Populating the new server just hang once in a while, and I have to restart the process. I have it on debian jessie x64 and raspbian jessie. Syncthing is 14.9 on all machines, including “client” machines. Do you need some other log or info?

Cheers

14

I disabled the slowest node. I have found that the other nodes syncking/updating spend few seconds. But the slowest one takes some time scaning. Could this stop or break the transfer ? I am controling the progress, I will comment.

15

stoped again, all servers scaning

Download Rate 455 KiB/s (6.08 GiB) Upload Rate 1.69 KiB/s (13.5 MiB) Local State (Total) 405718 items, ~288 GiB RAM Utilization 130 MiB CPU Utilization 0% Listeners 1/1 Uptime 1h 31m Version v0.14.9, Windows (32 bit)

16

I don’t understand why you claim it’s stopped. If the rate is low (non-zero), it might mean ISP throttling.

17

If you refresh the UI, does it still load, show rate, connection status?

18

In the other servers this one apears as disconnectet, it doesn’t download any other file.

Since 14.10 it donwloaded a lot more information, 25 GB and 30 GB. And was runing for more than 8 hours.

19

Please try the build from Folders out of sync, even after rebuilding indexes with the environent variables I’ve listed set, and look out for panics. If you can pinpoint which exact release broke it for you, that would also be useful.

20

I am currently working with 0.14.10 its running better than 0.14.09. Due to lack of time I am still awaiting to change the servers from windows 32 bits to linux 64 bits. Before I wish to avoid bottlenecks with processor, memory and disk bandwith.