V0.12 Config questions

Development
1

I am curious about those settings in config.xml: copiers pullers hashers

I try to sync a folder containing over 15millions of files and Syncthing often end-up topping the RAM of the whole system (8GB). I then need to restart ST (get a whole rescan of the folder) to free some RAM. So my idea about those settings is that maybe it can be used to reduce ressources usage.

2

This should get into a FAQ somewhere.

1 Like
3

This surprises me a little though. There should be no reason for that, afaik… :confused:

4

Just like it should not take like half an hour to start/restart… However it might be a problem due to the millions files/folders inside the biggest share folder…

5

That happened to me today as well. I have a box 200 km away from here, which currently has a very slow internet connection. I am running into ping timeouts all the time, so I decided to upload that particular file (50 GB VM image) seperately with rsync; outside of my syncthing folder.

The rsync upload at the same time made the syncthing connection worse; it never did finish its inital index exchange with my server. What happened an my server was a bit astonishing; syncthing idled but consumed about 3.5 GB of RAM (with about 1GB swapped out):

Restarting syncthing on the server and shutting down syncthing on the slow boxed fixed the RAM issue.

6

I don’t see a ram issue, I see a minimum about of 1.1 gigs of cache (free ram).

7

That increase (“apps”) has been created by syncthing while running into ping timeouts. The amount of ram, which I have written above, has been reported be cgtop (I have RAM accounting using cgroups enabled).

8

So you are saying that syncthing has its own cgroup and that ygroup uses 3.5 gigs of ram? Have you got a graph for just that cgroup?

9

Yes, currently it’s 2.3 gigs.

$ systemctl status syncthing@stefan.service                                                                                                                                                                              ⏎
● syncthing@stefan.service - Syncthing - Open Source Continuous File Synchronization for stefan
   Loaded: loaded (/usr/lib/systemd/system/syncthing@.service; enabled; vendor preset: disabled)
   Active: active (running) since Mon 2015-09-28 21:01:44 CEST; 12h ago
     Docs: http://docs.syncthing.net/
 Main PID: 9539 (syncthing)
   Memory: 2.3G
   CGroup: /system.slice/system-syncthing.slice/syncthing@stefan.service
           └─9539 /usr/bin/syncthing -no-browser -logflags=0

Unfortunately not; I have to search for an appropriate munin plugin.

10

What the rss? Run this: ps -p 9539 -v

11 
$ ps -p 9539 -v
  PID TTY      STAT   TIME  MAJFL   TRS   DRS   RSS %MEM COMMAND
 9539 ?        Ssl   21:07    118  4969 1192126 635956  8.2 /usr/bin/syncthing -no-browser -logflags=0
12

Syncthing is only using just over half a gig of real ram. iirc cgroups can’t do separate rss accounting, the value it sees includes swap and friends. I can’t find good documentation on where “systemctl status” is getting that memory value, but it’s not fair to say Syncthing is using 2.3 G of ram, the rest of that amount is likely shared or cached or paged to disk as swap.

1 Like
13

After reading the docs of RSS I understand what these values actually mean. Thanks for that pointer. I just took the value, which has been reported by cgtop.

1 Like