# Syncthing suddenly slowing down
**URL:** https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035
**Category:** Support
**Created:** [August 23, 2018, 3:33pm UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035 "2018-08-23T15:33:22Z")
**Posts on this page:** 20
**Page:** 1
### Author:  [@schneemensch](https://forum.syncthing.net/u/schneemensch)
#### Post date: [August 23, 2018, 3:33pm UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/1 "2018-08-23T15:33:22Z")
I am currently experimenting with Syncthing and therefore testing the exact same setup several times. I copy a 18GB folder from one machine to 5 remote devices and log the completion.
This process reliably takes between 1400s and 1550 seconds. But now twice it happened to me that a testrun took much longer (9350s) even though nothing changed in the configuration. I repeated the runs and got the same slow speed. The only way to reset to the previous speed was a restart of the Syncthing daemons on all devices.
Are there any known error, which can produce this sudden reduction in transfer speed?
Edit: I have the audit log running and they grow fairly large to about 400MB in size, but that should not explain the sudden drop.
---
### Author:  [@calmh](https://forum.syncthing.net/u/calmh)
#### Post date: [August 23, 2018, 5:13pm UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/2 "2018-08-23T17:13:09Z")
Not that I know of.
---
### Author:  [@AudriusButkevicius](https://forum.syncthing.net/u/AudriusButkevicius)
#### Post date: [August 23, 2018, 6:03pm UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/3 "2018-08-23T18:03:12Z")
Potentially database slows down or something along the lines, and a restart triggers compaction.
For many small files there are a ton of things that could go wrong.
---
### Author:  [@schneemensch](https://forum.syncthing.net/u/schneemensch)
#### Post date: [August 24, 2018, 7:39am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/4 "2018-08-24T07:39:18Z")
Those 18GB consist of 65000 files so we are definitely talking about small files.
Are there any advanced configuration settings which could help me here or should I just implement a daily restart?
---
### Author:  [@AudriusButkevicius](https://forum.syncthing.net/u/AudriusButkevicius)
#### Post date: [August 24, 2018, 7:48am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/5 "2018-08-24T07:48:48Z")
I don’t think there is any setting to help. Do you have ignores setup? Over what period does the slowdown happen?
---
### Author:  [@schneemensch](https://forum.syncthing.net/u/schneemensch)
#### Post date: [August 24, 2018, 7:54am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/6 "2018-08-24T07:54:31Z")
I do not have any ignores.
I am not completely sure, but I think after 3-5 test runs which took 25 minutes each, I experienced a sudden slow down. I mostly canceled those slow tests, unshared the folder and deleted it on the remote devices.
The same thing happened to me yesterday and the day before with about 3-5 normal testruns each day.
Should I delete the database after each testrun?
---
### Author:  [@calmh](https://forum.syncthing.net/u/calmh)
#### Post date: [August 24, 2018, 9:00am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/7 "2018-08-24T09:00:41Z")
I think you should do some normal performance troubleshooting. Figure out what your normal limiting factor is - is it CPU, disk I/O, network? What does this look like when it goes quickly, and when it goes slowly? Does the limiting factor change? Is it memory usage? If it’s I/O, is it file or database? If CPU, we can grab some profiles. Etc, etc.
There’s no setting that you can change to make things go magically faster when there is a slowdown, or we would make that setting the default. We need to figure out the source of the slowdown.
---
### Author:  [@schneemensch](https://forum.syncthing.net/u/schneemensch)
#### Post date: [August 24, 2018, 9:35am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/8 "2018-08-24T09:35:11Z")
Sure. I will look into it. I do not believe it is CPU or RAM since the machines in the datacenter are quite powerful and basically idling during my testruns, but I will test a bit when the issue arises again.
---
### Author:  [@schneemensch](https://forum.syncthing.net/u/schneemensch)
#### Post date: [August 27, 2018, 11:53am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/9 "2018-08-27T11:53:57Z")
I tested a bit when the issue arose again:
1. All machines are slowing down about the same time. Therefore I thought it might be related to the config and database folders which are all placed on the same centralized filer, but I saw the opposite. When syncthing is slow there is almost no traffic on the filer.
2. When one receiving machine is restarted, it receives the data in the usual speed. This suggests that it is no problem of the sending machine, but the receiving machines.
3. So far I have only noticed the problem on linux machines
4. Neither CPU, memory or network usage are high on any of the machines.
5. A simple restart always fixes the problem without deleting the database, config or log files.
I still do not know why the slow down occurs. I will probably do a daily restart now to fix the outcome of the issue.
---
### Author:  [@calmh](https://forum.syncthing.net/u/calmh)
#### Post date: [August 27, 2018, 12:58pm UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/10 "2018-08-27T12:58:36Z")
Restart of Syncthing or reboot?
---
### Author:  [@schneemensch](https://forum.syncthing.net/u/schneemensch)
#### Post date: [August 27, 2018, 1:48pm UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/11 "2018-08-27T13:48:00Z")
restart of Syncthing
---
### Author:  [@calmh](https://forum.syncthing.net/u/calmh)
#### Post date: [August 27, 2018, 2:26pm UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/12 "2018-08-27T14:26:02Z")
Odd.
---
### Author:  [@schneemensch](https://forum.syncthing.net/u/schneemensch)
#### Post date: [September 12, 2018, 8:37am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/13 "2018-09-12T08:37:57Z")
I want to look further into this, because I am fearing that it also appears during my production syncs and not only during my test runs.
It is 100% reproducible that the download and upload rate increases by a factor of up to 1000 when I restart the clients during a slowed down test run. It also works to restart the clients immediately before the folder is shared.
Which debug logging options could I activate to get more information about the reason for the slowdown?
---
### Author:  [@AudriusButkevicius](https://forum.syncthing.net/u/AudriusButkevicius)
#### Post date: [September 12, 2018, 11:23am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/14 "2018-09-12T11:23:43Z")
Do you have rate limits enabled in general? I can hwlp you debug this by producing some custom builds.
---
### Author:  [@schneemensch](https://forum.syncthing.net/u/schneemensch)
#### Post date: [September 12, 2018, 11:33am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/15 "2018-09-12T11:33:21Z")
No I don’t.
I am not sure if I can work with custom builds since SyncThing is deeply integrated into our scripts and I do not want to use custom builds on the production system.
I also feel not very comfortable to share logs without cleaning them, because of sensible file names.
---
### Author:  [@AudriusButkevicius](https://forum.syncthing.net/u/AudriusButkevicius)
#### Post date: [September 12, 2018, 7:57pm UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/17 "2018-09-12T19:57:47Z")
Right, so I don’t really see how we can help you, if we can’t get the logs nor we can run custom builds.
---
### Author:  [@schneemensch](https://forum.syncthing.net/u/schneemensch)
#### Post date: [September 13, 2018, 7:37am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/18 "2018-09-13T07:37:38Z")
Maybe you could start by answering my question which debug logging options are relevant.
I did not mean that I cannot share any logs. I just need to make sure that they are sanitized by creating a test directory with different file names.
---
### Author:  [@AudriusButkevicius](https://forum.syncthing.net/u/AudriusButkevicius)
#### Post date: [September 13, 2018, 7:56am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/19 "2018-09-13T07:56:45Z")
The relevant debugging in this case will need a custom build. I suspect this could be caused by the limiter, but there is no logging around that area that would help me prove my suspicion.
---
### Author:  [@schneemensch](https://forum.syncthing.net/u/schneemensch)
#### Post date: [September 13, 2018, 8:14am UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/20 "2018-09-13T08:14:56Z")
Ok, thanks. I did not understand that completely.
I will look if I can create a setup which runs the custom build separately from our production system
---
### Author:  [@calmh](https://forum.syncthing.net/u/calmh)
#### Post date: [September 13, 2018, 2:40pm UTC](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035/21 "2018-09-13T14:40:26Z")
If we suspect the limiter might be at fault, run without limits for a while and see what happens?
Another thing that could be interesting… When you see the slowdown, don’t restart. Instead pause and resume the device, causing just a connection reset. See if this makes a difference. If it does, it narrows down the amount of internal state that could be at fault.
[Next page](https://forum.syncthing.net/t/syncthing-suddenly-slowing-down/12035.md?page=2)