syncthing crashes linux if scanning many files

[hruskacha (Austin Hruskach)]

I have Syncthing on Windows 10 and on MXLinux (Debian 12 [Bookworm] Linux 6.1.0-28 amd64). The Linux PC has a local state of 300,000+ files but is configured to SEND ONLY to the windows PC. The Windows PC Runs Radio Scanner Software called Trunking Recorder, which will pull (move) the audio files (thats the 300,000 files) from the syncthing directory and put them elsewhere for archive.

For some reason, once the Linux PC gets near 300,000 files, Syncthing will consume all available RAM (2x4GB Sticks) and completely freeze the OS. This happens within 60 seconds of Syncthing starting. The only solution so far is to delete the syncthing share and create a new one.

Note: I only have it backlog over 300,000 calls for redundancy / backup. I could probably thin it out…

No logs at this time, I couldnt find any…

EDIT: I forgot to mention, these files are like 150kb each, they are tiny. but again… 300,000+ of them.

[martinleben]

Welcome here @hruskacha !

Are all the files in one single directory? If not, how many files are there in the directory with the largest amount of files? If the count is large, I suggest you try to break up the files by year or year and month or similar. Search the forum and you find more information on this subject.

[tomasz86]

Can you check if there are no panic logs in the Syncthing home directory? On Linux, the default path is either $XDG_STATE_HOME/syncthing or $HOME/.local/state/syncthing (see Syncthing Configuration — Syncthing documentation). If there are panic logs there, please upload them here.