# Syncthing ignores/doesn't pick up almost all files
**URL:** https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484
**Category:** Support
**Created:** [December 19, 2024, 11:31am UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484 "2024-12-19T11:31:01Z")
**Posts on this page:** 14
**Page:** 1
### Author:  [@str](https://forum.syncthing.net/u/str)
#### Post date: [December 19, 2024, 11:31am UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/1 "2024-12-19T11:31:01Z")
Created a new dir yesterday that I wanted to sync (50 000 files and lots of git repos and dot files), but today I noticed that syncthing just pics up 66 files instead of the 50 000.
I tried to reset deltas and the db but it changed nothing.
I have some dirs with 600 000+ files that sync just fine.
Today I double checked with all my dirs, I noticed several where syncthing doesn’t pick up everything and a couple thousand files are missing in the sync…
What can I do from here ? ( I mostly checked with ‘tree’) I have no ignore rules that should prevent the synchronization of those files.
I am using btrfs on the system where the files don’t get picked up. (root and home dir get snapped) Also i am syncing ‘$HOME/Sync/lots-of-dirs…’ where ‘Sync’ is a symlink to a different drive. And the daughter dirs contain the different syncthing folders
No errors or warnings in the webui. Tried to start syncthing via systemd and the provided .desktop files.
---
### Author:  [@str](https://forum.syncthing.net/u/str)
#### Post date: [December 19, 2024, 12:36pm UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/2 "2024-12-19T12:36:09Z")
I am quite confused.
example dir most stuffed doens’t get picked up: Sync/pc1/config/50 000 files
When I moved the 50 000 files directly into pc1 most stuff got picked up… And when I moved them to a new subdir e.g. config2 they vanish again
I doubt this has anything todo with path / file lenght
---
### Author:  [@calmh](https://forum.syncthing.net/u/calmh)
#### Post date: [December 19, 2024, 12:44pm UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/3 "2024-12-19T12:44:11Z")
My guess is [When socket files are in a folder that needs to be synced on linux, some files were not synced until the socket files were removed · Issue #9872 · syncthing/syncthing · GitHub](https://github.com/syncthing/syncthing/issues/9872)
Could be some other kind than sockets, or it could be some other error that takes the same path and currently doesn’t get surfaced. If you can try the latest nightly there is a fix in there…
---
### Author:  [@str](https://forum.syncthing.net/u/str)
#### Post date: [December 19, 2024, 1:13pm UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/4 "2024-12-19T13:13:01Z")
Yeah this might be it. This branch ? [GitHub - syncthing/syncthing at release-nightly](https://github.com/syncthing/syncthing/tree/release-nightly) nah the commit is not in there…
Ah NVM [Versions & Releases — Syncthing documentation](https://docs.syncthing.net/users/releases.html#nightly-builds) found it
---
### Author:  [@calmh](https://forum.syncthing.net/u/calmh)
#### Post date: [December 19, 2024, 1:59pm UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/5 "2024-12-19T13:59:59Z")
Actually it wasn’t, I thought the build had run but it hadn’t. It is running now. 😕
You want `1.29.0-rc.1.dev.12` (or newer) to have any luck.
---
### Author:  [@str](https://forum.syncthing.net/u/str)
#### Post date: [December 19, 2024, 2:16pm UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/6 "2024-12-19T14:16:14Z")
Okay I have run v1.29.0-rc.1.dev.12. most files get picked up now(after running once the nightly build) (even by the stable release)
‘tree’ still gives me a diff of 10 000 files ‘find dir -type f | wc -l’ does not. But at very least I am not missing anything important anymore.
I think syncthing still has trouble to pick up everything ‘find dir -type f | wc -l’ still gives me a diff of multiple 10 000 in some dirs… IDK why this might be (most folders seem to be fine now…)
---
### Author:  [@calmh](https://forum.syncthing.net/u/calmh)
#### Post date: [December 19, 2024, 2:18pm UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/7 "2024-12-19T14:18:47Z")
If you enable `scanner` debugging in the log view, and run a scan (with the dev.12 nightly), do you get `Skipping non-regular file` lines? Would be interesting to see…
---
### Author:  [@str](https://forum.syncthing.net/u/str)
#### Post date: [December 19, 2024, 2:34pm UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/8 "2024-12-19T14:34:10Z")
There were a couple with
```plaintext
STTRACE=scanner ./syncthing | tee log.txt
```
I removed them (9) now there is nothing. But I still have diffs with `find dir -type f | wc -l`
do you have a more reliable way to check the file count for syncthing? I hope this is an issue with the way those tools interact with BTRFS.
```plaintext
rsync -an --stats /path/to/btrfs /empty/dir
```
Also gives me a diff of ~30 000 regular files
Well I copied the dir to a ext4 usb but still a diff of 30 000
---
### Author:  [@str](https://forum.syncthing.net/u/str)
#### Post date: [December 19, 2024, 4:14pm UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/9 "2024-12-19T16:14:22Z")
Are there other things / logs I should check?
---
### Author:  [@calmh](https://forum.syncthing.net/u/calmh)
#### Post date: [December 19, 2024, 5:43pm UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/10 "2024-12-19T17:43:29Z")
If you have both sides you can diff the find output from them. I was interested in what those non-regular file log entries were, though.
---
### Author:  [@gadget](https://forum.syncthing.net/u/gadget)
#### Post date: [December 19, 2024, 5:54pm UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/11 "2024-12-19T17:54:29Z")
> [@str](#):
>
> do you have a more reliable way to check the file count for syncthing? I hope this is an issue with the way those tools interact with BTRFS.
Note that `find dir -type f | wc -l` along with `rsync -an --stats /path/to/btrfs /empty/dir` would include any versioned files under Syncthing’s .stversions directory while Syncthing’s web UI reports only the files counted in the sync.
_(In Linux, user-space tools that interact with a filesystem pass thru Linux’s [VFS](https://en.wikipedia.org/wiki/Virtual_file_system) so they’re insulated from the fact that it’s btrfs or some other filesystem type.)_
---
### Author:  [@str](https://forum.syncthing.net/u/str)
#### Post date: [December 20, 2024, 9:13am UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/12 "2024-12-20T09:13:50Z")
I don’t use syncthings file versioning.
mmmh I just remembered that ’ du ’ and similar tools apparently don’t report accurately on btrfs (e.g better use btrfs du etc…) .
I guess that is not the case for other things . thanks!
---
### Author:  [@str](https://forum.syncthing.net/u/str)
#### Post date: [December 20, 2024, 9:15am UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/13 "2024-12-20T09:15:45Z")
Well the result was rather anticlimatic
The socket issue was definitely one cause.
The rest was solved by this …
```plaintext
find -iname "*syncthing*tmp*" -delete
```
The tmp files was weren’t cleaned up ( + 200 000)
---
### Author:  [@system](https://forum.syncthing.net/u/system)
#### Post date: [January 19, 2025, 9:15am UTC](https://forum.syncthing.net/t/syncthing-ignores-doesnt-pick-up-almost-all-files/23484/14 "2025-01-19T09:15:52Z")
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.