Files deleted after update to v0.14.45-rc.2


(Alex) #1

Some files ended up as conflicts, some are just gone. Noticed it because it tried to delete some directories which it could not like for example:

[AGR6N] 2018/02/13 13:42:08.855203 rwfolder.go:1796: INFO: Puller (folder pi1-freigabe, file "..."): delete dir: directory is not empty

something else that appears in the log quite often is

[AGR6N] 2018/02/13 13:34:49.407153 rwfolder.go:1796: INFO: Puller (folder uberspace-agraf, file "..."): finisher: file modified but not rescanned; will try again later

will keep it in this state for now for debugging.

GUI also does not seem to load correctly on some devices, folders show unknown, remote devices show nothing. Any hints on how to debug it are appreciated.

Backup from this morning exists so at least no data lost, and this is a nice reminder for everybody that syncthing is no backup :wink:


(Ben Shepherd) #2

This happened to me too! Suddenly noticed lots of deletes (thanks to SyncTrayzor’s notifications). Going to have to dig through the logs and find out what was deleted now, ugh.


(Shelby Cain) #3

Same thing here and thank goodness I have backups. An explosion of inexplicable conflicts (e.g.: truecrypt containers that haven’t been mounted in months, jar files that should never change, etc) and what looks to be lots of deleted files.

Probably 100GB or so of data I’ll have to sift through and verify now. I think I’ll be permanently opting out of rc builds.


(Jakob Borg) #4

Any hints on a commonality between the affected files? Someone on IRC mentioned ignores?

Also mentioned is files that were at some point hit by a case sensitivity conflict (foo vs Foo)?


#5

Add “me too” to this list. it nuked only one share - my music, I have ignores on it - but it was deleting other files.


#6

I would also say (at least some of) mine seems to be case sensitivity too.


(Jakob Borg) #7

Case-only renames of directories? Thinking back on the changes made, I could see that having adverse effects…


#8

Yep certainly of directories


(Shelby Cain) #9

No commonality that I can see between the files that were conflicted/removed between Linux, MacOS and Windows and I don’t use ignores.

As far as deleted files, it seems syncthing was really keen on removing directories that were in fact not empty and most of the files/dirs in question had mixed case but that shouldn’t have really been a problem because most of these were one-way replication setups so there were no actual changes to replicate from the source.

Closer examination of my conflicted truecrypt volumes seems to indicate that they are different valid versions of the volumes which suggests that at least one of the members in my replication pool had older versions that were never kept in sync (which is obviously a problem in itself). It’s possible that me resetting the database on one of my nodes triggered that?

Finally, as others have stated, the GUI seems to become unresponsive and some nodes aren’t establishing connections so that sounds like a deadlock of some sort.


(Jakob Borg) #10

Any interesting log output (i.e., anything other than the ordinary chatter of devices connecting etc) for any of you? If it was saved?


(Simon) #11

Anybody (@alyandon @eyeson @benshep @Alex) experiencing this on any folder that is not shared with windows?


(Shelby Cain) #12

Got a panic on one of the nodes that wouldn’t connect:

https://paste.ubuntu.com/p/SbcwQ7Srz8/

Edit: In my case, all folders are shared between at least one Windows machine.

Edit2: Maybe one of these days I’ll get around to writing some systemd service files for syncthing so I have real logs to reference after the fact.


(Jakob Borg) #13

@alyandon Is that the full panic trace, or is it truncated? It’s odd if it’s not truncated, there should be more things happening… Or rather, it’s deadlocking on a lock, but there is only one routine visible trying to get the lock and no-one else in that section, according to the trace.

(Don’t think is related to us eating your data by the way)


(Zz0rk) #14

Ran into this behavior this AM when after starting up SyncTrazer that upgraded to 0.14.45-rc.2. Posted an initial bug report here (with screenshots of the SyncTrazer browser interface and output from console). I can confirm that the content of several folders were deleted. Not individual files within certain folders; always the entire content of folders. I sync between Windows and Debian. The naming convention of folders varies. The start with lowercase letters, uppercase letters or numbers.


(Jakob Borg) #15

@zz0rk Any chance you renamed these directories in case only (i.e. foo -> Foo) while they were under Syncthing’s care?


(Zz0rk) #16

No; I use a Master SyncThing server. Changes on remote devices get uploaded then distributed to other devices. Some of the folders that’s content was deleted have not been touched in months or longer. Other ones are more recent and are profile folders from portable versions of Firefox and Google.

EDIT: I should qualify that the update happened on a Windows box this AM. The files were deleted on my portable copy of Synchting. I have yet to verify, if those files were actually deleted from my Master SyncThing server.


(Zz0rk) #17

I can confirm this one as well. That’s the behavior I saw in SyncTrazer this AM after upgrading to 0.14.45-rc2


(Jakob Borg) #18

Odd.


#19

Jakob, can you send an emergency update( to 14.44)? To prevent further damage.


(Zz0rk) #20

That would be appreciated.