[SOLVED] Multiple panics during initial synchronisation

[tomasz86]

I have just had experienced these four panics in sequence while doing the initial synchronisation between two devices. The first device is an old one, while the second one was starting from zero, i.e. everything was being downloaded from scratch.

[XZZTD] 2021/05/17 21:22:34 WARNING: Fatal error: bnroh-e3h4v Get(xxx): filling Blocks: open xxx\index-v0.14.0.db\001093.sst: The system cannot find the file specified.
Panic at 2021-05-17T21:22:34+09:00
panic: filling Blocks: open x: The system cannot find the file specified.

panic-20210517-212234.log (75.0 KB)

[XZZTD] 2021/05/17 21:22:46 WARNING: Fatal error: bnroh-e3h4v GetGlobal(xxx): device present in global list but missing as device/fileinfo entry
Panic at 2021-05-17T21:22:46+09:00
panic: device present in global list but missing as device/fileinfo entry

panic-20210517-212246.log (81.0 KB)

[XZZTD] 2021/05/17 21:33:58 WARNING: Fatal error: bnroh-e3h4v Get(xxx): filling Blocks: open xxx\index-v0.14.0.db\001371.sst: The system cannot find the file specified.
Panic at 2021-05-17T21:33:58+09:00
panic: filling Blocks: open x: The system cannot find the file specified.

panic-20210517-213358.log (75.6 KB)

[XZZTD] 2021/05/17 21:34:42 WARNING: Fatal error: bnroh-e3h4v GetGlobal(xxx): device present in global list but missing as device/fileinfo entry
Panic at 2021-05-17T21:34:42+09:00
panic: device present in global list but missing as device/fileinfo entry

panic-20210517-213442.log (90.6 KB)

I have wiped the database since then, and now I’m doing a second trial, but I have no idea what the culprit might have been. I can only say that the hardware itself is in good shape and 100% stable.

Edit: I forgot to mention that this is Syncthing v1.16.0 with a couple of minor custom changes, and also with https://github.com/syncthing/syncthing/commit/0d054f9 cherry-picked on top of it.

[imsodin (Simon)]

The first and third panic is the database panicking because it is missing an internal file on disk, i.e. something in index-v0.14.0.db got deleted (or the db is otherwise corrupted). Everything else is likely just an effect/consequence of said corruption.

Usually db corruption implies bad storage, but a missing file sounds more like something else meddling with the directory the db is stored in.

[tomasz86]

Yeah, I’m not sure what exactly had happened, but I removed all folders, restarted from scratch, and everything has synced properly this time .