deletions not syncing

Correct. Config, please.

sorry, hadn’t seen your request for the config.

config for JKZ4TOI https://pastebin.com/TRifWxLG

Indent with 4 spaces, or bracket with 3 backticks:

```
Some code here
```

1 Like

Well, I’m stumped. There’s nothing wrong with your config. As far as we can see the index entry for the delete was never sent, or wasn’t processed correctly on the receiving side.

Does this happen for all folders or just this one? For all deletes?

TXZZIYN is sharing 2 folders.

The issue is there on deletes from one of those folders.

The issue does not happen when i create & delete just 1 file, manually.

The issue happens on automated mass deletions. But not for every single file.

I have >1 host that shows this exact same behaviour.

I have not looked into my errors as deep as you have, but it appears that for me it also only happens on mass deletions and not on all files.

I delete about 60000 files and it got stuck on 26 of them.

deleting 60 files per day, exactly 7 of those 60 deletions aren’t synced. Every single day, like clockwork.

Always the same files? Is there anything different about the files or their deletion process?

So I went looking through the logs you sent, but they don’t cover the time where the example file above should have been deleted so it’s hard to say anything.

The debug settings themselves are probably fine, but they would need to cover the deletion of a file that reproduces the issue.

they aren’t the same files, since they get deleted daily. and the names carry a timestamp.

Anyway, whenever they were created or deleted, sooner or later Syncthing on the other host should hear about the news, and mirror the change, amirite ?

The example file DBA_backup_2018_08_23_063002_1104513.bak should have been deleted 3 days ago…but granted, i will look for a better example.

I took DBA_backup_2018_08_23_063002_1104513.bak because it is the oldest of the bunch of non-deleted files.

DBA_backup_2018_08_25_063001_9830387 looks like one, deleted 2018/08/28 05:45:13, which is in the logs…

1 Like

in syncthing.log we could consider this deletion

[TXZZI] 2018/08/28 05:45:13.737195 leveldb_transactions.go:79: DEBUG: insert; folder="vnyi3-dsvsk" device=7777777-777777N-7777777-777777N-7777777-777777N-7777777-77777Q4 File{Name:"DBA_backup_2018_08_25_063001_9830387.bak", Sequence:73018, Permissions:00, ModTime:2018-08-25 06:30:02.2760555 +0200 CEST, Version:{[{TXZZIYN 2}]}, Length:0, Deleted:true, Invalid:false, LocalFlags:0x0, NoPermissions:false, BlockSize:0, Blocks:[]}

ya beat me to it…

shall i do the rest-dance ? for that file ?

TXZZIYN :

{
  "availability": null,
  "global": {
    "deleted": true,
    "ignored": false,
    "invalid": false,
    "localFlags": 0,
    "modified": "2018-08-25T06:30:02.2760555+02:00",
    "modifiedBy": "TXZZIYN",
    "mustRescan": false,
    "name": "DBA_backup_2018_08_25_063001_9830387.bak",
    "noPermissions": false,
    "numBlocks": 0,
    "permissions": "0",
    "sequence": 73018,
    "size": 0,
    "type": 0,
    "version": [
      "TXZZIYN:2"
    ]
  },
  "local": {
    "deleted": true,
    "ignored": false,
    "invalid": false,
    "localFlags": 0,
    "modified": "2018-08-25T06:30:02.2760555+02:00",
    "modifiedBy": "TXZZIYN",
    "mustRescan": false,
    "name": "DBA_backup_2018_08_25_063001_9830387.bak",
    "noPermissions": false,
    "numBlocks": 0,
    "permissions": "0",
    "sequence": 73018,
    "size": 0,
    "type": 0,
    "version": [
      "TXZZIYN:2"
    ]
  }
}

versus JKZ4TOI

{
  "availability": [
    {
      "id": "TXZZIYN-3IUWV6F-GBS3YOA-AQOPQZG-72BUFG3-5CA46F3-MQGJAAJ-N4724Q2",
      "fromTemporary": false
    }
  ],
  "global": {
    "deleted": false,
    "ignored": false,
    "invalid": false,
    "localFlags": 0,
    "modified": "2018-08-25T06:30:02.2760555+02:00",
    "modifiedBy": "TXZZIYN",
    "mustRescan": false,
    "name": "DBA_backup_2018_08_25_063001_9830387.bak",
    "noPermissions": false,
    "numBlocks": 17,
    "permissions": "0644",
    "sequence": 71423,
    "size": 2187776,
    "type": 0,
    "version": [
      "TXZZIYN:1"
    ]
  },
  "local": {
    "deleted": false,
    "ignored": false,
    "invalid": false,
    "localFlags": 0,
    "modified": "2018-08-25T06:30:02.2760555+02:00",
    "modifiedBy": "TXZZIYN",
    "mustRescan": false,
    "name": "DBA_backup_2018_08_25_063001_9830387.bak",
    "noPermissions": false,
    "numBlocks": 17,
    "permissions": "0644",
    "sequence": 71423,
    "size": 2187776,
    "type": 0,
    "version": [
      "TXZZIYN:1"
    ]
  }
}

Yeah so the logs clearly show a bug that affects that file. The update containing that delete is just lost in cyber space. I have no idea why yet, but there’s for sure something odd here.

were deleted, but not synced :

-rw-r--r--  1 admin users 2.1M Aug 23 06:30 DBA_backup_2018_08_23_063002_1104513.bak
-rw-r--r--  1 admin users 2.1M Aug 24 06:30 DBA_backup_2018_08_24_063001_5522167.bak
-rw-r--r--  1 admin users 2.1M Aug 25 06:30 DBA_backup_2018_08_25_063001_9830387.bak

and

-rw-r--r--  1 admin users 3.0G Aug 23 06:06 Kate_backup_2018_08_23_060501_5046216.bak
-rw-r--r--  1 admin users 4.0M Aug 24 06:00 Kate_backup_2018_08_24_060001_0742353.trn
-rw-r--r--  1 admin users 3.0G Aug 24 06:06 Kate_backup_2018_08_24_060501_1794003.bak
-rw-r--r--  1 admin users 1.9M Aug 25 06:00 Kate_backup_2018_08_25_060001_6070631.trn
-rw-r--r--  1 admin users 3.0G Aug 25 06:06 Kate_backup_2018_08_25_060501_5802206.bak

and

-rw-r--r--  1 admin users 6.2G Aug 23 06:09 KATE_IMAGES_backup_2018_08_23_060501_5086218.bak
-rw-r--r--  1 admin users 6.2G Aug 24 06:09 KATE_IMAGES_backup_2018_08_24_060501_1854007.bak
-rw-r--r--  1 admin users 6.2G Aug 25 06:09 KATE_IMAGES_backup_2018_08_25_060501_5842208.bak

and

-rw-r--r--  1 admin users 1.8M Aug 23 06:30 KATE_GEO_backup_2018_08_23_063002_1574540.bak
-rw-r--r--  1 admin users 1.8M Aug 24 06:30 KATE_GEO_backup_2018_08_24_063001_6082199.bak
-rw-r--r--  1 admin users 1.8M Aug 25 06:30 KATE_GEO_backup_2018_08_25_063002_0420421.bak

and there’s more, but we get the point.

Can I post extracts of the logs that are relevant, in an issue? Some file names and IDs there, similar to mentioned in this thread?

sure, thanks for asking. I don’t see any security risk in that.

1 Like