I’m unconvinced it’s an issue in practice, but if it is we can certainly do a vacuum at some point. Empty pages would be reused when needed and, as I understand it, get moved to end and compact over time. Obviously 120 MB to 35 MB is a huge difference percentage wise, but in actual space used more or less negligible I think. I checked my server that’s it’s been in all the experiments and it compacted from 4.7 GB to 4.3 GB. However it took like two minutes (during which Syncthing would be essentially frozen) and used an extra 4.3 GB of space to accomplish, so it’s not precisely “free”. I also think we had much larger balooning with leveldb, it’s just that nobody really analysed it.
So yeah, SQLite uses more space on average than leveldb. I’m OK with that as a tradeoff.
All that said the bulk of the database is the blocks lookup, which could be moved to a separate file with some finessing. There are only a couple of queries that use them, and they are essentially a “cache” (could be rebuilt from the rest of the database info). However it requires doing an ATTACH to join with the other tables which is somewhat annoying to accomplish I think.
So the attach is doable, but I’m not sure if it gains us much if anything? Non-block-related queries might be faster with a smaller main db that is easier cached?
jb@jbo2:..ng/syncthing/test/h1 % ls -lh
total 541192
-rw-r--r--@ 1 jb staff 1.4K Mar 17 10:33 cert.pem
-rw-r--r--@ 1 jb staff 9.1K Mar 22 08:36 config.xml
-rw-r--r--@ 1 jb staff 1.4K Mar 17 10:33 https-cert.pem
-rw-r--r--@ 1 jb staff 2.4K Mar 17 10:33 https-key.pem
-rw-r--r--@ 1 jb staff 189M Mar 22 12:50 index-v2-blocks.db
-rw-r--r--@ 1 jb staff 43M Mar 22 12:50 index-v2.db
-rw-r--r--@ 1 jb staff 2.4K Mar 17 10:33 key.pem
Many servers stay up for long periods at a time but does it make sense to vacuum on startup? It will delay startup but perhaps there’s an expectation that connections won’t be immediately available. It may also be that you can be listening and try to connect while the vacuum is ongoing.
If the vacuum is interruptable that may also be an option. You can wait till pending transfers complete and queue fswatcher events and transfer updates while the vacuum is underway. If transfer requests come you can come up with some criteria (or an option) whether to hold the request until the vacuum completes or interrupt the vacuum, use the old database and try again later.
@calmh one issue I noticed that may be worth fixing: a v2 instance can run at the same time as a v1 instance.
In v1, you cannot have two instances running at the same time from the same database, because they will both attempt to lock the LevelDB database. With v2, this is achieved by locking through SQLite. However, you can run v1 and v2 together simultaneously due to the different locking mechanisms used.
If I start v2 while v1 is running, it starts up without issue but does not seem to be able to migrate (while not throwing errors).
My suggestion would be to attempt to lock the old database on startup when it is present.
I am sure this scenario will not happen often (especially when users use auto-upgrading or even the iOS/macOS apps) but in the case it does it may be very confusing (and possibly dangerous? not sure what happens, v2 and v1 both have the same device ID but different indexes, they can’t listen on the same ports, etc.)
I’ve done more testing with a larger database, sized about 550 MB. This time, for some reason, vacuuming trimmed only 25 MBs or so. It still shrinks up to 300 MB with NTFS compression though.
Yeah, also an app can be quite long-lived on iOS (the OS suspends it on close but doesn’t quit it until certain circumstances are met, e.g. memory pressure).
On iOS I would disable any VACUUM on startup and if necessary schedule a periodic background task to do it. These would then happen when e.g. the device is on the charger. The runtime is limited so vacuuming larger databases may not be possible.
Using auto_vacuum is acceptable on iOS I think because all iOS devices have quite fast (flash) storage anyway, so fragmentation is not that bad.
I’m testing the new database on my main Syncthing installation right now. I just want to say that it would probably be useful to warn very clearly (e.g. in the Docs) that the migration process can be slow. Here, with the old database sized at about 1 GB, it’s been almost 1 hour already, and while the first phase has finished, the index exchange is taking a long time too.
In addition, while probably not a big deal on the desktop, the index-v2.db-wal file has grown up to 4.5 GB. Combined with index-v2.db (2.5 GB) and the old database still there (1 GB), the files take 8x the amount of space than before. This is almost guaranteed to crash on systems like Android where the database is stored on the user-inaccessible and size-limited /data partition (Actually not sure about this one, as the partition seems to be shared with user storage nowadays, so there should be plenty of space. It used to be a completely separate, small partition on old Android devices.).
I’d also like to point out that the migrated folder with the old database is actually called index-v0.14.0.db-migrated (with a hyphen ).
Mind sharing the specs, build, and database stats for that? Database size wise it sounds similar to what I’m running, but time wise an order of magnitude longer.
I compiled my own binary for Windows x86-64 using Zig CC v0.14.0 from https://ziglang.org/download. The hardware, or at least the relevant parts, are AMD Ryzen 5700G, 2x16 GB DDR4-3200 RAM, and Kingston KC3000 2TB SSD. The OS is Windows 10 x64.
The migration itself took about 39 minutes actually:
After a whole night, the index-v2.db-wal file size has decreased to just 24 MB, so it’s not a problem anymore. The database itself does still take 3.41 GB (compressed to 1.63 GB with NTFS), which is quite a bit more than the old one taking only 964 MB with the same data.
Thanks! I made some tweaks to increase concurrency and make bulk inserts faster at the price of safety (like turning off journalling and fsyncs) – but in any case the migration will be retried from start if it does not complete. Also added some stats to show better what’s going on.
For me this reduced the total time to about a third of what it was before, it would be interesting to see how it works out for you and what the stats are. This is what I see (Linux, default Go & GCC, Xeon E-2274G, some SATA SSD):
[start] 2025/03/23 10:13:04 INFO: syncthing v2.0.0-beta.9.dev.4.gfdfa19fc-sqlite "Hafnium Hornet" (go1.24.1 linux-amd64) jb@unu 2025-03-23 10:02:01 UTC
[start] 2025/03/23 10:13:05 INFO: Migrating old-style database to SQLite; this may take a while...
[start] 2025/03/23 10:13:05 INFO: Migrated folder 7ojpy-cfjhl; 11 files and 1k blocks in 0s, 825.4 files/s
[start] 2025/03/23 10:13:05 INFO: Migrated folder f3g2c-xkhxh; 2408 files and 12k blocks in 0s, 3910.9 files/s
[start] 2025/03/23 10:13:08 INFO: Migrated folder kzjer-zz3bg; 4687 files and 146k blocks in 2s, 2204.0 files/s
[start] 2025/03/23 10:13:16 INFO: Migrated folder marir-bw9mx; 1591 files and 1312k blocks in 8s, 186.1 files/s
[start] 2025/03/23 10:13:26 INFO: Migrated folder ml3yu-v9kaa; 3053 files and 1133k blocks in 9s, 320.3 files/s
[start] 2025/03/23 10:13:30 INFO: Migrated folder p3jms-73gps; 2492 files and 410k blocks in 4s, 577.4 files/s
[start] 2025/03/23 10:13:32 INFO: Migrated folder rmvlx-cekie; 4861 files and 99k blocks in 2s, 2276.6 files/s
[start] 2025/03/23 10:13:32 INFO: Migrated folder rozef-xd4qh; 5 files and 8k blocks in 0s, 64.1 files/s
[start] 2025/03/23 10:13:36 INFO: Migrated folder smaoh-2qdsh; 5016 files and 254k blocks in 4s, 1207.8 files/s
[start] 2025/03/23 10:13:46 INFO: Migrating folder uk9gc-dkerd... (52000 files and 93k blocks in 10s, 5180.3 files/s)
[start] 2025/03/23 10:13:49 INFO: Migrated folder uk9gc-dkerd; 62701 files and 131k blocks in 12s, 4962.8 files/s
[start] 2025/03/23 10:14:00 INFO: Migrating folder w3ejt-fn4dm... (11000 files and 862k blocks in 10s, 1015.1 files/s)
[start] 2025/03/23 10:14:10 INFO: Migrating folder w3ejt-fn4dm... (22000 files and 1719k blocks in 21s, 1036.9 files/s)
[start] 2025/03/23 10:14:21 INFO: Migrating folder w3ejt-fn4dm... (31000 files and 2562k blocks in 32s, 965.5 files/s)
[start] 2025/03/23 10:14:32 INFO: Migrating folder w3ejt-fn4dm... (41000 files and 3365k blocks in 42s, 954.2 files/s)
[start] 2025/03/23 10:14:43 INFO: Migrating folder w3ejt-fn4dm... (47000 files and 4174k blocks in 53s, 875.9 files/s)
[start] 2025/03/23 10:14:53 INFO: Migrating folder w3ejt-fn4dm... (57000 files and 4846k blocks in 1m3s, 891.3 files/s)
[start] 2025/03/23 10:15:04 INFO: Migrating folder w3ejt-fn4dm... (66000 files and 5572k blocks in 1m14s, 884.9 files/s)
[start] 2025/03/23 10:15:14 INFO: Migrating folder w3ejt-fn4dm... (76000 files and 6191k blocks in 1m25s, 892.9 files/s)
[start] 2025/03/23 10:15:25 INFO: Migrating folder w3ejt-fn4dm... (87000 files and 6812k blocks in 1m35s, 909.2 files/s)
[start] 2025/03/23 10:15:35 INFO: Migrating folder w3ejt-fn4dm... (96000 files and 7544k blocks in 1m46s, 902.1 files/s)
[start] 2025/03/23 10:15:43 INFO: Migrated folder w3ejt-fn4dm; 101908 files and 8093k blocks in 1m54s, 892.4 files/s
[start] 2025/03/23 10:15:43 INFO: Migrating virtual mtimes...
[start] 2025/03/23 10:15:43 INFO: Migration complete, 188733 files and 11605k blocks in 2m38s
My laptop is more or less the same; I think it has potential to be much faster, but macOS is fanatic about putting server processes on the efficiency cores and limiting their energy consumption etc…
[start] 2025/03/23 11:13:16 INFO: syncthing v2.0.0-beta.9.dev.4.gfdfa19fc-sqlite "Hafnium Hornet" (go1.24.1 darwin-arm64) jb@jbo2.local 2025-03-23 10:02:01 UTC [stnoupgrade]
[start] 2025/03/23 11:13:16 INFO: Migrating old-style database to SQLite; this may take a while...
[start] 2025/03/23 11:13:16 INFO: Migrated folder 7ojpy-cfjhl; 11 files and 1k blocks in 0s, 1951.1 files/s
[start] 2025/03/23 11:13:16 INFO: Migrated folder f3g2c-xkhxh; 2408 files and 12k blocks in 0s, 9878.0 files/s
[start] 2025/03/23 11:13:17 INFO: Migrated folder kzjer-zz3bg; 4687 files and 146k blocks in 0s, 5612.3 files/s
[start] 2025/03/23 11:13:21 INFO: Migrated folder marir-bw9mx; 1591 files and 1312k blocks in 4s, 378.2 files/s
[start] 2025/03/23 11:13:27 INFO: Migrated folder ml3yu-v9kaa; 3053 files and 1133k blocks in 5s, 550.8 files/s
[start] 2025/03/23 11:13:30 INFO: Migrated folder p3jms-73gps; 2492 files and 410k blocks in 2s, 883.4 files/s
[start] 2025/03/23 11:13:31 INFO: Migrated folder rmvlx-cekie; 4861 files and 99k blocks in 1s, 4005.4 files/s
[start] 2025/03/23 11:13:31 INFO: Migrated folder rozef-xd4qh; 5 files and 8k blocks in 0s, 80.6 files/s
[start] 2025/03/23 11:13:34 INFO: Migrated folder smaoh-2qdsh; 5016 files and 254k blocks in 2s, 2042.5 files/s
[start] 2025/03/23 11:13:39 INFO: Migrated folder uk9gc-dkerd; 62701 files and 131k blocks in 5s, 10831.8 files/s
[start] 2025/03/23 11:13:50 INFO: Migrating folder w3ejt-fn4dm... (16000 files and 1334k blocks in 10s, 1547.9 files/s)
[start] 2025/03/23 11:14:00 INFO: Migrating folder w3ejt-fn4dm... (28000 files and 2254k blocks in 20s, 1361.7 files/s)
[start] 2025/03/23 11:14:10 INFO: Migrating folder w3ejt-fn4dm... (39000 files and 3161k blocks in 30s, 1264.3 files/s)
[start] 2025/03/23 11:14:21 INFO: Migrating folder w3ejt-fn4dm... (44000 files and 3872k blocks in 41s, 1062.0 files/s)
[start] 2025/03/23 11:14:31 INFO: Migrating folder w3ejt-fn4dm... (54000 files and 4581k blocks in 51s, 1048.3 files/s)
[start] 2025/03/23 11:14:42 INFO: Migrating folder w3ejt-fn4dm... (63000 files and 5327k blocks in 1m2s, 1009.4 files/s)
[start] 2025/03/23 11:14:53 INFO: Migrating folder w3ejt-fn4dm... (72000 files and 5971k blocks in 1m13s, 979.6 files/s)
[start] 2025/03/23 11:15:04 INFO: Migrating folder w3ejt-fn4dm... (79000 files and 6394k blocks in 1m24s, 931.4 files/s)
[start] 2025/03/23 11:15:15 INFO: Migrating folder w3ejt-fn4dm... (89000 files and 6908k blocks in 1m36s, 925.6 files/s)
[start] 2025/03/23 11:15:27 INFO: Migrating folder w3ejt-fn4dm... (95000 files and 7443k blocks in 1m47s, 881.5 files/s)
[start] 2025/03/23 11:15:38 INFO: Migrating folder w3ejt-fn4dm... (99000 files and 7821k blocks in 1m58s, 833.4 files/s)
[start] 2025/03/23 11:15:44 INFO: Migrated folder w3ejt-fn4dm; 101908 files and 8093k blocks in 2m4s, 816.0 files/s
[start] 2025/03/23 11:15:44 INFO: Migrating virtual mtimes...
[start] 2025/03/23 11:15:45 INFO: Migration complete, 188733 files and 11605k blocks in 2m28s
Sizes:
jb@jbo2:..thing/syncthing/test % du -sh h1/index-v*
1.2G h1/index-v0.14.0.db-migrated
2.5G h1/index-v2.db
(Test db with only local files, it’d grow when also adding peers that announce their stuff)
Currently no, as that is part of the database schemas run at open time. It’s totally possible to split, I’ll check it out. If the incoming data is bad that would presumably move the error to the end, but that seems acceptable…
Hmm at least some of them, some indexes are required for the insert or ignore stuff on blocks and blocklists etc which are the bulk.
If we weren’t constrained by RAM, we could do the whole migration to an in-memory SQLite DB. But the environments where we can do that aren’t the ones where we need the performance gain anyway.
I’ve migrated my personal setups to the SQLite build (.9). This mostly consists of MacOSs <> Debian (Container) (RPi5 host) as part of a backup solution.
There’s so far not much to tell other than; it works.
All devices migrated without issues.
Regular folders as well as Receive-Encrypted ones.
Speeds seem to be unaffected here, at least nothing noticeably changed.
I’ll keep an eye out for issues, but so far so good.
I’ve merged the current code and migrated three additional devices. Two are Android and they took very little time to move to the new database. I expected that, as they don’t really sync that many files.
However, I’ve also migrated another Windows device, and this one took 2 hours… The hardware is weak though (Intel Core M-5Y10c).
[start] 2025/03/23 15:34:08 INFO: syncthing v1.29.4-rc.1.dev.111.gdcac0e9a-tomasz86-v1.29.3-sqlite "Hafnium Hornet" (go1.24.1 windows-amd64) tomasz86@tomasz86 2025-03-23 14:05:45 UTC [noupgrade, stnoupgrade]
[start] 2025/03/23 15:34:13 INFO: Migrating old-style database to SQLite; this may take a while...
[start] 2025/03/23 15:34:13 INFO: Migrated folder 5eief-x9lna; 389 files and 0k blocks in 0s, 852.7 files/s
[start] 2025/03/23 15:34:17 INFO: Migrated folder 74ex6-feapt; 4532 files and 3k blocks in 4s, 1121.6 files/s
[start] 2025/03/23 15:34:29 INFO: Migrating folder 9pzqk-mllzf... (8000 files and 35k blocks in 11s, 675.1 files/s)
[start] 2025/03/23 15:34:39 INFO: Migrating folder 9pzqk-mllzf... (16000 files and 41k blocks in 21s, 731.5 files/s)
[start] 2025/03/23 15:34:39 INFO: Migrated folder 9pzqk-mllzf; 16252 files and 41k blocks in 21s, 739.3 files/s
[start] 2025/03/23 15:34:50 INFO: Migrating folder abwgi-qj5iw... (6000 files and 5k blocks in 10s, 588.0 files/s)
[start] 2025/03/23 15:35:00 INFO: Migrating folder abwgi-qj5iw... (11000 files and 15k blocks in 20s, 542.4 files/s)
[start] 2025/03/23 15:35:10 INFO: Migrating folder abwgi-qj5iw... (15000 files and 20k blocks in 30s, 490.5 files/s)
[start] 2025/03/23 15:35:20 INFO: Migrating folder abwgi-qj5iw... (17000 files and 24k blocks in 40s, 416.4 files/s)
[start] 2025/03/23 15:35:32 INFO: Migrating folder abwgi-qj5iw... (20000 files and 29k blocks in 52s, 379.1 files/s)
[start] 2025/03/23 15:35:44 INFO: Migrating folder abwgi-qj5iw... (26000 files and 36k blocks in 1m4s, 402.6 files/s)
[start] 2025/03/23 15:35:50 INFO: Migrated folder abwgi-qj5iw; 26261 files and 41k blocks in 1m10s, 371.3 files/s
[start] 2025/03/23 15:36:00 INFO: Migrating folder capi4-h3srq... (3000 files and 5k blocks in 10s, 294.0 files/s)
[start] 2025/03/23 15:36:11 INFO: Migrating folder capi4-h3srq... (5000 files and 13k blocks in 20s, 244.1 files/s)
[start] 2025/03/23 15:36:26 INFO: Migrating folder capi4-h3srq... (7000 files and 34k blocks in 36s, 192.2 files/s)
[start] 2025/03/23 15:36:38 INFO: Migrating folder capi4-h3srq... (8000 files and 96k blocks in 48s, 165.6 files/s)
[start] 2025/03/23 15:36:38 INFO: Migrated folder capi4-h3srq; 8057 files and 97k blocks in 48s, 166.7 files/s
[start] 2025/03/23 15:37:01 INFO: Migrating folder ddfwz-if24v... (1000 files and 128k blocks in 22s, 45.2 files/s)
[start] 2025/03/23 15:37:33 INFO: Migrating folder ddfwz-if24v... (5000 files and 365k blocks in 54s, 92.2 files/s)
[start] 2025/03/23 15:37:43 INFO: Migrating folder ddfwz-if24v... (8000 files and 365k blocks in 1m4s, 124.1 files/s)
[start] 2025/03/23 15:38:26 INFO: Migrating folder ddfwz-if24v... (11000 files and 414k blocks in 1m47s, 102.0 files/s)
[start] 2025/03/23 15:38:27 INFO: Migrated folder ddfwz-if24v; 11583 files and 422k blocks in 1m48s, 106.9 files/s
[start] 2025/03/23 15:38:59 INFO: Migrated folder djmvr-prmdj; 385 files and 2k blocks in 32s, 11.9 files/s
[start] 2025/03/23 15:39:25 INFO: Migrating folder flpvr-njdfi... (1000 files and 11k blocks in 26s, 38.5 files/s)
[start] 2025/03/23 15:40:23 INFO: Migrating folder flpvr-njdfi... (2000 files and 57k blocks in 1m23s, 24.0 files/s)
[start] 2025/03/23 15:40:35 INFO: Migrating folder flpvr-njdfi... (7000 files and 58k blocks in 1m35s, 73.3 files/s)
[start] 2025/03/23 15:40:45 INFO: Migrating folder flpvr-njdfi... (14000 files and 65k blocks in 1m45s, 132.3 files/s)
[start] 2025/03/23 15:40:56 INFO: Migrating folder flpvr-njdfi... (15000 files and 66k blocks in 1m57s, 127.9 files/s)
[start] 2025/03/23 15:41:19 INFO: Migrating folder flpvr-njdfi... (19000 files and 75k blocks in 2m19s, 135.9 files/s)
[start] 2025/03/23 15:42:37 INFO: Migrating folder flpvr-njdfi... (21000 files and 108k blocks in 3m37s, 96.5 files/s)
[start] 2025/03/23 15:43:10 INFO: Migrated folder flpvr-njdfi; 21090 files and 119k blocks in 4m10s, 84.2 files/s
[start] 2025/03/23 15:43:21 INFO: Migrating folder gjhfl-4nzzc... (1000 files and 0k blocks in 11s, 88.6 files/s)
[start] 2025/03/23 15:43:39 INFO: Migrating folder gjhfl-4nzzc... (4000 files and 3k blocks in 29s, 135.0 files/s)
[start] 2025/03/23 15:44:03 INFO: Migrating folder gjhfl-4nzzc... (7000 files and 7k blocks in 53s, 132.0 files/s)
[start] 2025/03/23 15:44:51 INFO: Migrated folder gjhfl-4nzzc; 7666 files and 32k blocks in 1m41s, 75.3 files/s
[start] 2025/03/23 15:45:08 INFO: Migrating folder hgedz-qtsau... (2000 files and 2k blocks in 16s, 124.5 files/s)
[start] 2025/03/23 15:45:15 INFO: Migrated folder hgedz-qtsau; 10017 files and 9k blocks in 23s, 423.2 files/s
[start] 2025/03/23 15:45:15 INFO: Migrated folder huxxk-ypuaf; 13 files and 0k blocks in 0s, 814.2 files/s
[start] 2025/03/23 15:45:55 INFO: Migrated folder j2kgm-h9kws; 340 files and 13k blocks in 40s, 8.5 files/s
[start] 2025/03/23 15:46:17 INFO: Migrating folder jvtg5-hymk6... (1000 files and 5k blocks in 21s, 47.1 files/s)
[start] 2025/03/23 15:46:54 INFO: Migrating folder jvtg5-hymk6... (4000 files and 16k blocks in 58s, 68.1 files/s)
[start] 2025/03/23 15:47:12 INFO: Migrating folder jvtg5-hymk6... (8000 files and 20k blocks in 1m16s, 104.3 files/s)
[start] 2025/03/23 15:47:28 INFO: Migrated folder jvtg5-hymk6; 8371 files and 20k blocks in 1m33s, 89.9 files/s
[start] 2025/03/23 15:48:00 INFO: Migrating folder llyqx-ugzel... (7000 files and 3k blocks in 31s, 221.3 files/s)
[start] 2025/03/23 15:48:28 INFO: Migrating folder llyqx-ugzel... (22000 files and 7k blocks in 1m0s, 366.3 files/s)
[start] 2025/03/23 15:48:46 INFO: Migrating folder llyqx-ugzel... (24000 files and 9k blocks in 1m17s, 308.6 files/s)
[start] 2025/03/23 15:49:00 INFO: Migrating folder llyqx-ugzel... (26000 files and 11k blocks in 1m31s, 284.5 files/s)
[start] 2025/03/23 15:49:16 INFO: Migrating folder llyqx-ugzel... (27000 files and 12k blocks in 1m47s, 250.2 files/s)
[start] 2025/03/23 15:49:41 INFO: Migrating folder llyqx-ugzel... (31000 files and 16k blocks in 2m12s, 233.2 files/s)
[start] 2025/03/23 15:50:02 INFO: Migrating folder llyqx-ugzel... (34000 files and 19k blocks in 2m33s, 221.3 files/s)
[start] 2025/03/23 15:50:19 INFO: Migrating folder llyqx-ugzel... (36000 files and 21k blocks in 2m50s, 210.8 files/s)
[start] 2025/03/23 15:50:29 INFO: Migrating folder llyqx-ugzel... (37000 files and 22k blocks in 3m1s, 204.4 files/s)
[start] 2025/03/23 15:50:47 INFO: Migrating folder llyqx-ugzel... (39000 files and 24k blocks in 3m18s, 196.6 files/s)
[start] 2025/03/23 15:51:09 INFO: Migrating folder llyqx-ugzel... (42000 files and 27k blocks in 3m40s, 190.6 files/s)
[start] 2025/03/23 15:51:34 INFO: Migrating folder llyqx-ugzel... (44000 files and 29k blocks in 4m5s, 179.3 files/s)
[start] 2025/03/23 15:51:48 INFO: Migrating folder llyqx-ugzel... (46000 files and 31k blocks in 4m20s, 176.9 files/s)
[start] 2025/03/23 15:52:06 INFO: Migrating folder llyqx-ugzel... (48000 files and 33k blocks in 4m37s, 172.9 files/s)
[start] 2025/03/23 15:52:30 INFO: Migrating folder llyqx-ugzel... (51000 files and 36k blocks in 5m1s, 169.0 files/s)
[start] 2025/03/23 15:52:47 INFO: Migrating folder llyqx-ugzel... (53000 files and 38k blocks in 5m18s, 166.4 files/s)
[start] 2025/03/23 15:53:22 INFO: Migrating folder llyqx-ugzel... (58000 files and 43k blocks in 5m53s, 163.9 files/s)
[start] 2025/03/23 15:53:46 INFO: Migrating folder llyqx-ugzel... (61000 files and 46k blocks in 6m17s, 161.8 files/s)
[start] 2025/03/23 15:54:03 INFO: Migrating folder llyqx-ugzel... (64000 files and 49k blocks in 6m34s, 162.3 files/s)
[start] 2025/03/23 15:54:17 INFO: Migrating folder llyqx-ugzel... (66000 files and 51k blocks in 6m48s, 161.5 files/s)
[start] 2025/03/23 15:54:33 INFO: Migrating folder llyqx-ugzel... (68000 files and 53k blocks in 7m4s, 160.1 files/s)
[start] 2025/03/23 15:54:59 INFO: Migrating folder llyqx-ugzel... (70000 files and 55k blocks in 7m30s, 155.3 files/s)
[start] 2025/03/23 15:55:39 INFO: Migrating folder llyqx-ugzel... (74000 files and 59k blocks in 8m10s, 151.0 files/s)
[start] 2025/03/23 15:56:28 INFO: Migrating folder llyqx-ugzel... (81000 files and 66k blocks in 8m59s, 150.0 files/s)
[start] 2025/03/23 15:56:47 INFO: Migrating folder llyqx-ugzel... (83000 files and 68k blocks in 9m18s, 148.6 files/s)
[start] 2025/03/23 15:57:44 INFO: Migrating folder llyqx-ugzel... (84000 files and 76k blocks in 10m15s, 136.5 files/s)
[start] 2025/03/23 15:58:24 INFO: Migrating folder llyqx-ugzel... (85000 files and 95k blocks in 10m55s, 129.7 files/s)
[start] 2025/03/23 15:59:03 INFO: Migrating folder llyqx-ugzel... (96000 files and 102k blocks in 11m34s, 138.2 files/s)
[start] 2025/03/23 15:59:23 INFO: Migrating folder llyqx-ugzel... (98000 files and 104k blocks in 11m54s, 137.2 files/s)
[start] 2025/03/23 15:59:43 INFO: Migrating folder llyqx-ugzel... (100000 files and 106k blocks in 12m14s, 136.2 files/s)
[start] 2025/03/23 16:00:19 INFO: Migrating folder llyqx-ugzel... (106000 files and 112k blocks in 12m50s, 137.5 files/s)
[start] 2025/03/23 16:00:43 INFO: Migrating folder llyqx-ugzel... (108000 files and 114k blocks in 13m14s, 135.9 files/s)
[start] 2025/03/23 16:00:57 INFO: Migrating folder llyqx-ugzel... (109000 files and 115k blocks in 13m28s, 134.8 files/s)
[start] 2025/03/23 16:01:37 INFO: Migrating folder llyqx-ugzel... (112000 files and 119k blocks in 14m8s, 132.1 files/s)
[start] 2025/03/23 16:01:50 INFO: Migrating folder llyqx-ugzel... (114000 files and 121k blocks in 14m21s, 132.3 files/s)
[start] 2025/03/23 16:02:15 INFO: Migrating folder llyqx-ugzel... (116000 files and 123k blocks in 14m46s, 130.9 files/s)
[start] 2025/03/23 16:02:40 INFO: Migrating folder llyqx-ugzel... (118000 files and 125k blocks in 15m11s, 129.5 files/s)
[start] 2025/03/23 16:03:05 INFO: Migrated folder llyqx-ugzel; 118593 files and 127k blocks in 15m36s, 126.7 files/s
[start] 2025/03/23 16:03:25 INFO: Migrating folder m65ep-rgntd... (3000 files and 4k blocks in 20s, 145.7 files/s)
[start] 2025/03/23 16:03:52 INFO: Migrating folder m65ep-rgntd... (6000 files and 7k blocks in 47s, 127.5 files/s)
[start] 2025/03/23 16:04:10 INFO: Migrating folder m65ep-rgntd... (8000 files and 9k blocks in 1m5s, 121.8 files/s)
[start] 2025/03/23 16:04:36 INFO: Migrating folder m65ep-rgntd... (12000 files and 13k blocks in 1m31s, 130.8 files/s)
[start] 2025/03/23 16:04:56 INFO: Migrating folder m65ep-rgntd... (14000 files and 15k blocks in 1m51s, 125.8 files/s)
[start] 2025/03/23 16:05:35 INFO: Migrating folder m65ep-rgntd... (19000 files and 20k blocks in 2m30s, 126.7 files/s)
[start] 2025/03/23 16:06:00 INFO: Migrating folder m65ep-rgntd... (21000 files and 22k blocks in 2m55s, 119.8 files/s)
[start] 2025/03/23 16:06:21 INFO: Migrating folder m65ep-rgntd... (24000 files and 25k blocks in 3m15s, 122.5 files/s)
[start] 2025/03/23 16:06:31 INFO: Migrating folder m65ep-rgntd... (25000 files and 26k blocks in 3m26s, 121.1 files/s)
[start] 2025/03/23 16:06:46 INFO: Migrating folder m65ep-rgntd... (26000 files and 27k blocks in 3m41s, 117.6 files/s)
[start] 2025/03/23 16:07:29 INFO: Migrating folder m65ep-rgntd... (28000 files and 34k blocks in 4m24s, 105.9 files/s)
[start] 2025/03/23 16:08:40 INFO: Migrating folder m65ep-rgntd... (29000 files and 57k blocks in 5m35s, 86.4 files/s)
[start] 2025/03/23 16:08:55 INFO: Migrating folder m65ep-rgntd... (30000 files and 58k blocks in 5m49s, 85.7 files/s)
[start] 2025/03/23 16:09:35 INFO: Migrating folder m65ep-rgntd... (34000 files and 62k blocks in 6m30s, 87.1 files/s)
[start] 2025/03/23 16:10:24 INFO: Migrating folder m65ep-rgntd... (35000 files and 79k blocks in 7m19s, 79.7 files/s)
[start] 2025/03/23 16:11:29 INFO: Migrating folder m65ep-rgntd... (36000 files and 87k blocks in 8m24s, 71.3 files/s)
[start] 2025/03/23 16:12:10 INFO: Migrating folder m65ep-rgntd... (37000 files and 97k blocks in 9m5s, 67.8 files/s)
[start] 2025/03/23 16:15:34 INFO: Migrated folder m65ep-rgntd; 37810 files and 184k blocks in 12m29s, 50.4 files/s
[start] 2025/03/23 16:15:38 INFO: Migrated folder mfk32-snfdv; 249 files and 4k blocks in 3s, 65.6 files/s
[start] 2025/03/23 16:15:38 INFO: Migrated folder mgieg-z3mzc; 149 files and 0k blocks in 0s, 984.5 files/s
[start] 2025/03/23 16:16:07 INFO: Migrating folder mheku-2gahx... (6000 files and 0k blocks in 28s, 211.9 files/s)
[start] 2025/03/23 16:16:17 INFO: Migrating folder mheku-2gahx... (31000 files and 0k blocks in 38s, 808.8 files/s)
[start] 2025/03/23 16:17:01 INFO: Migrating folder mheku-2gahx... (37000 files and 8k blocks in 1m23s, 444.9 files/s)
[start] 2025/03/23 16:17:16 INFO: Migrating folder mheku-2gahx... (38000 files and 10k blocks in 1m38s, 387.1 files/s)
[start] 2025/03/23 16:17:34 INFO: Migrating folder mheku-2gahx... (39000 files and 12k blocks in 1m56s, 336.1 files/s)
[start] 2025/03/23 16:17:55 INFO: Migrating folder mheku-2gahx... (40000 files and 13k blocks in 2m16s, 292.4 files/s)
[start] 2025/03/23 16:18:31 INFO: Migrating folder mheku-2gahx... (43000 files and 17k blocks in 2m52s, 249.5 files/s)
[start] 2025/03/23 16:19:23 INFO: Migrating folder mheku-2gahx... (45000 files and 28k blocks in 3m44s, 200.6 files/s)
[start] 2025/03/23 16:19:37 INFO: Migrating folder mheku-2gahx... (46000 files and 30k blocks in 3m59s, 192.3 files/s)
[start] 2025/03/23 16:20:16 INFO: Migrating folder mheku-2gahx... (48000 files and 33k blocks in 4m37s, 172.9 files/s)
[start] 2025/03/23 16:20:42 INFO: Migrating folder mheku-2gahx... (51000 files and 37k blocks in 5m3s, 168.0 files/s)
[start] 2025/03/23 16:21:21 INFO: Migrating folder mheku-2gahx... (54000 files and 42k blocks in 5m42s, 157.7 files/s)
[start] 2025/03/23 16:21:36 INFO: Migrating folder mheku-2gahx... (58000 files and 42k blocks in 5m57s, 162.3 files/s)
[start] 2025/03/23 16:21:46 INFO: Migrating folder mheku-2gahx... (83000 files and 42k blocks in 6m7s, 225.8 files/s)
[start] 2025/03/23 16:21:56 INFO: Migrating folder mheku-2gahx... (107000 files and 42k blocks in 6m17s, 283.1 files/s)
[start] 2025/03/23 16:22:07 INFO: Migrating folder mheku-2gahx... (126000 files and 42k blocks in 6m28s, 324.3 files/s)
[start] 2025/03/23 16:22:18 INFO: Migrating folder mheku-2gahx... (144000 files and 42k blocks in 6m39s, 360.2 files/s)
[start] 2025/03/23 16:22:28 INFO: Migrating folder mheku-2gahx... (152000 files and 42k blocks in 6m50s, 370.5 files/s)
[start] 2025/03/23 16:22:39 INFO: Migrating folder mheku-2gahx... (160000 files and 42k blocks in 7m0s, 380.1 files/s)
[start] 2025/03/23 16:22:49 INFO: Migrating folder mheku-2gahx... (167000 files and 42k blocks in 7m11s, 387.4 files/s)
[start] 2025/03/23 16:23:00 INFO: Migrating folder mheku-2gahx... (175000 files and 42k blocks in 7m21s, 396.0 files/s)
[start] 2025/03/23 16:23:11 INFO: Migrating folder mheku-2gahx... (186000 files and 42k blocks in 7m32s, 410.7 files/s)
[start] 2025/03/23 16:23:31 INFO: Migrating folder mheku-2gahx... (192000 files and 46k blocks in 7m52s, 406.4 files/s)
[start] 2025/03/23 16:24:05 INFO: Migrating folder mheku-2gahx... (193000 files and 52k blocks in 8m27s, 380.5 files/s)
[start] 2025/03/23 16:24:05 INFO: Migrated folder mheku-2gahx; 193067 files and 52k blocks in 8m27s, 380.6 files/s
[start] 2025/03/23 16:25:47 INFO: Migrating folder o2gvm-qojrk... (2000 files and 30k blocks in 1m41s, 19.7 files/s)
[start] 2025/03/23 16:26:37 INFO: Migrating folder o2gvm-qojrk... (3000 files and 39k blocks in 2m31s, 19.8 files/s)
[start] 2025/03/23 16:27:16 INFO: Migrating folder o2gvm-qojrk... (5000 files and 49k blocks in 3m10s, 26.3 files/s)
[start] 2025/03/23 16:27:57 INFO: Migrating folder o2gvm-qojrk... (6000 files and 55k blocks in 3m51s, 25.9 files/s)
[start] 2025/03/23 16:27:57 INFO: Migrated folder o2gvm-qojrk; 6288 files and 57k blocks in 3m51s, 27.1 files/s
[start] 2025/03/23 16:28:19 INFO: Migrated folder o6kpx-zrftj; 389 files and 0k blocks in 21s, 17.8 files/s
[start] 2025/03/23 16:28:36 INFO: Migrating folder ofxx9-nqyuz... (3000 files and 4k blocks in 17s, 173.7 files/s)
[start] 2025/03/23 16:32:00 INFO: Migrating folder ofxx9-nqyuz... (4000 files and 72k blocks in 3m40s, 18.1 files/s)
[start] 2025/03/23 16:38:13 INFO: Migrating folder ofxx9-nqyuz... (5000 files and 203k blocks in 9m53s, 8.4 files/s)
[start] 2025/03/23 16:38:55 INFO: Migrating folder ofxx9-nqyuz... (6000 files and 207k blocks in 10m35s, 9.4 files/s)
[start] 2025/03/23 16:39:10 INFO: Migrating folder ofxx9-nqyuz... (8000 files and 207k blocks in 10m50s, 12.3 files/s)
[start] 2025/03/23 16:40:03 INFO: Migrating folder ofxx9-nqyuz... (16000 files and 217k blocks in 11m43s, 22.7 files/s)
[start] 2025/03/23 16:40:15 INFO: Migrating folder ofxx9-nqyuz... (23000 files and 218k blocks in 11m55s, 32.1 files/s)
[start] 2025/03/23 16:40:55 INFO: Migrated folder ofxx9-nqyuz; 24984 files and 236k blocks in 12m35s, 33.1 files/s
[start] 2025/03/23 16:41:17 INFO: Migrated folder p4qoa-r9bwd; 66 files and 0k blocks in 22s, 3.0 files/s
[start] 2025/03/23 16:42:07 INFO: Migrating folder qojqz-thphx... (1000 files and 11k blocks in 50s, 19.9 files/s)
[start] 2025/03/23 16:43:05 INFO: Migrating folder qojqz-thphx... (2000 files and 18k blocks in 1m48s, 18.5 files/s)
[start] 2025/03/23 16:43:52 INFO: Migrating folder qojqz-thphx... (4000 files and 27k blocks in 2m35s, 25.7 files/s)
[start] 2025/03/23 16:44:03 INFO: Migrating folder qojqz-thphx... (5000 files and 29k blocks in 2m46s, 30.1 files/s)
[start] 2025/03/23 16:44:28 INFO: Migrating folder qojqz-thphx... (6000 files and 32k blocks in 3m10s, 31.4 files/s)
[start] 2025/03/23 16:45:32 INFO: Migrating folder qojqz-thphx... (7000 files and 51k blocks in 4m15s, 27.4 files/s)
[start] 2025/03/23 16:45:59 INFO: Migrating folder qojqz-thphx... (24000 files and 51k blocks in 4m42s, 85.0 files/s)
[start] 2025/03/23 16:46:08 INFO: Migrated folder qojqz-thphx; 42803 files and 51k blocks in 4m51s, 146.8 files/s
[start] 2025/03/23 16:47:38 INFO: Migrating folder tcato-lqtcw... (2000 files and 22k blocks in 1m29s, 22.4 files/s)
[start] 2025/03/23 16:48:17 INFO: Migrating folder tcato-lqtcw... (7000 files and 27k blocks in 2m8s, 54.3 files/s)
[start] 2025/03/23 16:52:45 INFO: Migrating folder tcato-lqtcw... (8000 files and 103k blocks in 6m36s, 20.2 files/s)
[start] 2025/03/23 16:53:11 INFO: Migrating folder tcato-lqtcw... (9000 files and 104k blocks in 7m2s, 21.3 files/s)
[start] 2025/03/23 16:54:16 INFO: Migrating folder tcato-lqtcw... (10000 files and 117k blocks in 8m7s, 20.5 files/s)
[start] 2025/03/23 16:54:38 INFO: Migrated folder tcato-lqtcw; 11033 files and 120k blocks in 8m29s, 21.6 files/s
[start] 2025/03/23 16:55:24 INFO: Migrating folder ut4ck-ffdny... (1000 files and 4k blocks in 45s, 21.8 files/s)
[start] 2025/03/23 16:55:38 INFO: Migrating folder ut4ck-ffdny... (3000 files and 15k blocks in 1m0s, 49.9 files/s)
[start] 2025/03/23 16:55:51 INFO: Migrating folder ut4ck-ffdny... (6000 files and 29k blocks in 1m12s, 82.2 files/s)
[start] 2025/03/23 16:56:12 INFO: Migrating folder ut4ck-ffdny... (12000 files and 34k blocks in 1m33s, 127.7 files/s)
[start] 2025/03/23 16:56:34 INFO: Migrating folder ut4ck-ffdny... (22000 files and 35k blocks in 1m55s, 189.9 files/s)
[start] 2025/03/23 16:56:49 INFO: Migrating folder ut4ck-ffdny... (26000 files and 36k blocks in 2m10s, 199.0 files/s)
[start] 2025/03/23 16:56:59 INFO: Migrated folder ut4ck-ffdny; 33947 files and 38k blocks in 2m20s, 241.1 files/s
[start] 2025/03/23 16:56:59 INFO: Migrated folder w9h6p-vpccd; 99 files and 0k blocks in 0s, 2051.5 files/s
[start] 2025/03/23 16:58:14 INFO: Migrating folder wqpwv-jpr97... (1000 files and 20k blocks in 1m15s, 13.3 files/s)
[start] 2025/03/23 16:59:44 INFO: Migrated folder wqpwv-jpr97; 1144 files and 32k blocks in 2m45s, 6.9 files/s
[start] 2025/03/23 16:59:54 INFO: Migrating folder xmptn-sxvx5... (2000 files and 1k blocks in 10s, 195.6 files/s)
[start] 2025/03/23 17:00:20 INFO: Migrating folder xmptn-sxvx5... (4000 files and 9k blocks in 36s, 110.5 files/s)
[start] 2025/03/23 17:01:04 INFO: Migrating folder xmptn-sxvx5... (5000 files and 15k blocks in 1m20s, 62.4 files/s)
[start] 2025/03/23 17:02:00 INFO: Migrating folder xmptn-sxvx5... (6000 files and 25k blocks in 2m16s, 44.0 files/s)
[start] 2025/03/23 17:08:17 INFO: Migrating folder xmptn-sxvx5... (7000 files and 118k blocks in 8m32s, 13.7 files/s)
[start] 2025/03/23 17:11:28 INFO: Migrating folder xmptn-sxvx5... (8000 files and 175k blocks in 11m44s, 11.4 files/s)
[start] 2025/03/23 17:12:00 INFO: Migrated folder xmptn-sxvx5; 8818 files and 176k blocks in 12m15s, 12.0 files/s
[start] 2025/03/23 17:12:18 INFO: Migrating folder ynb9x-ccysv... (3000 files and 2k blocks in 17s, 166.8 files/s)
[start] 2025/03/23 17:12:51 INFO: Migrating folder ynb9x-ccysv... (6000 files and 6k blocks in 51s, 117.1 files/s)
[start] 2025/03/23 17:13:04 INFO: Migrating folder ynb9x-ccysv... (12000 files and 9k blocks in 1m4s, 186.3 files/s)
[start] 2025/03/23 17:13:28 INFO: Migrating folder ynb9x-ccysv... (14000 files and 11k blocks in 1m27s, 159.3 files/s)
[start] 2025/03/23 17:13:39 INFO: Migrating folder ynb9x-ccysv... (15000 files and 12k blocks in 1m38s, 152.0 files/s)
[start] 2025/03/23 17:13:53 INFO: Migrating folder ynb9x-ccysv... (16000 files and 13k blocks in 1m53s, 141.3 files/s)
[start] 2025/03/23 17:14:32 INFO: Migrating folder ynb9x-ccysv... (19000 files and 16k blocks in 2m32s, 125.0 files/s)
[start] 2025/03/23 17:14:49 INFO: Migrating folder ynb9x-ccysv... (21000 files and 18k blocks in 2m49s, 124.0 files/s)
[start] 2025/03/23 17:15:14 INFO: Migrating folder ynb9x-ccysv... (23000 files and 20k blocks in 3m14s, 118.5 files/s)
[start] 2025/03/23 17:15:56 INFO: Migrating folder ynb9x-ccysv... (26000 files and 23k blocks in 3m56s, 110.0 files/s)
[start] 2025/03/23 17:16:16 INFO: Migrating folder ynb9x-ccysv... (29000 files and 26k blocks in 4m16s, 113.1 files/s)
[start] 2025/03/23 17:16:30 INFO: Migrating folder ynb9x-ccysv... (30000 files and 27k blocks in 4m30s, 111.1 files/s)
[start] 2025/03/23 17:16:44 INFO: Migrating folder ynb9x-ccysv... (31000 files and 28k blocks in 4m43s, 109.2 files/s)
[start] 2025/03/23 17:16:57 INFO: Migrating folder ynb9x-ccysv... (32000 files and 29k blocks in 4m56s, 107.9 files/s)
[start] 2025/03/23 17:17:34 INFO: Migrating folder ynb9x-ccysv... (35000 files and 32k blocks in 5m33s, 104.8 files/s)
[start] 2025/03/23 17:18:25 INFO: Migrating folder ynb9x-ccysv... (39000 files and 36k blocks in 6m24s, 101.4 files/s)
[start] 2025/03/23 17:19:03 INFO: Migrating folder ynb9x-ccysv... (43000 files and 40k blocks in 7m3s, 101.6 files/s)
[start] 2025/03/23 17:19:14 INFO: Migrating folder ynb9x-ccysv... (44000 files and 41k blocks in 7m13s, 101.5 files/s)
[start] 2025/03/23 17:19:52 INFO: Migrating folder ynb9x-ccysv... (48000 files and 45k blocks in 7m52s, 101.6 files/s)
[start] 2025/03/23 17:20:31 INFO: Migrating folder ynb9x-ccysv... (51000 files and 48k blocks in 8m31s, 99.7 files/s)
[start] 2025/03/23 17:21:00 INFO: Migrating folder ynb9x-ccysv... (54000 files and 51k blocks in 8m59s, 100.0 files/s)
[start] 2025/03/23 17:21:13 INFO: Migrating folder ynb9x-ccysv... (55000 files and 52k blocks in 9m12s, 99.5 files/s)
[start] 2025/03/23 17:21:55 INFO: Migrating folder ynb9x-ccysv... (58000 files and 55k blocks in 9m55s, 97.4 files/s)
[start] 2025/03/23 17:22:15 INFO: Migrating folder ynb9x-ccysv... (60000 files and 57k blocks in 10m15s, 97.6 files/s)
[start] 2025/03/23 17:22:42 INFO: Migrating folder ynb9x-ccysv... (62000 files and 59k blocks in 10m41s, 96.6 files/s)
[start] 2025/03/23 17:23:23 INFO: Migrating folder ynb9x-ccysv... (65000 files and 65k blocks in 11m23s, 95.2 files/s)
[start] 2025/03/23 17:26:03 INFO: Migrating folder ynb9x-ccysv... (67000 files and 102k blocks in 14m2s, 79.5 files/s)
[start] 2025/03/23 17:32:53 INFO: Migrating folder ynb9x-ccysv... (68000 files and 207k blocks in 20m53s, 54.3 files/s)
[start] 2025/03/23 17:32:54 INFO: Migrated folder ynb9x-ccysv; 69760 files and 208k blocks in 20m53s, 55.6 files/s
[start] 2025/03/23 17:33:33 INFO: Migrating folder zu2la-qszfr... (2000 files and 5k blocks in 38s, 51.4 files/s)
[start] 2025/03/23 17:33:44 INFO: Migrating folder zu2la-qszfr... (6000 files and 8k blocks in 50s, 119.3 files/s)
[start] 2025/03/23 17:33:44 INFO: Migrated folder zu2la-qszfr; 6626 files and 10k blocks in 50s, 130.8 files/s
[start] 2025/03/23 17:33:44 INFO: Migrating virtual mtimes...
[start] 2025/03/23 17:34:04 INFO: Migration complete, 670781 files and 2106k blocks in 1h59m50s
).