I don’t think it is correctly to say “starts to slow down”. I think there are some constant “CPU-expenses” per-file, and they are just become observable on large set of tiny files.
There is a relevant topic: Increase the transfer speed for small files