Stuff will still go out of sync and show large sizes of out of sync, regardless it will be renamed or not. The only way to know what exactly is happening is to enable debug logging.
If inotify is enabled, a few files a minute should be ok as it delays deletes compared to new files appearing.
If its on and you still have seen issues, it might be too much changes in a single scan period as the messages indicating change are capped in size, which the splits additional and removal of file over separate messages in which case the optimisation does not work.
It’s much worse when you rename directories, as then things are definately split over multiple messages.
If you don’t use inotify, then the bets are somewhat off for large files due to the message splitting business I’ve explained above.
As usual, the answer is not binary, but I suspect if you rename a single file, it should work as expected.