For user storage, Android – with some exceptions – for various reasons uses a FAT-based filesystem. It’s also a commonly used filesystem on smaller capacity USB flash drives/sticks, especially when there’s a need for portability between Windows, macOS, Linux, etc.
FAT reserves a set of special characters/symbols for internal use, so they cannot be used in file and folder names: " * / : < > ? \ |
Unfortunately no, there’s no getting around the FAT (includes exFAT) and NTFS limitations. They were designed for compatibility with Windows, where the 9 characters have special meaning – e.g. when a file in a FAT filesystem is deleted, the first character of the filename is replaced with a ? to mark the file available for being overwritten with new data.
If you’re open to replacing the OEM Android and your phone is supported by LineageOS, GrapheneOS, or one of the other AOSP-based variants of Android, there are better filesystem choices, but even that isn’t without its caveats.