I have thought about that. For this same reason I did not remap a lot of keys in nvim, because I still want to be able to use vim wherever I work if that is the only option.
However, I think that creating a simple git repository with rc files and configuration can be used to create a uniform experience across machines.
The git repo idea is fine for some machines, but when I log into a random customers server at 4:00AM to fix some issue that paged me, I'm not spending time cloning a repo to setup neither vim nor tmux, it just has to work.
Also the machine may not actually able to reach out onto the wider internet.
I think it depends on the use case. If I had to do what you do with random machines, I would probably need to be familiar with default tool setups as well
However, I think that creating a simple git repository with rc files and configuration can be used to create a uniform experience across machines.