On Windows, Vim does
source $VIMRUNTIME\mswin.vim in its system-wide config and remaps many keys.
I'd like to have default Vim key bindings but I don't want to touch system-wide config. How do I do it in proper way?
The top of the file checks the variable
g:skip_loading_mswin which you can set to prevent it from running. Put this in your vimrc:
let g:skip_loading_mswin = 1