How do you remap keys in :history or :highlight?

Question

I use Colemak hnei for nav in normal mode, but my keys default to hjkl when when I'm viewing :history and :highlight. How do I remap these keys?

My guess is that the program may be switching to more. If so, how can I make vim choose less?

EDIT

As per D. Ben Knoble, this quesion looks pertinent.