How to control vim mode outside of normal editor contexts

[diminutivesloop]

I use the Codeium and GitHub PR extensions. Whenever I edit or add a PR file comment or invoke the Codeium command mode I get vim mode rather than VSCode's default text input mode. I seem to remember there being a setting to control this but I can't find it documented anywhere. Ideally I would like the option to disable this feature in particular contexts or at least set it to default to vim input mode. Is there an option here that I'm missing?

Update:
I also noticed that if I enable vim.smartRelativeLine I start seeing line numbers in these comment/command inputs which isn't great either.

[17hz]

I'm also facing a similar issue and would be grateful for any insights or solutions. It seems that GitHub Copilot doesn't have this problem.