There are a few issues here.
The first is that USB keyboards in general were kind of flaky in the early days of USB even at the time. That definitely has not improved when trying to hook up a *modern* USB keyboard to an older system with USB. I have an Abit KT7A motherboard in my retro system that has USB 1.1 ports. I always had issues with USB keyboards back when this board was new and stuck with PS2 (a Model M) up until I stopped using it as my daily PC. Now that I've turned it into a retro gaming PC, I picked up a used Corsair K70 in silver aluminum to match my case aesthetics and it's got the same type of issues I remember, plus more.
The biggest issue is that there seems to be some limitation in the USB 1.1 spec (I don't know if it's power or speed) that forces the keyboard to revert to "BIOS" mode when in Windows. (Note that this is different from the BIOS mode *in the BIOS*; it's the keyboard's own BIOS mode.) I've checked the drivers and they're working fine. The keyboard itself works, but in BIOS mode it's at its lowest polling rate and does not support ten-key rollover. Now, may not be that big of a problem for most people but I know the limitation is there and it might matter in some games (I haven't installed too many yet). But it also means the damn scroll lock LED blinks at me constantly.
Doesn't happen in DOS. Not sure why. Just Windows.
Also, USB keyboards in general will kind of turn on and off throughout the bootup process. This is something I remember with older USB keyboards too. On some older systems, they wouldn't turn on at all until your OS loaded a driver for them. My motherboard luckily has a setting where I can select between BIOS/OS for USB keyboard detection. That means I can use the keyboard in the BIOS and in DOS, but I can't use it on my bootloader screen - it's off at that point.
PS2 keyboards don't have these issues. I remember that for a long time, USB keyboards were kind of considered persona non-grata for real hardcore users; it took a while before the keyboards, USB itself and motherboards were all designed in such a way that you could rely on a USB keyboard actually being fully functional all the time.
So honestly, unless you just want a particular aesthetic like I did and are prepared to live with some flakiness/less than perfect functionality, I would just get a PS2 keyboard. That's probably going to limit you to Unicomp or something used, or potentially new old stock. I bought my Lexmark Model M NOS back in the day, and I bought a Compaq rubber dome silver plastic PS2 keyboard a while back for this same computer that was also NOS. Honestly, I may just go back to that, although I still have a hard time dealing with the feel of rubber domes. (But hey, it is period accurate!) But the point is, you can still find stuff NOS if you look. Keyboards were real commodities for a while.