The MIDI port and the game port are two sepparate devices.
It's just that the Sound Blaster card used some unused pins of the DB-15 connector that was used by the IBM Game Control Adapter card.
And since Sound Blaster became so popular, almost all sound card makers continued to support this choice.
A normal game card has no MIDI pins, thus can't work with any of the usual MIDI devices.
https://mysite.du.edu/~etuttle/electron/elect57.htm

Edit: In other words, the gameport on a sound card can communicate with MIDI and a joystick the same time.
It just needs a splitter cable (MIDI/Joystick), in a similar fashion as it is required for a two player scenario (two joysticks on one DB-15).
Speaking under correction, I believe the easist would be to make your own 1:1 extender cable, with three wires (MIDI RX, MIDI TX, GND)
going to a separate connector (DIN directly or DB15) for MIDI.

Edit: You can also disable the game port on sound cards, independendly of the MIDI port (MPU-401).
Doing so would cause no conflict with a dedicated game card.

Ok so i my case i have a turtle beach card with vortex ii. So the connection would be wavetable header. So gameport would not be affected?

Oh, you're using an internal MIDI device ? In that case, you can just simply attach a joystick to the game port of the same card no problem.
The wave blaster header is not connected to the game portion of the external DB15 port (namely the X/Y axises, buttons 1-4).

Rather, the waveblaster header is wired in parallel to the same MPU-401 logic as the MIDI portion of the game port does.
It just is using a different signal on the electirical level (it uses 5v TTL instead of a current loop).

In practice, some people even use both the same time. Internal waveblaster card and external MIDI module.
Haven't done that myself yet, so I'm speaking under correction again. 😅

Ok sounds good. I was under the impression that is ran off the 12v and that having both running 12v was too much so it wouldn't work. Thankyou.