Swapping drivers between SCI games is really hit or miss. Usually the games will lock up on start or will give memory errors. In the case of MIDI drivers, you may encounter incompatibilities with the embedded patch resource. The game may quit complaining of the missing patch file or may give the wrong instruments/sounds.
Some may seem to work, but can have problems during game play. For example, to over come the initialization speed bug error by replacing the Sierra SB driver in QfG1VGA with certain later versions can cause endless looping of some the digital sound effects. This does not mean that it can never be done, but unless a driver is specified for any given game, don't count on it. If you want to try, you are more likely to have success if you swap between games of the same year and or interpreter versions.
There are after market driver updates released by Sierra for specific games and there are patcher utilities for some problems, like the initialization error (GOSiERRA and SBSIERRA, not to mention the MIDI port changer). There are also some fan made drivers from Ravi and a Sierra GM driver appended with the SB part from the Sierra MTBLAST.DRV. Note the add in GM drivers usually come with a patch file to map the instruments for the intended game. I have all of these drivers and utilities on my site.
One last note, if you try to use the install program to configure a game with a driver that did not ship with the game, it may error out and quit. You will need to edit the INSTALL.HLP file to add the proper entry for the unlisted driver or you will need to manually edit the RESOURCE.CFG.