With Windows 3.11? There's no easy way. You'll probably want to remove any references to the driver's files in WIN.INI and SYSTEM.INI, as well as the driver's various files. This might take some trial and error.
The easiest way to be sure would be to start over with a fresh copy of Windows 3.11 (in DOSBox, perhaps), track the changes the installer makes, and then reverse the changes in your normal copy of Windows 3.11. There are a lot of Win 3.11 utilities that will track such changes. PC Magazine's InCtrl4 is pretty nice, if you can find it.
A better solution in the meantime would be to find the exact version of Quicktime the game requires (these games can be very, very picky) and install that instead. Hopefully it will overwrite whatever is causing the problem.