I've gone back to the IBM CGA for this machine. It's been an interesting experience finding out what makes sense and what doesn't for an original XT. While a lot of upgrades are possible, they don't necessarily make sense. Here's my conclusions:
- EGA card: works fine and CGA compatibility is good if you pick the right card. However, most/all EGA games run too slowly. The best thing about it in an XT is that you don't get snow. However, you lose one really unique feature of the original IBM CGA - composite output. This is a big minus in my book, so I'm sticking with the CGA.
- EMS card: Cool, but it's kind of pointless. The driver uses up valuable conventional memory. If you need EMS you also need a faster machine, at least a 286. I'm moving mine to another machine.
- V20: No real downsides bar a handful of games won't work. Really cheap speed boost and takes a lot of games from being slightly sluggish to playable.
- 8087: No downsides, get one cheap on eBay.
- SB16: No downsides and you get a joystick port and volume control for PC speaker! There may be one or two games that can use Adlib.
- XT-IDE: Works great, no downsides
- Gotek: Works great, no downsides
- High density floppy controller: Well.... I was never 100% happy with mine. Maybe the controller was bad, but I got some intermittent problems. So, I've gone back to the IBM controller. With the Gotek there's no issues with finding DD disks.
Basically, the same conclusions Great Hierophant comes to in his blog.