If you are handy with a soldering iron you can desolder the battery from the motherboard. I recently had a 486 board with the same type of battery and had to remove it:


You can buy the same type of batteries and solder a new one in, alternatively you can just buy a AAA/AA style battery holder and make one up yourself to plug in. Alternatively you can buy a premade battery like this one:
http://jaycar.com.au/productView.asp?ID=SB241 … ry&form=KEYWORD
This is what I ended up using for the above board. They are sealed to help prevent leaks. Be aware that if you use standard AA/AAA batteries in a holder, that these batteries can leak and the acid will destroy components. (I lost a soundcard this way back in the mid 90's). Its best to try and mount the batteries where they won't leak on anything if possible.
The voltage you need is 3.6V. Near your battery on the motherboard should be a row of 4 vertical pins, maybe one in the middle is missing. It should be labeled EXT BATT or similiar. In my pictures above you can see it immediately to the right of the battery, to the left of the mounting hole. If it has a jumper over the pins then remove it. Then you can plug in the external battery holder.
It is probably a good idea to remove the old battery from the motherboard even if you are using an external battery, so the old battery doesn't leak and corrode the tracks on the board. Corrosion can travel along the metal inside the board too. There are plenty of guides on desoldering on the internet if you google for them, its actually very easy, but practice on some old boards you aren't worried about first 😀