Radeon 9800 Pro most definitely uses the 5V rail very heavily - both from the Molex connector and from the AGP connector, along with 3.3V from the AGP connector. I think 12V rail is very lightly used on that card.
The 6800 GT AGP is a completely different animal and uses mostly the 12V rail from the 4-pin connector. Not sure if the 5V rail is used or not, though - I think that may be card-specific. For example, on a XFX 6800 XT AGP I have, that card uses the 12V rail from the 4-pin connector for the GPU V_core rail and the 3.3V rail from the AGP connector for generating the VRAM V_ddq rail (IIRC.) I don't recall if the 5V rail from the 4-pin connector was used or not, though.
Either way, don't just plug in stuff randomly to try it, unless you don't mind frying your hardware.
The better approach would be to take a multimeter and trace out where the 5V and 12V rails go from the 4-pin connector. There's a chance the 5V rail could be used for VRAM V_ddq instead of the 12V rail or 3.3V rail or for something else.