Yeah, those heatsinks will work fine, I have a few of the fanless versions. The part that clips over the edge of the CPU is pretty thin, so it won't really interfere with seating the chip in the socket.

Fancy heatsink compound is pretty much pointless in general, and especially so on older stuff with low TDPs. Just use whatever cheap crap you come across. This is the stuff I use, and there's also a grey version that seems to be the same other than the color.

As for removing the old glue, try mineral spirits or naptha. (I.e., paint thinner or lighter fluid.) That's been able to break down even the most stubborn of thermal adhesives I've encountered. Just be sure to clean with alcohol afterwards, as those chemicals tend to leave a bit of a residue.

Thanks Thrashbarg very helpful 😀