So far, I've gotten to the point where I can get the icons added in the appropriate places (My Computer, Explorer side navigation panel), but I have yet to determine exactly which registry data is needed to make Windows treat these items like links to a directory. Replicating registry information partly from Control Panel, Printers, and Dial-Up Networking has gotten me to the point where it looks correct, and the menus are correct, but opening the location doesn't work at all, and choosing Explore just makes Windows whine about an htt file I have yet to create.
"Pictures" is installed just fine, as indicated in my previous image, reposted here:

The context menu is configured properly.

But Open does nothing, and Explore 404s as expected without a page layout htt file.

There is no information online that I can find, regarding adding new items to My Computer, least of all something as simple as directory links. As there is nothing similar in Win9X that I can find, I'm not sure if using the registry of WinXP would help. I don't have any systems suitable for Windows XP right now, as the one that is suitable needs new capacitors, otherwise I'd look there immediately.
I've added the ID {B3690E58-E961-423B-B687-386EBFD83239} (ID for "My Pictures" in later versions of Windows), set its folder to C:\Pictures (directory in this installation created for it), configured its DefaultIcon, InProcServer32, and ShellFolder settings to some degree, as well as adding its ID and reference to HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\explorer\mycomputer\nameSpace
The inscrutable binary value attached to "Attributes" may be the hurdle, but I don't have access to a newer version of Windows' registry to look for similarities to emulate or decode. Windows seems to want me to make an htt file for its display, while in Explore mode, but simply opening it to a location like any other directory is said not to require this.
- Where it's always 1995.
Icons, wallpapers, and typical Oldternet nonsense.