Der Kuenringer wrote on 2020-12-14, 19:41:

I would certainly fancy a more self-contained version of this device.
Do you have any news about that DOS utility, so we can switch CD images from inside the host machine? Usage it in a retro gaming rig would be far more viable, if I didn't have to connect the IDE simulator to another computer.

You'd still need a way to switch images outside the command prompt. I guess you could have the ability to map multiple disks and then have a physical button on the front switch between them. The problem I see if will multi disk games and I believe the largest get up to seven disks.

Maybe using serial could be the same to interface from inside the host, though I believe some controllers cards has the serial ports on the PCB with a parallel and gameport as headers.

since christmas is nigh, how about adding bluetooth to the board, so we can connect to a host machine wirelessly? 🎁👀
the most convenient interface would be a smartphone app, just swiping through a simple list of files and switching when needed.

The DOS utility isn't quite ready yet either, but I'm hoping all of it will come together soon for a new release with a bunch of new features.

Here's a silly little screenshot of it in an earlier incarnation I shared before, just testing the UI side:

It actually mostly works now, but since MSCDEX.EXE and its accompanying drivers don't have the facility to pass through SCSI commands directly, I had to use ASPI. This also turned out to be a pain - ATAPIMGR.SYS (from Panasonic) rejects vendor-specific SCSI commands. ASPI.SYS (Oak Technologies) seems to be fine, but it's still an irritation. In addition to this people might not want random extra drivers loaded (even though there's ways to load/unload them on demand), so I may also make a mode where it just pokes the IDE registers directly (which sadly obviously means it won't work for exotic IDE ports that actually need a driver).

I did consider making a TSR version to switch in-app from DOS but last time I made a TSR I was 15 and it was a project with my dad, and that also wouldn't work with 32-bit DOS extender-based games, I believe. I do intend to make a Windows version just because ASPI is already there, too.

Bluetooth is an interesting idea, I could possibly get a Bluetooth stack working via a USB Bluetooth dongle 😉 I played around with adding support for an ethernet dongle in the past just for a laugh (you'd be able to upload/download ISOs as well as switch them remotely), but that was still limited by the fact you needed the ethernet cable flopping around.

For the PS1, GC and Dreamcast ODEs they just have a physical button that you press to swap to the next disk. It's suggest doing that and also put on a header that will let you plug in your case's reset switch or something.
Bluetooth would be pretty cool though. And several esp32 modules now have Bluetooth/WiFi built in already.

electric_monk wrote on 2020-12-15, 02:08:

It actually mostly works now, but since MSCDEX.EXE and its accompanying drivers don't have the facility to pass through SCSI commands directly

MSCDEX command 12 (ioctl output) function 4 is "write device control string"; might be worth checking if any of the atapi device drivers implement it in any way besides just returning an error?

Sorry guys, I don't get this at all. In what situations would one want to emulate an optical disc instead of copying the data out on a normal virtual disk, as in virtual hard drive. Certainly there are consoles designed around use of optical discs, and maybe there are dos games with copy protection built into the disc. But it's hard to imagine having the ability to decode most protection without being able to put into another format. Basically what possible advantage would a Gotek CD bring? I get that there might be a convenience of the ability to play files directly in .iso or .cue format, but conversion shouldn't be a big deal. IDK maybe they can make a custom "700MB floppy" for Gotek, wouldn't that work? Aren't the vast majority of games that use CDs for anything besides installation Windows games? I think someone mentioned earlier, the way some CDs were made bootable was to include a bootable floppy image, -basically its easier for DOS to recognize bootable floppies.
I remember starting to use linux around 1999. For a while there were no bootable linux CDs, one had to boot from a floppy, then copy all the files off the CD onto the hard drive, then make the drive installation bootable and put the CDs on a shelf. Or else use about a dozen 3.5 floppies. I used 5.25 floppies through college, so I understand a bit how all of those worked. That seemed like a lot of work when I had no earlier experience with unix and had barely learned a handful of commands. I think it was Debian 2.0 was the first bootable linux CD, I picked up a copy at a Geek Pride festival. Unfortunately my wife had demanded we get a 68k Mac, so I had to wait a while longer for my own linux box. But the Mac had a SCSI 2X CD, which was surprisingly useful because it sped up to double speed right away, while all the 4X IDE drives took a while to speed up, slowing boot times on PCs. I'm explaining all this to show, I've been using CDs from the beginning , I learned DOS and Windows 3.11 back in the day, and I still have no idea why anyone would want a hardware device dedicated to emulating optical discs. If I wanted to play with old Mac emulators, I'd just make sure I had enough hard drive space and emulate from within. I can only see limited use for Windows machines, again it is better to emulate from within, and really there's no significant advantage over getting a physical CD drive. It's of no use for 8-bit machines like the Apple II or Commodore. What makes a dedicated CD emulator a "holy grail"? It would also be preferable to get data straight from a network, even an emulated network! Am I right about it being useful for copyright protected games? Otherwise I have to assume a lot of people here don't understand how information is recorded read on various formats, and they assume there's something magical and special about optical disks, when there really isn't.

Cuvtixo wrote on 2021-01-02, 04:53:

Otherwise I have to assume a lot of people here don't understand how information is recorded read on various formats, and they assume there's something magical and special about optical disks, when there really isn't.

Name one software drive emulator that works reliably for cd audio, no matter what operating system or audio hardware is being used.

electric_monk wrote on 2019-10-16, 04:44:

Jo22 wrote:

but no *.NRG is slightly lame, though.

I mean, I'm open to suggestions 😉 I haven't heard of that format before though. It doesn't look very well documented (at least, based on the weirdly technical Wikipedia article about it).

Really? you haven't heard of that format? I'm fairly certain it's proprietary. Can you tell me what exactly what the goal here would be, like for what use-cases. I don't mean to put you on the spot or interrogate you or anything, but I really don't understand the purpose. If someone wants to make a library of CD-Rom games, why not just put the files in folders? Name the folders after the titles? Why keep them in a .iso or any other optical disc format?

BTW the application Isobuster does DAO, TAO, ISO, BIN, IMG, CCD, CIF, FCD, NRG, GCD, P01, 2D, CUE, CDI, CD, GI, PXI, MDS, MDF, VC4, 000, B5T, B5I, B6T, B6I, DMG, HFV, DC42, IBP, IBQ, IBDAT, IBADR, NCD, FLP, E01, Ex01, S01, RMG, VMDK, UDF, DD, VHD, VHDX, VDI, WBFS, XISO, XBX, ST, GDI, DCM, VMU, DDF, GME, MCD, MCI, MCR, MEM, PS, PSM, SAVERAM, SRM, VCD, VGS, VM1, VMP, APA, DAT, PS2, VM2, VMC, RAW, DSK, IMAGE, IMA -you could be very busy

jmarsh wrote on 2021-01-02, 05:28:

Cuvtixo wrote on 2021-01-02, 04:53:

Otherwise I have to assume a lot of people here don't understand how information is recorded read on various formats, and they assume there's something magical and special about optical disks, when there really isn't.

Name one software drive emulator that works reliably for cd audio, no matter what operating system or audio hardware is being used.

Part of my point, actually. Encode CD Audio into MP3, or else use a physical optical disc player. Don't try to keep a file in the format of an audio CD.

And how exactly is that going to work on a machine running DOS, for example?
It seems like you're assuming this ODE is going to be used on modern machines, when this thread is mostly focused on retro machines. The very first post raises the point that both physical media and drives are rapidly becoming extinct hence the need for a replacement.

There already exists a few options for software ODE for DOS, but none support audio.
I have a bunch of DOS games that use the audio output of the CD-ROM drive and I hate having to burn discs and swap them out all the time.
A physical ODE with audio support would be worth alot to me.

For a modern system, just use Dosbox and Ogg files.
But we're going with real hardware here, which require hardware solutions

Cuvtixo wrote on 2021-01-02, 04:53:

Sorry guys, I don't get this at all. In what situations would one want to emulate an optical disc instead of copying the data out on a normal virtual disk, as in virtual hard drive. Certainly there are consoles designed around use of optical discs, and maybe there are dos games with copy protection built into the disc. But it's hard to imagine having the ability to decode most protection without being able to put into another format. Basically what possible advantage would a Gotek CD bring? I get that there might be a convenience of the ability to play files directly in .iso or .cue format, but conversion shouldn't be a big deal. IDK maybe they can make a custom "700MB floppy" for Gotek, wouldn't that work? Aren't the vast majority of games that use CDs for anything besides installation Windows games? I think someone mentioned earlier, the way some CDs were made bootable was to include a bootable floppy image, -basically its easier for DOS to recognize bootable floppies.
I remember starting to use linux around 1999. For a while there were no bootable linux CDs, one had to boot from a floppy, then copy all the files off the CD onto the hard drive, then make the drive installation bootable and put the CDs on a shelf. Or else use about a dozen 3.5 floppies. I used 5.25 floppies through college, so I understand a bit how all of those worked. That seemed like a lot of work when I had no earlier experience with unix and had barely learned a handful of commands. I think it was Debian 2.0 was the first bootable linux CD, I picked up a copy at a Geek Pride festival. Unfortunately my wife had demanded we get a 68k Mac, so I had to wait a while longer for my own linux box. But the Mac had a SCSI 2X CD, which was surprisingly useful because it sped up to double speed right away, while all the 4X IDE drives took a while to speed up, slowing boot times on PCs. I'm explaining all this to show, I've been using CDs from the beginning , I learned DOS and Windows 3.11 back in the day, and I still have no idea why anyone would want a hardware device dedicated to emulating optical discs. If I wanted to play with old Mac emulators, I'd just make sure I had enough hard drive space and emulate from within. I can only see limited use for Windows machines, again it is better to emulate from within, and really there's no significant advantage over getting a physical CD drive. It's of no use for 8-bit machines like the Apple II or Commodore. What makes a dedicated CD emulator a "holy grail"? It would also be preferable to get data straight from a network, even an emulated network! Am I right about it being useful for copyright protected games? Otherwise I have to assume a lot of people here don't understand how information is recorded read on various formats, and they assume there's something magical and special about optical disks, when there really isn't.

You can't get audio streaming to work on virtual CD ROM solutions. Hence the need for a hardware solution.

Even if software solutions could be made to support the feature, and in DOS and win9x none the less, even then a 386 can't reasonably be expected to emulate a CD ROM in software.

electric_monk wrote on 2020-12-13, 23:21:

I was working on adding some support for CrystalFontz USB LCD screens (with buttons) so it could have an out-the-box GUI for people who want that, but it's been on the back burner a little since I'm working on other compatibility features just now (like increasing compatibility with some older 386s and adding support for UHD floppies like ZIP disks, which is something that's useful to some people). The main thing that makes it a bit of a pain is that they use a FTDI USB to serial chip, instead of a chip that implements the official USB serial adapter protocol, so I need to write a driver for that.

I didn't see anyone ask this yet, but have you considered open sourcing the firmware? As a fellow computer geek and software developer, I tend to enjoy goofing around with things and submitting pull requests to fix bugs or add features. Is this something you might entertain? I get it if you don't; I'm just thinking that there are probably a number of people here who'd be so inclined.

I guess I'm asking because I'm looking at making a couple of older systems, one of which would hugely benefit from this emulator as dealing with optical drives and their discs is becoming increasingly fraught. But it would be amazing to use one of those USB LCD screens with the buttons cause it would make navigating a library of images on an SD card an absolute breeze.

Anyway, thanks for all your work!

I would certanly like a CD/DVD-Emulator, esp. with disc-changing solution by choosing the image like on a gotek.

But actually there is not a real demand, because it is not true you can not buy new produced optical drives with IDE/atapi. SATA actually is mostly a serial version of IDE; a transperent conversion between IDE/Atapi and SATA is no problem at all. Such an adapter only cost about $4 incl. shipping (https://de.aliexpress.com/item/1005001790344824.html). So you can use any actual modern optical drive inside your vintage PC.

Many people are "collectors" - and as people like to collect and streaming does not fullfill that, CD´s and blue ray sellings might go down due to streaming, but will not stop. Pressed optical mediums have a quite long live. Same as with vinyl being still produced - and still also the drives. In lower numbers, but they are.
Due to the backwards compability (you can use any blueray drive to read CD and DVD also) there might be a drop in sales - but no end in sight for the medium as for compatible drives. Also no end for SATA in sight.

So the situation between emulation of Floppy drives, where some media like Double Density (instead High Density) needed for popular vintage computers like Commodore Amiga or Atari ST are not produced (and still produced Disc Drives might read DD but can not reliable write them), is quite different to the situation on optical drives or even harddisks (where on IDE quite cheap IDE2 CF, IDE2SD, IDE2SATA or mSATA-Adapters are available).

So an Floppy emulator is mostly a must2have to use popular vintage computers (and play the games you loved as you where young). So it is a mass product.
IDE-Hard-Disc Emulation is no problem anyways.
Simulating SCSI is much less needed, but for vintage Apple users often is essential. Much smaller numbers as on the more sold vintage computers, so less demand. Also as SCSI is much faster than Floppy, so more powerfull controller needed (like an rapery pi zero with level converters, emulating a scsi interface at the GPIO - but boottime of the Pi can be a problem with timeoff on start. So more comfortable are FGA-solutions). So DiY solutions starts about $30 (with a little problem on instant boot) and $90 for "ready to use" SCSI2SD.
Emulating MFM HD is quite less needed, emulating more complicated, uses FPGA and cost more than 200$ (as it only is produced in small batches). But there are cases they are needed, f.e. if you have a programmer for SPS Controllers, like the Siemens 750 (wich is a 386 portable PC with 8 inch tube monitor and programming interface for Siemens SPS controllers, but a bios only booting from Floppy or MFM controller).

But emulating optical drives is not a must2have, but only a "nice2have" for very few people. As modern optical drives can be used extremly easy (at least on desktops) only some vintage notebooks might require it. But still, if you are a fan of a vintage notebook, you mostly want it most stocklike as possible, and you still get CD-Drives used in good condition. So using an emulator (wich has to fit inside the IDE/ATAPI-CD-Drive by the way) is not an urgent problem. Maybe the demand increases in 10 years.

Of course an emulator for CD-Drives is nice. I would certanly buy one, if it has CD-Changer Emulation, as I always wanted a CD-Changer for my Amiga (CD Changer are hard to get now - and quite expensive, so $200 for an emulator would be less than an real one). But a "drop-in" solution would be a product only for few people, produced only in small numbers and at a price quite high.

I mostly hope someone designs an "IDE-Emulator" for the raspberry pi zero (W) like the existing "SCSI-Emulator". It would be a 30$ solution hardwareside. Even if boottime for IDE is problimaticaly (SCSI scans much longer for drives, so with SCSI ID 15 good chance Pi has booted already after power on the computer). On IDE time for starting the Pi exeeds the scanning time for devices. So you have to delay power getting from PSU to mainboard by about 20 seconds using a relay to allow the Pi to boot before starting boot process. Also I am not sure DMA-Mode can be simulated on GPIO. But for a vintage computer, PIO-Mode would be more authentic anyway.

Of course you can use the PI SCSI emulator in combination with IDE2SCSI converter (Haage and Partner if I remember correctly). But while the SCSI emulator is cheap, the SCSI-Converter last time I looked was about 350$. I bought one (or two, I am not sure) more than 20 years ago for about 50$. I thought that being a high price than... But of course, as I said, price gets lower as more is sold. The time I bought it, large numbers where produced and sold, as the new upcomeing IDE took over SCSI. SCSI-Drives where much more expensive at the time, more than double the price for IDE-Drives. Als the demand for bigger storage never ends, many people with a existing SCSI system wanted to use IDE devices. Even with 50$ such an adapter + IDE-Drive was less than buing a SCSI drive. If I remember correctly I bought the adapter witch worked in both directions (SCSI->IDE and IDE-> SCSI).

Ironicly, I used the adapter for adding a CD-Drive to the SCSI bus. Would be funny if I find it again and use it for adding a SCSI-CD-Emulator to IDE now. But most likely if I find them, I will use them for restauration of my old Amiga 2000 (as the SCSI harddisk would most likely not work by now anymore, but I need the SCSI-host adapter anyway, as it also contains the RAM Expansion...)

I wonder if anything like this exist on a reasonable price for ATA which similarly to the Gotek can take .iso images and boot from it.

It would save a lot of pain for me because I love to play around with old OS-es and although I have developed a fairly large PXE network boot image collection there are many iso-s what cannot be booted successfully through PXE or not even with Grub (with iso loader). I don't have any rewritable CDs or DVDs left all broke and hated this technology so don't want to go back there either.

For example Windows 2000, I can easily pxeboot a DOS floppy and install it to FAT but to install it to a NTFS partition you need to boot from the cd as it loads the drivers. This is just one of many where using an original CD to install something would be just the easiest way.

I thought the windows NT 4.0 and 2k had an NT CLI for the bootdisks

Gopher666 wrote on 2021-02-05, 20:00:

For example Windows 2000, I can easily pxeboot a DOS floppy and install it to FAT but to install it to a NTFS partition you need to boot from the cd as it loads the drivers. This is just one of many where using an original CD to install something would be just the easiest way.

only bringing it becasue you mentioned it. Windows 2000 server has RIS, remote instalation services which can install almost anything over pxe boot. So yeah. A original CD maybe the easiest way but not the only way... have you ever used RIS?

I know you were talking about running DOS over PXE, and reading NTFS drives but you do know there are NTFS drivers for DOS.

To stick with the original point PXE is a major pain in the ass by itself I dont want a windoz thingy next to mine. I know they have something like WDS these days I use good old pxelinux + tftpd-hpa for my setups.

low level emulation where a physical device is emulating a CD rom like a gotek emulates a floppy drive and the BIOS is accessing it through a physical IDE controller and it is appearing as if it is a real drive to the bios there is nothing like that. Only mounting network drives as CD drives is possibly That I know of. But that doesn't work for everything. These days obvisouly you can just boot from USB flash or something but a old computer cannot do that since it doesn't have legacy emulation that is that advanced if at all. Only other way I know is to get a CF to ide adapter with external bay. Then you can load stuff on the CF and read from it over IDE.

If you gave me a specific example of what you are trying to do Id be willing to help you figure out how it can work.

Gopher666 wrote on 2021-02-05, 20:00:

https://i.ebayimg.com/images/g/HGcAAOSw6atfNKAl/s-l500.png […]
Show full quote

I wonder if anything like this exist on a reasonable price for ATA which similarly to the Gotek can take .iso images and boot from it.

It would save a lot of pain for me because I love to play around with old OS-es and although I have developed a fairly large PXE network boot image collection there are many iso-s what cannot be booted successfully through PXE or not even with Grub (with iso loader). I don't have any rewritable CDs or DVDs left all broke and hated this technology so don't want to go back there either.

For example Windows 2000, I can easily pxeboot a DOS floppy and install it to FAT but to install it to a NTFS partition you need to boot from the cd as it loads the drivers. This is just one of many where using an original CD to install something would be just the easiest way.

ebay has some interesting 'industrial computer'backplanes[processor isa type boards2]which'easier than old dec pport serial gaff bp'yunno? also pci[china]ext scsi/raid cards useful for esdi/rz/rx/mfmf!![compaq no!]4nos'biplane'enc'mulch'mix-up'count10z'nasty buss-mind traps!