Thanks for clarifying on the Higan/bsnes, I’ve modified all my posts/spreadsheet accordingly. For the bsnes special chip accuracy, I suppose it would be more honest to state Cx4 and SPC7110 accuracy than overall special chip accuracy. My goal had been to not confuse people too much with getting into all the details. Plus while I realize it can support all the chips with the images, I don’t expect most users to do that and as such I wanted to test out-of-the-box functionality. I fully get that these tests aren’t a perfect, and I’m open to any ideas to improve this to give the most accurate picture of emulator accuracy. I’m not exactly aiming for compatibility tests as they are a bit different.
I did try to address this by finding out as much as possible what each emulator was based on, which I have in the spreadsheet that far and away snes9x is what most are based on. There are some slight difference between all of them still, with different versions of snes9x being used and such.
And yup, that’s what I noticed in doing my testing, and while I may not have done a disassembly of many emulators, the results of the testing suggest very strongly some emulators using the same backend.
If you have any suggestions for how to better interpret the tests, more tests to run, better ways to analyze, etc… I’m all ears. I enjoy these sorts of measurements and hope to provide accurate info.
Yeah… I know Gambatte has a bunch of tests, which if anyone thinks there’s a real need to do I can. However after doing 158 tests per NES emulator that got kind of old. Still, if it’s desired I can do.
TASVideos was actually the inspiration for theses tests, most of the test ROMs I used I grabbed from there, I wouldn’t have even started this project without that site!
You’re the one that did those tests? I must extend my sincerest thanks! That list came in extremely useful during testing to help me understand the results and put things into perspective, plus sharing with others what to expect from emulators. I noticed that about snes9x in Android emulators during testing… and the price tags
For the GBA emulators I appreciate the list. What I really want to do is perform some kind of tests of those emulators to gauge how accurate they are, colors, how it runs certain instructions, etc… Unfortunately I don’t know any such tests, and while I know enough to mostly interpret the results and why of such tests, I don’t know enough to make them.
Don’t apologize at all! I would rather have too much info than too little. I hate passing along incorrect info to people so anything that helps me change that is good. I started this partially because I got frustrated with seeing recommendations all over the board about emulators with no numbers to back up people’s opinions (especially with the oid emulators being recommended). I wanted to make some number based analysis which is as accurate as it can be.