EMULAB Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

The new forum is online, hope you enjoy it!

Pages: [1] 2   Go Down

Author Topic: Missing ROMs but empty scan results  (Read 10138 times)

joelkolb

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 11
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Missing ROMs but empty scan results
« on: 16 October 2020, 17:01 »

I am working with an older set, 0.160. I already had a complete set of 0.159 and used n 0.159->0.160 upgrade set with the rebuilder to get to 0.160. I did a scan afterwards to make sure everything is good. The statistics show that I'm not missing any sets, CHDs or samples and nothing needed to be fixed, but it shows that I'm missing 3 ROMs. The scan results window is completely empty so I have no idea what those ROMs are. It's driving me nuts. Is there any way to figure out which ROMs are missing?

Here's a screenshot:
« Last Edit: 16 October 2020, 17:02 by joelkolb »
Logged


Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #1 on: 16 October 2020, 19:12 »

First of all, don't care about stats. The only important thing is that the scan results tree is empty.

Use the latest nighly or official build, clean the cache in the profiler, check the following options and do a new scan.

You should first check if you don't hide anything and check all sets. All "you want to scan" options are enabled and all "check" options are enabled. Scanner->SetInformation->click "select all", in Scanner->Systems, select "all", in Scanner->Hash & CHD->Available Regions are all checked, in Scanner->Scan Results Tree->Context Menu->View->Hide fully missing sets should be disabled.
All these are default options, so unless you've changed them they should be ok.

If all of these natch your settings and you still get 3 missing in the stats it maybe something weird in the old Mame versions. There is no real reason to use anything but the current mame release.
« Last Edit: 16 October 2020, 19:23 by Roman »
Logged

joelkolb

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 11
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #2 on: 17 October 2020, 17:16 »

You should first check if you don't hide anything and check all sets. All "you want to scan" options are enabled and all "check" options are enabled. Scanner->SetInformation->click "select all", in Scanner->Systems, select "all", in Scanner->Hash & CHD->Available Regions are all checked, in Scanner->Scan Results Tree->Context Menu->View->Hide fully missing sets should be disabled.

All my settings are just as you described except for "Scanner->SetInformation->click "select all"". I don't have a section called Set Information in the scanner. What am I missing?
Logged

joelkolb

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 11
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #3 on: 17 October 2020, 23:12 »

I found the Set Information at the bottom of the Scan Results window. All sets were already selected.
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #4 on: 19 October 2020, 07:28 »

and now update to MAME .225 and don't use a 5.5 year old MAME version ;) or simply turn off stats.
Logged

joelkolb

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 11
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #5 on: 20 October 2020, 01:56 »

At least I know I did everything right. Thanks for your help.
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #6 on: 20 October 2020, 07:12 »

I can prepare a version for you which logs the 3 ones into a textfile to check which weird things happened on your place...
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #7 on: 20 October 2020, 14:21 »

try https://mamedev.emulab.it/clrmamepro/binaries/cmproTest.7z

It creates a cmpro.log file in the cmpro main folder and lists all missing roms in there. Would be interesting to see which are listed there. The file is locked until you quit cmpro and emptied on startup.
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.111 Chrome 86.0.4240.111
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #8 on: 23 October 2020, 18:56 »

Did you give that version a try with your old MAME version? Would be interesting to see which roms are marked as missing
Logged

joelkolb

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 11
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #9 on: 24 October 2020, 04:29 »

I did. Here  are the contents of cmpro.log after the scan:

hng64\bios_export.bin
hng64\bios_korea.bin
hng64\bios_us.bin

With that information I was able to track down those 3 ROMs and get a clean scan that showed 0 missing down the line in the stats.

I'm a bit of a perfectionist so having this info is great, IMHO. I wish this were part of the main release versions. Thanks again for all your help!
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.111 Chrome 86.0.4240.111
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #10 on: 24 October 2020, 11:21 »

But they definetly should appear as missing in the scan results tree if they were really missing (and all hide this, hide that, disable this/that was turned off).
I will do some tests
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.111 Chrome 86.0.4240.111
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #11 on: 24 October 2020, 17:05 »

Did some tests with 159 and 160...and I can't reproduce your problem. If the files are missing, they are listed in the tree.
Logged

joelkolb

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 11
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #12 on: 24 October 2020, 18:09 »

I was also cleaning up an 0.174 set last night and the same kind of thing happened with that. The results pane was empty but the stats showed 3 missing sets and 58 missing ROMs. Unfortunately, I didn't save the cmpro.log from that but it was consistent with what the stats showed and after gathering the ROMs listed a subsequent scan showed 0 missing in the stats.

Just now I finished updating a set that was a few versions old to get it up to 0.225. This was done on a different computer from the other 2 with a new setup of clrmamepro. I'm getting the same deal. Missing 1 set and 37 ROMs in the stats but the scan results are empty. Screenshot and cmpro.log with duplicate entries filtered out are below.



cmpro.log contents:
aristmk5\setchip v1.0.u11
aristmk5\setchip v1.0.u7
aristmk5\setchip v4.03.07.u11
aristmk5\setchip v4.03.07.u7
aristmk5\setchip v4.04.05.u11
aristmk5\setchip v4.04.05.u7
aristmk6\01040505.u70
aristmk6\01040505.u71
aristmk6\01040505.u83
aristmk6\01040505.u84
aristmk6\03130334_left.u70
aristmk6\03130334_right.u83
aristmk6\14011605_left.u70
aristmk6\14011605_right.u83
aristmk6\20012305_left.u70
aristmk6\20012305_right.u83
aristmk6\25012805_left.u70
aristmk6\25012805_right.u83
atarisy1\136032.105.l13
atarisy1\136032.107.b2
atarisy1\136032.115.j10
awbios\fpr-24363.ic48
bubsys\boot.bin
cdibios\zx405042p__cdi_slave_2.0__b43t__zzmk9213.mc68hc705c8a_withtestrom.7206
crysbios\mx27l1000-alt.u14
konendev\2v02s502_ifu.u190
megaplay\315-5349a.ic54
megaplay\315-5651.ic8
megaplay\315-5653.ic56
megaplay\315-5655.ic34
megaplay\315-5661.ic7
naomi2\epr-23607c.ic27
naomi2\epr-23609b.ic27
neogeo\uni-bios_4_0.rom
segasp\fpr-24329.ic72
stvbios\epr-17741a.ic8
tourvis\v4-54.ic29
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.111 Chrome 86.0.4240.111
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #13 on: 24 October 2020, 18:24 »

Do you really miss the files in the log file or do they actually exist in your paths?

It's pretty normal that you need to run two scans to cleanup some stats/listed entries.
There are some rare cases where a first scan puts parts to the backup folder and a second one will add them back to their correct places. ...but still weird that you get an empty results tree and entries in the stats....never seen that one though.

can you send me your:
cmpro.ini
and the used dat (in case you didn't import from a mame binary) and the beloning *.cmp settings file for your used profile (in cmpro's settings folder).
Logged

joelkolb

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 11
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #14 on: 24 October 2020, 20:09 »

Yes, all of those specific ROM files are missing from the sets except for konendev which is the 1 set indicated in the stats that is missing, so of course the ROM for that is missing also.

I did have to run several scans. Just as you said, several ROMs that were needed were moved to the backup folder and showed as missing in the results. A rebuild with the backup folder as the source and another scan fixed those. I also ended up with problems with several CHD files in a subsequent scan. It told me that they were being detected as v4 and v5 was needed. It was very odd because when I checked them with chdman they were all v5. I don't remember which files specifically but they were mostly variants of Street Fighter III. After another scan none of those issues with the CHDs came up. Altogether I had to do about 4 or 5 scans and manually finding a few missing files in between each scan before it came back as clean as it did here. In every case I've mentioned where the scan results were empty but the stats showed missing ROMs, I did multiple scans and got things to the point where I could do several scans or new scans in a row and still get them same exact results.

I have attached the files you requested with .txt appended as the extension. There's no dat because I used the MAME 0.225 binary to make the profile. You will notice a lot of references to the folder "MAME_0.205_Non-Merged" because I was upgrading from 0.205 when I started.
« Last Edit: 24 October 2020, 20:11 by joelkolb »
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.111 Chrome 86.0.4240.111
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #15 on: 25 October 2020, 08:54 »

The chdversion problem sounds even more weird.
Since the chd file holds the version which is simply read and compared to the one which you've set in settings->compressor->chdman->req chd version.
Does it always show the same results or random?

If random it more sounds like a system problem where something is interfearing, where "something" can be anything from bad network drivers when the data is stored on a network drive, bad RAM/HD, virusscanner or other 3rd party tools interfearing etc..etc..
Don't worry, sounds more dangerours at it is....but such errors were never reported before.
Logged

joelkolb

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 11
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.75 Chrome 86.0.4240.75
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #16 on: 25 October 2020, 09:02 »

The CHD version thing is random. I've never had that happen before and when I did another scan right after it didn't say anything about the CHDs anymore.
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.111 Chrome 86.0.4240.111
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #17 on: 25 October 2020, 12:19 »

Can you tell me a bit about your system?
Which OS (version, 32/64bit),  I can see that you store your data on drive D...what kind of drive is that?

If things happen randomly there is a chance that something interfears. There were cases in the past where bad samba network drivers caused issues or virusscanners simply blocked access and lead to weird results. Not to mention overclocked systems where RAM simply produced flipped bits here and then.
I don't say that your system has a problem but if you got the chance to test stuff on a different drive or machine, it would be interesting to see the results there.

But of course I will double check the chd version check (surely a not correctly initialized variable may cause random issues, too). But again.....no one else reported such kind of things..... ;-)
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.111 Chrome 86.0.4240.111
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #18 on: 25 October 2020, 13:18 »

One thing I've spotted in your settings is Scanner->Advanced -> you got "Separate BIOS sets" disabled. This means you waste pretty much space by keeping the bios files in each and any set instead of keeping them separated (e.g. each neogeo set keeps the neogeo bios files instead having 1 neogeo.zip holding them). Disabling that option is very very very rarely used...actually so rarely used that I can imagine it's the cause of your stats issues. I will do some checks on that option but you should turn that option on. The same option exists in rebuilder->advance.
And you're using non-merged sets...again, not a good idea. You waste a lot(!) diskspace and actually nobody uses this ;)
The common modes are split merged or fully merged sets (split sets / merged sets).

So...really think about switching your merge mode to something common ;-)

Regarding chd versions...no luck here to repeat the behaviour yet.
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 86.0.4240.111 Chrome 86.0.4240.111
    • View Profile
Re: Missing ROMs but empty scan results
« Reply #19 on: 25 October 2020, 13:25 »

ok...I can now for sure tell you that your stats/scan results tree mismatch is based on the disabled "separate bios sets" option.

If this mode is enabled and the bios sets itself misses files (but all the sets using this bios got the bios files included already) show no entry in the scan results tree but stats count them as missing.
This is of course a wrong behaviour. It should list the bad bios set in the tree. I will check why it does not appear (for whatever reason cmpro might saw the existing files in the single sets and didn't pop out the bios itself).

Thanks for helping me by sending your config.....but you should really think about split merged mode and separated bios sets....you will gain diskspace.
Logged
Pages: [1] 2   Go Up
 

Page created in 0.128 seconds with 19 queries.

anything