EMULAB Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

The new forum is online, hope you enjoy it!

Pages: [1]   Go Down

Author Topic: clrmamepro 4.038a released  (Read 5162 times)

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 84.0.4147.105 Chrome 84.0.4147.105
    • View Profile
clrmamepro 4.038a released
« on: 07 August 2020, 15:01 »

4.038a
added: support for zip/rar/7z aliases (e.g. jar/cbz/cbr/cb7, etc) in Settings->Compressor tabs.
       So you can now scan e.g. jar files like zip files etc
       The alias settings allow multiple values separated by space, so e.g. .cbz .jar .war
added: zip property tab in Settings-Ccompressor with e.g. zip compression level setting option
misc:  use a private use utf8 char for internal set subfolder handling, so all kind of apostrophes
       'ยด` in rom/setnames are allowed again and won't be replaced
misc:  speedup multi 7z/rar delete opertions by using filelists
misc:  updated rar dll
fixed: some zip circular rename operations could kill files
fixed: some zip renames could create dupes (4.038a) (MAME .223 v4mdice v4monte issue)
« Last Edit: 07 August 2020, 15:02 by Roman »
Logged


mjmattson3170

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 37
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 79.0 Firefox 79.0
    • View Profile

Roman:

4.038 and 4.038a may still have an issue with the CHDs for:
dor se (special edition) '93 (japan)
dor special edition '93 (alt)
pro student g(japan)(rerelease) (in fmtowns_cd)

It looks like both pc98_cd and fmtowns_cd should have a dorse93 and dorse93a folder (or maybe just a dorse93) based on torrents.

Starting with each of pc98_cd and fmtowns_cd having a dorse93 and dorse93a folder (the JP in the dorse93 and the alt in the dorse93a folders), what I see is this:
1. CMP asks to rename fmtowns_cd\dorse93 to dorse93a
2. Both CHDs are put into fmtowns_cd\dorse93a
3. CMP says a CHD is in the wrong place and asks then to move both the JP and alt versions of the CHD from fmtowns_cd/dorse93a (just renamed) to pc98_cd\dorse93
4. CMP then says that I need to move the two CHDs in the fmtowns_cd/dorse93a (which it just renamed) to set "dorse93" presumably in fmtowns_cd.
5. CMP reports dorse93 under fmtowns_cd as "missing but fixable"
6. Then CMP requests to remove the JP version of the CHD from the fmtowns_cd\dorse93a folder, which leaves only dor special edition '93 (alt) left in fmtowns_cd/dorse93a.

I then stopped the scan at this point and started over.  I wanted to see what CMP would do with the files and folders in the state that it left them in through the first run.

1. CMP asks to move the alt CHD from fmtowns_cd\dorse93a to pc98_cd\dorse93
2. It reports that the moved CHD is "missing but fixable"
3. it reports now that the JP CHD is missing from fmtowns_cd "dorse93" (which in the last run it renamed the folder "dorse93a" and also asked to remove this CHD).

I can email you screenshots in order of the progression if you would like to see them.

For the "pro student g (japan) (rerelease).chd", the CHD is in the prostudg folder under fmtowns_cd, but it reported as "missing but fixable (-> prostudgr)"

Matt



« Last Edit: 07 August 2020, 20:43 by mjmattson3170 »
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Mac OS X Mac OS X
  • Browser:
  • Safari 13.1.2 Safari 13.1.2
    • View Profile
Re: clrmamepro 4.038a released
« Reply #2 on: 07 August 2020, 20:53 »

You are using the combined software list mode or each softwarelist got its own profile (prefered method)

But I will look at it a bit closer over the weekend.
« Last Edit: 07 August 2020, 21:08 by Roman »
Logged

mjmattson3170

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 37
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 79.0 Firefox 79.0
    • View Profile
Re: clrmamepro 4.038a released
« Reply #3 on: 07 August 2020, 22:23 »

Combined.
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 84.0.4147.105 Chrome 84.0.4147.105
    • View Profile
Re: clrmamepro 4.038a released
« Reply #4 on: 08 August 2020, 06:55 »

do you use split or merged sets?

A quick setup in a combined mode and only pc98_cd and fmtown_cd sets enabled doesn't show any problems though...Need to find more time to look deeper into it.
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 84.0.4147.105 Chrome 84.0.4147.105
    • View Profile
Re: clrmamepro 4.038a released
« Reply #5 on: 08 August 2020, 10:20 »

Trying to build up a minimum scenario but no luck yet...

What I've tried: MAME .223 exe imported only pc98_cd + fmtowns_cd software list
setup 2 rompaths, 1st one for  fmtowns, 2nd for pc98
Systems->only enabled pc98_cd + fmtowns_cd [SOFT] lists
SetInformation->Select sets "dorse93*" + Apply -> this enables the 4 sets in question

The rompaths hold
fmtowns_cd\dorse93\dor se (special edition) '93 (japan).chd
fmtowns_cd\dorse93a\dor special edition '93 (alt).chd
pc98_cd\dorse93\dor se (special edition) '93 (japan).chd
pc98_cd\dorse93a\dor special edition '93 (alt).chd

Run a scan with default options but disabled samples in split merged mode.
Nothing bad found...result is good...

So maybe you should send me your cmpro.ini and your belonging used cmpro_folder\settings file for the used profile.
Logged

mjmattson3170

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 37
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 79.0 Firefox 79.0
    • View Profile
Re: clrmamepro 4.038a released
« Reply #6 on: 08 August 2020, 17:28 »

I am using merged sets.

Let me know if you need anything other than the attached files.
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 84.0.4147.105 Chrome 84.0.4147.105
    • View Profile
Re: clrmamepro 4.038a released
« Reply #7 on: 08 August 2020, 19:09 »

hard to setup the scenario, while I got an idea about the dorse93 thing I cannot reproduce the pro student one at all.

The problematic part is part of some kind of fuzzy game match algorithm which in case of sets with double names may pick a wrong positive from time to time...*sigh*....I've done a bit tweaking on it (however it should go to the bin if you ask me) but anyway...

you may want to give this a try:

https://mamedev.emulab.it/clrmamepro/binaries/cmpro20200808.7z

would be interesting to know if that one opens the door to other weird sideeffects or not ;-) so better run it without fix options....
« Last Edit: 08 August 2020, 19:09 by Roman »
Logged

mjmattson3170

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 37
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 79.0 Firefox 79.0
    • View Profile
I will give it a try...question...
« Reply #8 on: 08 August 2020, 19:13 »

There was an explanation as to how to set up with separate profiles.  If this doesn't work, swapping to that set up might be better anyway.

Can you point me to how to set it up?
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 84.0.4147.105 Chrome 84.0.4147.105
    • View Profile
Re: clrmamepro 4.038a released
« Reply #9 on: 08 August 2020, 19:55 »

well......usually you simply drag'n drop all the files from MAME's hash holder into the profiler.
The first time when you do that you need to setup rompaths for each profile....the batcher (select more than one datfile at hit load) allows some automatic creation for them in the misc tab.
The next time cmpro should see that the files you've dropped are updates to the existing ones (like it does for other dats, too).

If you already have them due to your current setup, you may need to reassign them one on one....yeah..bit manual work to do.....


But in general the combined mode should work....I'm aware of the algorithm which may cause the problem...let me know if the tweaking helped you...otherwise I need to get rid of it ;)
Logged

mjmattson3170

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 37
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 79.0 Firefox 79.0
    • View Profile
Re: clrmamepro 4.038a released
« Reply #10 on: 08 August 2020, 19:59 »

I'm scanning the whole set...at 29%...

So far the only unexpected thing is:

Cricket [folder: cricket - size: 521kb]
unneeded file: L:\MAME\Software List ROMs\electron_cass\cricket\cricket_be.uef [not fixed]

I said no to the fix since I am not sure if this file really is unneeded...I don't see cricket as a set in the pleasuredome complete software list rom set under electron_cass, so maybe it is not needed?  The 4.038a build didn't see this, but maybe it is part of the algorithm tweak that now noticed it?

« Last Edit: 08 August 2020, 20:05 by mjmattson3170 »
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 84.0.4147.105 Chrome 84.0.4147.105
    • View Profile
Re: clrmamepro 4.038a released
« Reply #11 on: 08 August 2020, 20:19 »

Hmm..that file belongs to bbc_cass and not electron_cass

If you stored it in electron_cass (do you really have it there?) then it's indeed wrong...but maybe you already have it in bbc_cass, too

I actually wonder how the change of the algorithm should have an impact on this...I will double check that tomorrow
Logged

mjmattson3170

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 37
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 79.0 Firefox 79.0
    • View Profile
Update
« Reply #12 on: 08 August 2020, 22:19 »

OK, completed the scan:

1. pc98_cd:  dorse93 and dorse93a folders were merged together (which seems correct) and CHDs were moved into the merged folder.  CMP did NOT try to move the CHDs between pc98_cd and fmtowns_cd, which also seems correct.

2. fmtowns_cd:  dorse93 and dorse93a were NOT merged.  It also did not try to move them to pc98_cd.  I would have assumed that it should have merged those two folders and CHDs to dorse93 as it did with pc98_cd?  This may be an issue.  Since it didn't try to merge the two folders, I wonder if it just skipped them?

3. pro student:  CMP asked me to merge the CHDs in prostudg and prostudgr into prostudg, which seemed correct.  However, when I ran the scan AGAIN, it reported that prostudgr is "missing but fixable".  The "r" CHD is still in the prostudg folder, but reported as missing after CMP wanted to merge them.  So it wanted to merge them, then next run complained that the one was missing.

Note:  I did have cricket in electron_cass AND bbc_cass, but I deleted it from electron_cass.  The older versions of CMP seemed to think it was OK?

##################

I was playing around with trying to set up separate profiles and started with SoftwareList 3do_m2.   When I set up the profile, set the rompath, and ran the scan, I found that CHDs and folders for imsarcng and shootr2d were not in my romset at all.   But the scans using combined mode did not report that at all.  I have no idea how long this has been the case.  Once I downloaded and added them to the 3do_m2 folder, the scan completed with no error using just the 3do_m2 profile.   When I run a normal scan using combined mode, the testing unneeded scan at the start does not report anything unneeded about the two new folders I added.  That seems odd.

I also copied all of the existing hash folder files into a backup folder, deleted the hash files, and re-installed mame to get a clean set of hash files for the profile creation.





Matt
« Last Edit: 09 August 2020, 07:07 by mjmattson3170 »
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 84.0.4147.105 Chrome 84.0.4147.105
    • View Profile
Re: clrmamepro 4.038a released
« Reply #13 on: 09 August 2020, 07:48 »

Thanks for testing, yes the old algorithm might mark some unneeded sets as unneeded...As mentioned I will look into that a bit more. To make it clear...this is only for combined mode and only for sets which share the same name.

1) good
2) no, fmtowns_cd has no parent clone relationship for the 2 dorse93 sets, so there is no merging. You can see that in the hash file for fmtowns, so...also ok

3) I will look into this

imsarcng/etc...I will look into this
Logged

mjmattson3170

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 37
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 79.0 Firefox 79.0
    • View Profile
Re: clrmamepro 4.038a released
« Reply #14 on: 09 August 2020, 08:20 »

The Acorn Electron Cassette profile i created using the hash and running merged sets removed 62 items from the software list roms electron_cass folder (one file was xanagram - it does not appear to be in the hash file).   I kept a back up of the original folder.  Thought I would point that out as I was wondering why the combined mode did not do the same on earlier scans.

Also, I have created a few profiles using the hash files.  I notice that some profiles cannot be set to merged (while some can).  Even though I select in the Scanner tab for profile batchrun to have all "merged".  Is this because merged makes no sense for that particular profile?
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 84.0.4147.105 Chrome 84.0.4147.105
    • View Profile
Re: clrmamepro 4.038a released
« Reply #15 on: 09 August 2020, 13:07 »

split/full merge mode is only available if the software list support parent/clone relationships. No relationships, no merging


regarding "3do_m2" sets, actually MAME's direct software list import (-listsoftware) does not even include this as a software list.
MAME does filter some of the hash files for whatever reason when using the -listsoftware option.
The direct import only has imsarcng for the PSX software list. That's the reason why you didn't see the 3do ones yet.
If you use the hash files directly, you can access all data.

Regarding the former "unneeded" problem, I rewrote the algorithm in the meantime, making it much more logical and not fuzzylike...
I can't repeat you  pro student problem though....

I will prepare a new build for you soon.
« Last Edit: 09 August 2020, 17:00 by Roman »
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 84.0.4147.105 Chrome 84.0.4147.105
    • View Profile
Re: clrmamepro 4.038a released
« Reply #16 on: 09 August 2020, 17:43 »

https://mamedev.emulab.it/clrmamepro/binaries/cmpro20200809.7z

This should solve problems with not found "unneeded" sets like cricket and wrong suggested renames between software lists like dorse93.

Regarding "pro student", well yes, if you have 2 subfolders for the chds, the full merge mode will moan about it and will move the one chd to the parent. You said that "The "r" CHD is still in the prostudg folder,")...and that means the actual move failed. Why? I don't know. Maybe the folder was somehow locked by the system...the rest are sideeffects of the failed move.

"3do_m2", as mentioned, you don't have them in a direct -listsoftware import from MAME...only available in the single hash files
Logged

yerduaz

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 21
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 79.0 Firefox 79.0
    • View Profile
Re: clrmamepro 4.038a released
« Reply #17 on: 11 August 2020, 15:55 »

Hi Roman,
it seems there is a small issue with clrmame 4.038/a regarding the update of dat files: when you place a new version of a dat file in the same directory as the old one and open it, you get the usual window "Found an updated DatFile" and the new dat file takes over the seetings of the old one (so far, so good...). However, the old dat file, instead of being removed, is resetted: it is still available physically and is listed in the Profiler, in the folder [NEW DATFILES].
Could you please take a look at this?
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 84.0.4147.125 Chrome 84.0.4147.125
    • View Profile
Re: clrmamepro 4.038a released
« Reply #18 on: 11 August 2020, 16:29 »

It's working fine for me....attached 2 example dats.
Maybe you have the option disabled to remove the old one. Profiler->Options->Remove old Datfile after update...that one should be checked.
Logged

yerduaz

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 21
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 79.0 Firefox 79.0
    • View Profile
Re: clrmamepro 4.038a released
« Reply #19 on: 11 August 2020, 21:08 »

Hi Roman,
you're right: the option was disabled. I have probably click on this checkbox inadvertently...
Anyway, sorry for the trouble and many thanks for the quick and efficient answer.
Logged
Pages: [1]   Go Up
 

Page created in 0.19 seconds with 20 queries.

anything