EMULAB Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

The new forum is online, hope you enjoy it!

Pages: [1]   Go Down

Author Topic: Skipped files while rebuilding and zip compression  (Read 3749 times)

emulajavi

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 12
  • Operating System:
  • Mac OS X Mac OS X
  • Browser:
  • Safari 12.1.1 Safari 12.1.1
    • View Profile

Hi,

I have Clrmamepro 4.035 and .209 full set (merged). Only the .zips, without the chds.

I think split is better.... so pointed clrmamepro to the .209 binary and created a dat file (saying ‘no’ to software lists and then ‘ok to all’)

On the rebuilder option, selected as the source path the folder that contains all the zips of the merged roms, and as the destination path a new folder in other place.

I have two questions:

1.- On clrmamepro Settings->compression, there’s no ‘zip’ tab to select the compression level. (I think there is supposed to be a selector to select from 1 to 9) So what will the compression level that clrmamepro use when rebuilding?

2.- For example, now the rebuilding process is at 32% and says:
168244 matched
54500 created
2350 skipped

Why are there so many skipped things? I think that if I have a merged set, which is all files parent+clones on the same zip, and to convert it to split what clrmamepro does is create separate parent and clone sets, why it says it skipping things? Aren’t all the files of a merged full set useful for a split full set?

Thank you!
Logged


Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 74.0.3729.169 Chrome 74.0.3729.169
    • View Profile
Re: Skipped files while rebuilding and zip compression
« Reply #1 on: 31 May 2019, 20:32 »

1) There is no setting to change the compression level anymore (acutally for decades). clrmamepro uses 9 by default.
2) As soon as a source file does not match a hash it is counted as skipped and if it was rebuilt already. So for example if you got a file which is shared by 30 different sets (Without parent/clone relationship) it is rebuilt by the first match already 30 times ( so 'created' is increased by 30) and every time it is found again in the source it's counted as skipped. There are shared files even without parent/clone relationsships....e.g. devices or bios sets.
Logged

emulajavi

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 12
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 64.0.3282.140 Chrome 64.0.3282.140
    • View Profile
Re: Skipped files while rebuilding and zip compression
« Reply #2 on: 01 June 2019, 12:19 »

Hi,

Thank you very much for your quick reply!

About the setting to change the compression…. last time I 'updated' my set was on MAME .149 so it's been a long time


.210 was released two days ago and while I was looking to update my .209 to .210 roms, I've seen these post:

https://forum.pleasuredome.org.uk/index.php?showtopic=35012#entry303333

Where it says that 'Due to merging differences, some sets are (currently) not reproducible using the MAME binary or -listxml output.
In order to reproduce the available full sets with any Rom Manager, it's highly recommended to use the attached datfiles.'

So what's better…. to create the .210 datfile using clrmamepro with the mame64.exe binary...or use the datfile that PD provides?

Thanks!
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 74.0.3729.169 Chrome 74.0.3729.169
    • View Profile
Re: Skipped files while rebuilding and zip compression
« Reply #3 on: 01 June 2019, 15:41 »

The link does not work for me....so I don't know what they are writing.......What do they write? Merging differences? Source code merge or set merge? Without any details I can't comment.....
Generally, clrmamepro should be able to handle all merging problems (e.g. equally named files within a parent/clone relationship but with differnt byte data/different checksums).....
There shouldn't be a problem in using a direct MAME import.
Logged

emulajavi

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 12
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 64.0.3282.140 Chrome 64.0.3282.140
    • View Profile
Re: Skipped files while rebuilding and zip compression
« Reply #4 on: 01 June 2019, 17:02 »

It says this:

Due to merging differences, some sets are (currently) not reproducible using the MAME binary or -listxml output.
In order to reproduce the available full sets with any Rom Manager, it's highly recommended to use the attached datfiles.

And then they post the datfiles below

I've put them in my OneDrive if you want to check them:

https://1drv.ms/f/s!Al0KjcezUqKng4wMx4a43jQ_ewayCg


Maybe this datfiles are different than generating them from mame.exe or maybe not…..

Thanks!
Logged

oddi

  • Member
  • *
  • Karma: 2
  • Offline Offline
  • Posts: 193
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Firefox 68.0 Firefox 68.0
    • View Profile
Re: Skipped files while rebuilding and zip compression
« Reply #5 on: 01 June 2019, 17:14 »

@emulajavi:
If u used PD mame sets u must used PD dats.
Because torrent owner used different method for generate dats. If u  wanna have 100% full sets used this dats.
Whats different between methods, dats and etc, i dont know .
For more question open thread in PD forum, dont touch Roman :) :) :)
Logged

emulajavi

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 12
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 64.0.3282.140 Chrome 64.0.3282.140
    • View Profile
Re: Skipped files while rebuilding and zip compression
« Reply #6 on: 01 June 2019, 18:03 »

Hi,

I've got the .210 Split set complete and clrmamepro Scan statistics say:






But the Miss List shows this:

 You are missing 14 of 40411 known MAME_v210 sets (+ BIOS sets)

fantasy_sound
monsterb_sound
nes_bandai_pt554
nes_jf13
nes_jf17_pcm
nes_jf19_pcm
nes_jf23
nes_jf24
nes_jf29
nes_jf33
s97271p
sasuke_sound
satansat_sound
vanguard_sound
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 74.0.3729.169 Chrome 74.0.3729.169
    • View Profile
Re: Skipped files while rebuilding and zip compression
« Reply #7 on: 01 June 2019, 18:16 »

ignore stats and miss/have lists.....the only important thing is an empty scan tree output

The listed sets are sample-only sets. I should fix the miss-list routine for them....
« Last Edit: 01 June 2019, 18:25 by Roman »
Logged

emulajavi

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 12
  • Operating System:
  • Mac OS X Mac OS X
  • Browser:
  • Safari 12.1.1 Safari 12.1.1
    • View Profile
Re: Skipped files while rebuilding and zip compression
« Reply #8 on: 01 June 2019, 23:00 »

Thank you very much Roman!

The scan tree window is empty so I got the full .210 correctly.
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 112
  • Offline Offline
  • Posts: 3287
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 74.0.3729.169 Chrome 74.0.3729.169
    • View Profile
Re: Skipped files while rebuilding and zip compression
« Reply #9 on: 02 June 2019, 20:17 »

fixed the miss-list generation for these sample-only-sets....for the next nightly build....
Logged
Pages: [1]   Go Up
 

Page created in 0.126 seconds with 19 queries.