EMULAB Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

The new forum is online, hope you enjoy it!

Pages: [1]   Go Down

Author Topic: Problems with ZIP64  (Read 10297 times)

coccola

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 56
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 40.0 Firefox 40.0
    • View Profile
Problems with ZIP64
« on: 21 September 2015, 18:12 »

I'll report 2 bugs. They are probably related to each other:


1) When scanning large ZIP archives compressed in ZIP64 format and "decompress ROM & check CRC32" enabled in the "Hash and CHD Settings" window, the archives instantly fail with the message "Full archive integrity check reported errors or a header crc32 mismatch was found".
The archives were compressed by clrmamepro's rebuilder (64-bit), mostly in older versions. All the archives successfully pass the integrity tests of WinRAR 5.21 64-bit and 7-Zip 9.22 beta on Windows 7.
The smallest archive I have with this error is 2.12 GB, part of No-Intro's dat:

1018 - Senran Kagura 2 - Shinku (Japan).3ds
size="4294967296"
crc="42f9ec42"
md5="c726bf92ee0b3b7d604988f8a4e6c2d6"
sha1="a4d9a9bcd4ac8d30dea1f7b2745c01f052a8d282"

If needed, I can send you the file somehow.


2) The rebuilder doesn't recognize the ROMs mentioned above. The statistics window doesn't count the matches. No warnings are shown.


These are links I found to similar problems:

http://romshepherd.com/index.php?topic=1203.0

http://www.emulab.it/forum/index.php?topic=412.0


Thank you for creating such a wonderful tool. You are a genius!  ;)
Logged


Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 120
  • Online Online
  • Posts: 3443
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 45.0.2454.93 Chrome 45.0.2454.93
    • View Profile
Re: Problems with ZIP64
« Reply #1 on: 21 September 2015, 18:14 »

Easy answer: zip64 isn't supported. Use rar or 7z instead.
« Last Edit: 21 September 2015, 18:15 by Roman »
Logged

coccola

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 56
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 40.0 Firefox 40.0
    • View Profile
Re: Problems with ZIP64
« Reply #2 on: 21 September 2015, 18:25 »

Very easy.

Thank you!
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 120
  • Online Online
  • Posts: 3443
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 45.0.2454.93 Chrome 45.0.2454.93
    • View Profile
Re: Problems with ZIP64
« Reply #3 on: 21 September 2015, 18:29 »

Well...of course standard zip is fully supported (which is allows archives < 4GB) and actually I got the licence (yes, this is extra costs, zip64 ain't free) to support zip64 via the used ziparchive class library which cmpro uses. But I never added it since there is no real need for it. I guess I got it somewhere on my request list already but don't expect to see it anytime soon.
Logged

coccola

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 56
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 40.0 Firefox 40.0
    • View Profile
Re: Problems with ZIP64
« Reply #4 on: 21 September 2015, 18:52 »

No problem, I'll wait. Maybe sometime in the future...

Problems like these I described only happened for me for the Nintendo 3DS stuff. As time goes by the files tend to get larger, and this will be a necessity someday. Not for MAME, as the larger files are usually CHDs.

I didn't know you had to buy a license to use ZIP64. You are right, it is better to use 7z instead, even if you have bought the license already.

Thanks for answering!
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 120
  • Online Online
  • Posts: 3443
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 45.0.2454.99 Chrome 45.0.2454.99
    • View Profile
Re: Problems with ZIP64
« Reply #5 on: 22 September 2015, 08:19 »

Actually it shouldn't be such a big problem to support it....I had a quick peek at the api documentation:

The ZipArchive Library automatically uses the Zip64 extensions when the regular zip archive limits are exceeded. The ZipArchive Library will not otherwise include the extensions in the archive, even if the extensions are enabled (see the paragraph below). The extensions will be removed from the archive when due to modifications they are not needed anymore. The library also automatically detects an archive in the Zip64 format.

so....I guess I only have to enable some global switch and double check some routines here and there...
so maybe you don't have to wait that long ;-)
Logged

coccola

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 56
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 40.0 Firefox 40.0
    • View Profile
Re: Problems with ZIP64
« Reply #6 on: 22 September 2015, 16:39 »

That's great news!

So clrmamepro will get more future-proof! That's nice.

That also means you'll probably have less stuff to update after the new code stabilizes  ;)
Logged

Roman

  • Global Moderator
  • Member
  • ***
  • Karma: 120
  • Online Online
  • Posts: 3443
  • Operating System:
  • Windows NT 10.0 Windows NT 10.0
  • Browser:
  • Chrome 45.0.2454.99 Chrome 45.0.2454.99
    • View Profile
Re: Problems with ZIP64
« Reply #7 on: 22 September 2015, 21:14 »

ok..I've had another look at the zip64 topic.

Generally it is already enabled...(great if the author himself is not aware of this....doh). It acts as it should, i.e. if the zipclass library sees that zip64 needs to be used it is used, otherwise it's not used (and you got a standard zip).

Both, the rebuilder skip and the 'decompress ROM & check CRC32' problem is based on a lousy litte bug. There was a wrong DWORD cast which cut down the UINT64 value to 32bit...great...so the test failed...This is now fixed.

I got 2 more things on my current to-do list...but I'd expect a new version later this week....
Logged

coccola

  • Member
  • *
  • Karma: 0
  • Offline Offline
  • Posts: 56
  • Operating System:
  • Windows 7/Server 2008 R2 Windows 7/Server 2008 R2
  • Browser:
  • Firefox 40.0 Firefox 40.0
    • View Profile
Re: Problems with ZIP64
« Reply #8 on: 22 September 2015, 21:24 »

W00t!

Thank you very much for your time and effort!

I'll be waiting anxiously!
Logged
Pages: [1]   Go Up
 

Page created in 0.069 seconds with 22 queries.