Hi Roman

I was wondering if you could help me out with a small problem... apologies if it's been covered before.

When I scan (for example) cabinet art files, the process is very slow until CMP all but freezes up.

The directory is unzipped- just a normal folder.

All I can think is that only having 256 MB RAM simply is not enough.

Can you confirm this, or might it be another issue?

Many thanks, hope you're well,

Sean

> Hi Roman
>
> I was wondering if you could help me out with a small problem... apologies if
> it's been covered before.
>
> When I scan (for example) cabinet art files, the process is very slow until CMP
> all but freezes up.
>
> The directory is unzipped- just a normal folder.
>
> All I can think is that only having 256 MB RAM simply is not enough.
>
> Can you confirm this, or might it be another issue?
>
> Many thanks, hope you're well,
>
> Sean
>


Just for benchmarking...a full mame scan takes about 1 minutes 20 seconds without diskcache usage and about 40 seconds with diskcache usage. That's on a P4 >3 GHz System with fast harddisks, without sha1/md5 check.

Scanning unzipped sets with any check-checksum options takes longer of course, since it has to recalculate the hashes. The unneeded checks have to recalculate the hashvalues, too, so scanning unzipped sets takes longer...and in most cases there is no need in scanning unzipped sets...why not keeping them zipped.

Further time intensive options are:

- settings->zipsettings->full zip structure scan
- scanner->checksums->unzip rom and check crc32/sha1/md5
- scanner->checksums->decompress chd and check sha1/md5
- scanner->checksums->rom checksum analysis->run analysis
- scanner->advanced->'fix missing' scans all sets (that's a performance killer!)
- scanner->advanced->additionally test sha1/md5 for matches
- a disabled 'use optimized rompath scanning'

Most of these options don't have to be set, so check if you use some of them and if you really need them.



Roman Scherzer

> Further time intensive options are:
>
> - settings->zipsettings->full zip structure scan
> - scanner->checksums->unzip rom and check crc32/sha1/md5
> - scanner->checksums->decompress chd and check sha1/md5
> - scanner->checksums->rom checksum analysis->run analysis
> - scanner->advanced->'fix missing' scans all sets (that's a performance killer!)
> - scanner->advanced->additionally test sha1/md5 for matches
> - a disabled 'use optimized rompath scanning'
>
> Most of these options don't have to be set, so check if you use some of them and
> if you really need them.

I've disabled all of those options, yet CMP simply won't complete the scan (even w/ fastscan!).

Hmm. I'm starting to think that having the cab files in an unzipped directory is a significant inhibitor. Has something happened to CMP in the last 2-3 months that might have made this problem worse? It never used to be this slow w/ uncompressed files.

All my MAME roms are zipped (single) and are audited very quickly.

Further info: 2.66GHz, p4

Thanks as always.

> a significant inhibitor. Has something happened to CMP in the last 2-3 months
> that might have made this problem worse? It never used to be this slow w/
> uncompressed files.


Most likely it finds a very big file which it tries to calculate hashvalues for.
Try to find out at which point it gets slow....unneeded scan....scan....or try to find the file....move some files to a new folder and scan only that one.....


...and turn off virusscanners ;)


Roman Scherzer

Hey Roman.

I downloaded all the cabinet files again from the official mame qa site and scanned. Scanning is now fast again. Thanks for the help.

Nonetheless- I still encounter issues. I've put all the files in one folder, but cmp still reports files missing:

cabinets [folder: cabinets - size: 51mb]
wrong size: endurob2.png [wrong: 29246] [right: 33580] [CRC32: 0xfa2e3b41] [not fixed]
missing rom: frogseg1.png [size: 42678] [CRC32: 0xe818e38b]
missing rom: galmidwo.png [size: 35443] [CRC32: 0x6f125910]
missing rom: gauntl12.png [size: 57036] [CRC32: 0x46f0861a]
missing rom: gt2ks100.png [size: 65385] [CRC32: 0x2eae093f]
missing rom: losttmbh.png [size: 35488] [CRC32: 0xf6d7cca3]
missing rom: mainevto.png [size: 37204] [CRC32: 0x3182c8d9]
missing rom: qberttst.png [size: 40004] [CRC32: 0xff2c9f58]
missing rom: sf2ceua.png [size: 42203] [CRC32: 0x967354d2]
missing rom: sf2uk.png [size: 34954] [CRC32: 0xde34802d]
missing rom: slyspy2.png [size: 36820] [CRC32: 0x2af322aa]
missing rom: turbob.png [size: 37468] [CRC32: 0xde0a3b80]

How is this possible when I got all files from homepage and used latest dat?

-

Also, because I use unzipped folders to store my art files, the 'drag n drop' does not allow me to rebuild unless I create a zip.

Would it be possible to add the function where cmpo rebuilds without creating a zip, and just into a normal folder?

Thanks as always!

> Hey Roman.
>
> I downloaded all the cabinet files again from the official mame qa site and
> scanned. Scanning is now fast again. Thanks for the help.
>
> Nonetheless- I still encounter issues. I've put all the files in one folder, but
> cmp still reports files missing:
>
> cabinets [folder: cabinets - size: 51mb]
> wrong size: endurob2.png [wrong: 29246] [right: 33580] [CRC32: 0xfa2e3b41] [not
> fixed]
> missing rom: frogseg1.png [size: 42678] [CRC32: 0xe818e38b]
> missing rom: galmidwo.png [size: 35443] [CRC32: 0x6f125910]
> missing rom: gauntl12.png [size: 57036] [CRC32: 0x46f0861a]
> missing rom: gt2ks100.png [size: 65385] [CRC32: 0x2eae093f]
> missing rom: losttmbh.png [size: 35488] [CRC32: 0xf6d7cca3]
> missing rom: mainevto.png [size: 37204] [CRC32: 0x3182c8d9]
> missing rom: qberttst.png [size: 40004] [CRC32: 0xff2c9f58]
> missing rom: sf2ceua.png [size: 42203] [CRC32: 0x967354d2]
> missing rom: sf2uk.png [size: 34954] [CRC32: 0xde34802d]
> missing rom: slyspy2.png [size: 36820] [CRC32: 0x2af322aa]
> missing rom: turbob.png [size: 37468] [CRC32: 0xde0a3b80]
>
> How is this possible when I got all files from homepage and used latest dat?
>
> -




The cabinets packs have been updated for 98 recently. Recheck out the mame32qa page for all data you need...

> Also, because I use unzipped folders to store my art files, the 'drag n drop'
> does not allow me to rebuild unless I create a zip.

Nonsense. ;)

> Would it be possible to add the function where cmpo rebuilds without creating a
> zip, and just into a normal folder?

You only have to disable "zip sets" in the rebuilder.



Roman Scherzer

Ok, thanks Roman- sorted!