Criminal Girls data.dat file

Extraction and unpacking of game archives and compression, encryption, obfuscation, decoding of unknown files
jse
Posts: 3
Joined: Wed Aug 24, 2016 6:56 pm

Criminal Girls data.dat file

Post by jse »

Hello all, I'm trying to extract the game files from a Hong Kong version of Criminal Girls invite only. It seems all the games data is in an archive file called data.dat which is around 1.5gb big. I googled around and tried using this application https://tlwiki.org/index.php?title=Tools#ExtractData it errors when i open the file with it, but then offers to scan the file, and finds some .wav and .png files in it, when i try to extract these files all the .wavs are corrupt and the size all all extracted files is 90mb so it's not a complete dump. Opening the file in a hex editor it appears the format is PS3FS_V1. Does anyone have any idea how I can extract this file? I can post it somewhere if someone wants to take a look at it. Thanks in advance for any and all help.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Criminal Girls data.dat file

Post by aluigi »

Use the following script for QuickBMS on that big file and upload the 2 files it generates:
http://aluigi.org/bms/filecutter.bms
jse
Posts: 3
Joined: Wed Aug 24, 2016 6:56 pm

Re: Criminal Girls data.dat file

Post by jse »

Thanks for the quick response aluigi, here are the files it generated https://www.sendspace.com/file/oora2t
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Criminal Girls data.dat file

Post by aluigi »

sendspace is down from here today, can you use mediafire or mega.nz?
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Criminal Girls data.dat file

Post by aluigi »

ok now it works, hold on.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Criminal Girls data.dat file

Post by aluigi »

jse
Posts: 3
Joined: Wed Aug 24, 2016 6:56 pm

Re: Criminal Girls data.dat file

Post by jse »

Thanks very much aluigi yourt script worked like a charm :)
When im done modding files how can I rebuild the data.dat file?
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Criminal Girls data.dat file

Post by aluigi »

QuickBMS supports the reimporting feature but in this case the format is so simple that it's possible to make a rebuilder very quickly.
Something like this:

Code: Select all

# WHAT YOU MUST SELECT FROM QUICKBMS:
# 1) script.bms
# 2) the input file is ignored, select the same script
# 3) the output folder is the folder containing the files to pack

set OUTPUT_ARCHIVE string "NEW_DATA.DAT"
for FILES = 0
    # copy&paste code
    scanDir "." NAME SIZE       # get the file from the current folder
    if NAME == ""               # no other files are available
        break
    endif
    open "." NAME
    string NAME << 2            # remove ".\"
    if NAME != OUTPUT_ARCHIVE   # in case the archive already exists (not necessary)
    # end of copy&paste code

        putarray 0 FILES NAME
        putarray 1 FILES SIZE
        math FILES + 1
    endif
next

log MEMORY_FILE  0 0
putdstring "PS3FS_V1" 8 MEMORY_FILE
put FILES longlong MEMORY_FILE
savepos TMP MEMORY_FILE
xmath OFFSET "TMP + (FILES * (0x30 + 8 + 8))"
for i = 0 < FILES
    getarray NAME 0 i
    getarray SIZE 1 i
    string NAME R \ /
    putdstring NAME 0x30 MEMORY_FILE
    put SIZE longlong MEMORY_FILE
    put OFFSET longlong MEMORY_FILE
    math OFFSET + SIZE
next i

log OUTPUT_ARCHIVE 0 0
append
get SIZE asize MEMORY_FILE
log OUTPUT_ARCHIVE 0 SIZE MEMORY_FILE
for i = 0 < FILES
    getarray NAME 0 i
    open "." NAME
    get SIZE asize
    log OUTPUT_ARCHIVE 0 SIZE
next i
append
neptuniapp
Posts: 22
Joined: Sat Aug 27, 2016 11:58 pm

Re: Criminal Girls data.dat file

Post by neptuniapp »

Can you upload the data.dat please?
neptuniapp
Posts: 22
Joined: Sat Aug 27, 2016 11:58 pm

Re: Criminal Girls data.dat file

Post by neptuniapp »

I have two problems ,

When I unpack the file, there are two files with the same name ( src ) what should I do? rename ? skip?...

When I package , after spending some time working he says:

-error in src\extra\xalloc.c line 704: xdbg_realloc()

Error: memory allocation problem

Can somebody help me? Thanks.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Criminal Girls data.dat file

Post by aluigi »

Regarding the same name, yes select 'r'ename to automatically rename all the duplicates.
Maybe then check them manually to see what are the differences.

Regarding the rebuilding problem I have just updated the script of the previous post that no longer uses memory.
neptuniapp
Posts: 22
Joined: Sat Aug 27, 2016 11:58 pm

Re: Criminal Girls data.dat file

Post by neptuniapp »

Thanks , works !!
neptuniapp
Posts: 22
Joined: Sat Aug 27, 2016 11:58 pm

Re: Criminal Girls data.dat file

Post by neptuniapp »

My packaging does not work in ps vita . Is the original packaging is not distributed in folders ? unpacking are 5247 files without folders. I imagine if the packaging is not the same as the original packaging will not work.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Criminal Girls data.dat file

Post by aluigi »

The only missing thing is the alignment which is not available in the rebuilding script, maybe the game refuses to run if the alignment is wrong (strange but it's possible).
Or maybe the game checks the hash or checksum of the package.
Anyway I support only the extraction scripts, that one was just a quick test that works with the extraction script.
Maybe someone else wants to make a better rebuilder and moreover wants to work on that game and do all the tests.