[PS4] Dirt 5 .dat files

[eclipse00074]

Hello! I need help to unpack files from .dat and pack back the modified ones. Here a .zip archive that contains a sample .dat file (0_DISC_INIT.dat).
Also here is a link to dat.ndx, maybe it contains all the filenames that are in .dat
https://www.mediafire.com/file/936xyj88 ... x.zip/file

[aluigi]

I'm quite sure to have already seen this format in the past since I remember the index file located in a sub-folder of the dat archives.
Anyway I made a new script from scratch:
http://aluigi.org/bms/dirt5.bms

Just select dat.ndx and it will do the rest.

Most of the files are without name and it's normal because they are not referenced so I decided to extract them anyway (maybe there is some old/hidden content)

[eclipse00074]

I'm quite sure to have already seen this format in the past since I remember the index file located in a sub-folder of the dat archives.
Anyway I made a new script from scratch:
http://aluigi.org/bms/dirt5.bms

Just select dat.ndx and it will do the rest.

Most of the files are without name and it's normal because they are not referenced so I decided to extract them anyway (maybe there is some old/hidden content)

Thanks a lot for the script! Sorry for the late respond, only now I saw your post. It worked, but there are a couple of problems =(
1. In process of unpacking files at some point the following error appears: https://imgur.com/Mrtmobx But there is no 9_DISC_XB.dat file in the dat folder. That's all we have:

Code: Select all

0_DISC_INIT.dat
1_DISC_DEV.dat
2_DISC_FPX.dat
3_DISC_FPX.dat
4_DISC_ARC.dat
5_DISC_ARC.dat
6_DISC_ARC.dat
7_DISC_AUC.dat
8_DISC_PS.dat
11_DISC_OTH.csv
11_DISC_OTH.dat
12_DISC_OTH.csv
12_DISC_OTH.dat
13_DISC_OTH.csv
13_DISC_OTH.dat
14_DISC_OTH.csv
14_DISC_OTH.dat
15_DISC_OTH.csv
15_DISC_OTH.dat
16_DISC_OTH.csv
16_DISC_OTH.dat
17_DISC_OTH.csv
17_DISC_OTH.dat
18_DISC_OTH.csv
18_DISC_OTH.dat
19_DISC_OTH.csv
19_DISC_OTH.dat
datfiles.version

2. It seems all the *.cfg or *.json or other text files are not readable (encrypted or compressed?). I've attach the zip archive with some of this files.

Is any chance to extract all files from .dat and make them readable? (*.cfg, *.json etc)

And thanks again for your hard work! Many times your scripts helped me to modify games =)

[x1SlowSBCx]

I get this error trying to unpack them:- enter in folder C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index
- open input file C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index\../0_DISC_INIT.dat

- error in src\file.c line 615: fdnum_open()
Error: No such file or directory

Last script line before the error or that produced the error:
66 open FDSE TMP 1
coverage file 0 100%! 34995622 28926946 . offset 005c99f4
coverage file -1 80% 6421746 7928470 . offset 0078fa96

Press ENTER or close the window to quit

Edit: I tried a different method now i get a different error: - enter in folder C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index
- open input file C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index\../0_DISC_INIT.dat
00000008 83849 00000000.dat

Error: incomplete input file 1: C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\0_DISC_INIT.dat
Can't read 64 bytes from offset 00000008.
Anyway don't worry, it's possible that the BMS script has been written
to exit in this way if it's reached the end of the archive so check it
or contact its author or verify that all the files have been extracted.
Please check the following coverage information to know if it's ok.


Last script line before the error or that produced the error:
70 log NAME OFFSET SIZE 1

- OFFSET 0x00000008
- SIZE 0x00014789
coverage file 0 100%! 34995622 28926946 . offset 005c99f4
coverage file -1 80% 6421746 7928470 . offset 0078fa96

Press ENTER or close the window to quit

[aluigi]

Please upload the index file.

[x1SlowSBCx]

the website says .ndx isnt allowed

[LokiReborn]

the website says .ndx isnt allowed

you can put it in a zip or add .bin to extension etc.

[x1SlowSBCx]

its too big, its 28mb

[aluigi]

Why don't you just use a file sharing website like mega, mediafire, dropbox, google drive, or any of the thousands available nowadays?

[restyy1967]

Why don't you just use a file sharing website like mega, mediafire, dropbox, google drive, or any of the thousands available nowadays?

I have uploaded the file. Is it possible this file unpack ?


https://www.mediafire.com/file/kixlflot ... at.7z/file

[aluigi]

The script seems to be correct and it expects 0_DISC_INIT.dat to be 931 Mb, isn't that size?
Can you provide a screenshot or directory list of the files in "C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat" ?

[x1SlowSBCx]

https://imgur.com/a/sjtePzz
https://imgur.com/a/Gf1DSSS
Heres the NDX file.
https://mega.nz/file/jBlCnBrZ#QHQ2nR3el ... d8EYjsQ4HE
Heres the error i get
https://imgur.com/a/wMJWpvq
Thanks

[aluigi]

Here is the explanation:
dat.ndx is a sort of incremental index file, everytime there is a patch that modifies or removes the "dat" archives, the new information are appended to this dat.ndx and the old information are simply made "unavailable" by setting FILE_ID to 0xffffffff.

For example the problem with 0_DISC_INIT.dat may have been caused by this patch https://steamdb.info/patchnotes/6239635/ that indeed seems to delete its content (and therefore keeping a 0bytes file), which is now like the one you took in the screenshot: https://steamdb.info/depot/1038251/

Long story short I just updated the script by checking if the filename is valid because I have no other simple way to check FILE_ID 0xffffffff handled in two different locations of the script, but the result is correct:
http://aluigi.org/bms/dirt5.bms

[x1SlowSBCx]

Interesting. So i ran the new script and this is what i got.
https://imgur.com/a/gr2PFTy

[aluigi]

Are you using the new script 0.1.1?

Code: Select all

# Dirt 5 NDX/DAT (script 0.1.1)

[x1SlowSBCx]

Are you using the new script 0.1.1?

Code: Select all

# Dirt 5 NDX/DAT (script 0.1.1)

Ya, and i just double checked. Maybe im doing something wrong?

[aluigi]

I don't know what to say because I redownloaded the script and it works correctly in my test.
For sure it's impossible that it tries to dump the file 00000000.dat because there is a line in the script (line 65 'if NAME != ""') that doesn't allow empty skips empty filenames like the one in your screenshot.

[x1SlowSBCx]

Hmm. Ill try and reinstall the game maybe??

[aluigi]

Why reinstalling the game? It's a problem of the script.

Are you sure that the last screenshot is the correct one?
As already said, it's impossible that you get that error so maybe you posted an old screenshot?

[x1SlowSBCx]

idk maybe the files were messed up somehow... anyways yep i just ran it again its the same error. Interesting.