Far Cry 4 "Dunia" .fat/.dat archives

Extraction and unpacking of game archives and compression, encryption, obfuscation, decoding of unknown files
jbeckman
Posts: 7
Joined: Sat Nov 01, 2014 3:56 pm

Far Cry 4 "Dunia" .fat/.dat archives

Post by jbeckman »

The UPlay preload data is not encrypted so the files are fully accessible although the main binaries (The Dunia .dll file and game exe.) are missing.

I would like to take a look into the settings xml files similar to Far Cry 3 and Watch_Dogs and the easiest way for that would be to be able to unpack the common.dat/common.fat archive to access said files directly although I can see the contents partially via a hex editor.

Seeing how it worked for Far Cry 3 and Watch_Dogs I guess the file names will need a lot of work to be found but just being able to extract the files would be good.

And with that here's the common .dat / .fat archive.
http://www76.zippyshare.com/v/48521402/file.html

Game won't unlock until Tuesday and Ubisoft already has two patches planned (First one being prepared on Monday.) although it will probably affect the patch .dat / .fat file primarily (And the game exe and .dll file.) if it works similar to previous Dunia engine games.

There's no real hurry though, I understand that these things can take time. :)



EDIT: How curious, I decided to try and run the files through Gibbed's tools for Dunia 2 (rev179 I think the latest version is.) and it seems to have extracted the archive, interesting but good news. :)
(EDIT: That would be these. -> http://svn.gib.me/builds/dunia2/ )
Last edited by jbeckman on Sun Nov 16, 2014 1:49 pm, edited 1 time in total.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by aluigi »

Thanks for the informationb, I have updated my script although I guess there is other stuff to fix later.
jbeckman
Posts: 7
Joined: Sat Nov 01, 2014 3:56 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by jbeckman »

I was really surprised that the Dunia 2 tools by Gibbed worked so well but I guess the file format for these archives wasn't altered much if at all, there's a lot of unknown files of course but both packing and repacking appears to work although I can't yet test this in the actual game until it unlocks in two days time.

Speaking of unlocking the game the leaked binary files will allow the game to be started already but personally I'll wait until it unlocks properly on Tuesday as going by the upcoming patch notes for 1.1.0 (and 1.2.0) and by comments from people who have actually played the game it seems to be pretty buggy currently.
(1.1.0 is planned for release on Monday before the game unlocks but I don't know when the other patch is planned to be released, it's kinda strange how the UPlay preload data has these patch notes but is still at version 1.0.0, weird.)

I don't think these two upcoming patches will affect the current ability to pack and unpack data so modifying the game should still be possible although there's also other files in these .dat/.fat archives which will need other utilities to edit since not everything will be plain text lua and xml and there's also the texture, model and audio formats although I believe the textures at least are in the .XBT format so converting them to .DDS shouldn't be too difficult.

Will download your script for the .fat/.dat format and test it, I'm really glad the archives can already be extracted although I'm not much of a modder myself but if it works like Watch_Dogs and Far Cry 3 I'm going to tweak a few of the settings which can't otherwise be changed such as removing the FXAA effect to lessen screen blur for example.
(I would guess that this should also help people who want to localize the game to other languages.)

EDIT: The BMS script appears to work without issue on the archives I've tried it on.
lostprophet
Posts: 49
Joined: Thu Sep 04, 2014 9:34 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by lostprophet »

The Dunia 2 tools extract common.dat/.fat perfectly, but for example patch.dat/.fat gives an error halfway through. I contacted Rick about supporting Far Cry 4.
Also I contacted the guy, who made the localization of Far Cry 3 and Blood Dragon possible, I'll post it here, if they write back.
Savage
Posts: 176
Joined: Thu Oct 02, 2014 4:58 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by Savage »

Hi!, i tried the script fat2_fat3.bms and work great but looks some files are missing, maybe i'm wrong but the file fcc_main.dat it's 9,19 Gb's and the data extracted are 11,11 Gb's, less than 2gb's using LZO?

Total extracted files 118.852. i dont' get any error and the reimport works great, maybe the bms miss some files?

Thanks.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by aluigi »

There are a couple of test you can do to verify if everything has been extracted:

1)
Check the coverage of file 1 reported by quickbms

2)
Use the following script to compress all the files and then check the size of the output folder:

Code: Select all

comtype lzo1x_compress
get SIZE asize
get NAME filename
clog NAME 0 SIZE SIZE
quickbms script.bms input_folder output_folder
Savage
Posts: 176
Joined: Thu Oct 02, 2014 4:58 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by Savage »

Ok, files compressed again using your script and...it's 7,80 Gb's not 9 Gb's..looks some files are missing?
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by aluigi »

Or maybe the developers used lzo1x_1_compress instead of the better lzo1x_999_compress used in quickbms.
On so big archives it's difficult to know if there is something missing or not but the script doesn't seem to have missing parts and FAT2 doesn't use chunks, so I don't see errors.
In case of a bad offset, zsize or size field, lzo will return an error so if you extracted everything it means that everything was correct.
chiconspiracy
Posts: 1
Joined: Wed Nov 26, 2014 12:52 am

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by chiconspiracy »

Has anyone had any further luck with extracting? Using the current 179 version Dunia tools, but much seems to be missing still. I did weapons modding in Farcry 2 and 3, and would sacrifice a thousand kittens to be able to unpack whatever folder has the weapons data.
El Duderino
Posts: 14
Joined: Fri Aug 08, 2014 12:30 am

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by El Duderino »

I saw all the weapon names in one of the fcb files, but I don't recall which one.
I also tried to find the weapon models, but they could be in one of the other dat files I didn't extract.
If you're using Windows, use grepWin to search inside all the files: http://stefanstools.sourceforge.net/grepWin.html
Just make sure "Include binary files" is checked.
birseysoylicem
Posts: 3
Joined: Mon Dec 15, 2014 11:14 am

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by birseysoylicem »

Far cry 4 ps3 files common.dat/fat archive

link; https://www.mediafire.com/?abbn9b6c4315d24

how to unpack/ pack archive ? please help.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by aluigi »

Script updated to version 0.1.2.
I hope to have not broken the compatibility with other games and versions :D
jbeckman
Posts: 7
Joined: Sat Nov 01, 2014 3:56 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by jbeckman »

EDIT: Turns out the files were just damaged, no changes to the file format with this patch.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by aluigi »

Apparently Far Cry Primal is not compatible with my script.
The reason is ZTYPE 2 which appears to be lz4 but probably an old version of the algorithm because decompression fails with quickbms.
FartingSquirrel
Posts: 4
Joined: Fri Mar 18, 2016 11:02 am

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by FartingSquirrel »

Are you gonna make it compatible with Primal? That would be awesome! :)
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by aluigi »

Without knowing what variant of lz4 is used, I can't update the script.
FartingSquirrel
Posts: 4
Joined: Fri Mar 18, 2016 11:02 am

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by FartingSquirrel »

aluigi wrote:Without knowing what variant of lz4 is used, I can't update the script.

Are there any news about that lz4? Should we expect something? :/
volfin
Posts: 4
Joined: Thu Dec 01, 2016 1:10 am

Re: Far Cry 4 "Dunia" .fat/.dat archives

Post by volfin »

http://forum.xentax.com/viewtopic.php?p=124859#p124859

Another Ubi title is using modified LZ4. Might also work with Primal.