The Division sdfdata Files

Extraction and unpacking of game archives and compression, encryption, obfuscation, decoding of unknown files
Ehnoah
Posts: 51
Joined: Tue Jan 26, 2016 12:45 pm

The Division sdfdata Files

Post by Ehnoah »

There are 2 Types of SDF Data. One Streaming and one Non-Streaming.

The Non Streaming seems to come with a Index File + Splitted archives simlar to Black Desert?
The Streaming Files are splitted in a Global Folder + TileFile + streaming TileFolder like: tile0000x0000x0000 / 0000x0001x0000 (so Chunks I guess)

So my Guess: Streaming Files = Map Files, like Objects etc. and non-Streaming to be the "Main" Archives.



Streaming File Example:
http://www9.zippyshare.com/v/aWwkjjyp/file.html

Non Streaming File Example:
http://www9.zippyshare.com/v/BumJbPRt/file.html
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: The Division sdfdata Files

Post by aluigi »

What horrible format.
Use offzip on the sdfdata archives and you will be able to dump everything.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: The Division sdfdata Files

Post by aluigi »

Exact command:
offzip -a -c 0x10000 FILE.sdfdata output_folder
Ehnoah
Posts: 51
Joined: Tue Jan 26, 2016 12:45 pm

Re: The Division sdfdata Files

Post by Ehnoah »

Thanks working. But that are crazy lot of small Kilobyte Files :D

Is the sdf.sdftoc a Index File? With Filenames etc.?

Edit: The 100 MB + Files seems not to work with this Method. Says no ZIP or different etc.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: The Division sdfdata Files

Post by aluigi »

Unfortunately I don't have alternatives at the moment.
bulihack
Posts: 2
Joined: Fri Feb 05, 2016 8:11 am

Re: The Division sdfdata Files

Post by bulihack »

The sdf.sdftoc seem to be the index, and offzip (great tool) has revealed it contains deflate data format, but there's something wrong with the output stream because the result looks fragmented. Could be the actual data is encrypted/malformed perhaps?

Here is the original sample:
http://www95.zippyshare.com/v/dOAzmw1F/file.html
Last edited by bulihack on Fri Feb 05, 2016 9:24 pm, edited 1 time in total.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: The Division sdfdata Files

Post by aluigi »

It's the way in which the data is stored in the compressed sdftoc file.
Probably a way to save space by not replicating parts of filenames or something similar.
bulihack
Posts: 2
Joined: Fri Feb 05, 2016 8:11 am

Re: The Division sdfdata Files

Post by bulihack »

https://db.tt/WmZev35p

Sounds reasonable actually, but i don't think that would be the case, since words like .mwidget are appear many times (instead of referencing one chunk), but some letters are missing from the begin eg. hangelist.txt instead of changelist.txt, and sometimes these fragments here that very odd, like "foN ... ano ... -ceman/".
using quickbms with the comtype_scan2 can also unpack the same content (1) from the raw chunk extracted by offzip -A, and it results the same so it is not an offzip specific issue after all. i also have found that at the end of the compressed stream there are leftovers from the original file remain. could some extra fragments at the end can affect the whole content (10mb) when decompressing it?
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: The Division sdfdata Files

Post by aluigi »

It's not a decompression error if that's what you mean.
zlib is safe because it's a container for a deflate (non safe) stream with crc checking.
dima00910
Posts: 1
Joined: Sun Mar 27, 2016 10:46 am

Re: The Division sdfdata Files

Post by dima00910 »

Hello. Maybe someone can help, how to get the models of buildings from the game The Division?
In the game folder there are files with the extension "SDFDATA", it seems to me just the same, and there are all the different models of the game, how do I get these models?
Ekey
Posts: 1383
Joined: Sat Aug 09, 2014 2:34 pm

Re: The Division sdfdata Files

Post by Ekey »

nep05
Posts: 1
Joined: Sun May 08, 2016 7:58 pm

Re: The Division sdfdata Files

Post by nep05 »

Can anyone Help me out how do i Extract the Sound Files from the .sdfdata File with the Original File Name Output?
I know how to Extract them with VGMToolBox but they gave me Random Names of it without a Folder Structure.

Or is there another Way tp Extract the Whole Game with the Original Folder Structure=?
Im new on this so im very Happy if someone could Help me.