Deus Ex: Human Revolution Director's Cut (Wii U) - bigfile/dlcpack files

[Ekey]

I don't know but, in addition to the archives also present bin files that contain file names, also there is a certain table after them.

[AnonBaiter]

^ Maybe we could use that too. You know, in case there are CDRM/DRM files in there.

Yeah, about that:

Code: Select all

Error: incomplete input file 0: E:\DeusEx\DeusEx\data\content\bigfile-wiiu.023
       Can't read 564069511 bytes from offset 000000001f400000.
       Anyway don't worry, it's possible that the BMS script has been written
       to exit in this way if it's reached the end of the archive so check it
       or contact its author or verify that all the files have been extracted.
       Please check the following coverage information to know if it's ok.

  coverage file 0   100%   524288000  524288000

Last script line before the error or that produced the error:
  87  log MEMORY_FILE 0 SIZE

---

- open input file E:\DeusEx\DeusEx\data\content\dlcpack-wiiu.005

- error in src\file.c line 243: fdnum_open()
Error: No such file or directory

Last script line before the error or that produced the error:
  83  open FDDE TMP

And just FYI, I've already concatenated the bigfile-wiiu files into one(bigfile-wiiu_full.000), so consider making a separate script when you're done.

[aluigi]

Script 0.3 with auto-merging of the archives if they aren't (so if you have already done the work then you are fine).

Yeah the script is really that simple

P.S.: the names are a lot less than the files (for example 1778 vs 37512) so are totally useless.

[AnonBaiter]

Well, so I should already use the concatenated file into the script, right? Okay then. I'll post you the results when I'm done testing.

EDIT: Well, your script did everything an all but what about this:

Code: Select all

  0000000091aaf800 120001     0000000000005fe0.dat

Error: incomplete input file 0: E:\DeusEx\DeusEx\data\content\dlcpack-wiiu\TEMPORARY_FILE
       Can't read 64 bytes from offset 0000000091aaf800.
       Anyway don't worry, it's possible that the BMS script has been written
       to exit in this way if it's reached the end of the archive so check it
       or contact its author or verify that all the files have been extracted.
       Please check the following coverage information to know if it's ok.

  coverage file 0    61%   1495598908 2443841536

Last script line before the error or that produced the error:
  53  log "" OFFSET SIZE

It also affected the merged file:

Code: Select all

Error: incomplete input file 0: E:\DeusEx\DeusEx\data\content\bigfile-wiiu_full.000
       Can't read 64 bytes from offset 000000034dac1000.
       Anyway don't worry, it's possible that the BMS script has been written
       to exit in this way if it's reached the end of the archive so check it
       or contact its author or verify that all the files have been extracted.
       Please check the following coverage information to know if it's ok.

  coverage file 0     0%   6239978    13845485568

Last script line before the error or that produced the error:
  53  log "" OFFSET SIZE

[aluigi]

Yes, it's enough that it has the 000 extension because the script checks it in any case.

[AnonBaiter]

Well, that makes sense. I'll see if it works with the bigfile-wiiu files now.
But the dlcpack-wiiu's extracted filesize is far beyond the splitted files(about 2.27GB in total of 5 files, 3,66GB when extracted if you include the TEMPORARY_FILE), so do you think these are compressed? Wait...

EDIT: Same issue:

Code: Select all

  000000034dac1000 50393      000000000000007f.dat

Error: incomplete input file 0: E:\DeusEx\DeusEx\data\content\bigfile-wiiu\TEMPORARY_FILE
       Can't read 64 bytes from offset 000000034dac1000.
       Anyway don't worry, it's possible that the BMS script has been written
       to exit in this way if it's reached the end of the archive so check it
       or contact its author or verify that all the files have been extracted.
       Please check the following coverage information to know if it's ok.

  coverage file 0     0%   6239978    13845485568

Last script line before the error or that produced the error:
  53  log "" OFFSET SIZE

[aluigi]

Mah honestly I think I will give up because I see nothing wrong in the script.
If and when someone will have a full description of the file format, I will update the script.

[Ekey]

Code: Select all

    get DUMMY short # 0xffff
    get DUMMY short

must be DWORD because it's language ID

[AnonBaiter]

Ekey, now that you`ve provided some insight on the files why don`t you take a shot at writing a script based on aluigi`s work?
Or maybe I could just edit it myself, I don't know...

[Ekey]

Because we must first understand how to get number of archive. For example

Code: Select all

File: wiiu-w\audio\streams\vo\eng\global_barks\npcs\security_guard\mb02\barks\uni_bsecguard02_brk_audiominorbreakingobject_001.mul
Offset: 0x1348000
Size: 149653

This file is stored in the dlcpack-wiiu.004 archive with correct offset 0x1348000, but in TEMPORARY_FILE this file at offset 0x7E31C000. Joining parts in one big file totally useless.

[AnonBaiter]

So what do you suggest?

[Ekey]

Well, seems i'm found solution for detect id of archives. I will share it after a some tests

[AnonBaiter]

Got anything so far?

[Ekey]

Ok, here my solution. It works perfect. I was so tired and I think aluigi can make complete bms script.

[aluigi]

Excellent work.
I have updated the script on the fly to version 0.4.

I have noticed that the format you used there differs than the provided samples so I added a variable in the script to set to 1 for handling the hash value in the toc rather before it (Deux Ex).

[AnonBaiter]

I've tested the 0.4 script with the "dlcpack-wiiu" and it extracted everything. Thanks Ekey and aluigi!

Now what about the filename situation?

[Ekey]

I will make relative list with filenames, but later.

[AnonBaiter]

Now onto the "bigfile-wiiu" files:

Code: Select all

  0000000009be2800 952969605  0000000000009ce1.dat

Error: incomplete input file 1: E:\DeusEx\DeusEx\data\content\bigfile-wiiu.020
       Can't read 927744 bytes from offset 000000001f400000.
       Anyway don't worry, it's possible that the BMS script has been written
       to exit in this way if it's reached the end of the archive so check it
       or contact its author or verify that all the files have been extracted.
       Please check the following coverage information to know if it's ok.

  coverage file 1    68%   360831040  524288000

Last script line before the error or that produced the error:
  60  log "" OFFSET SIZE 1

Looks like an error has appeared...

[Ekey]

Code: Select all

  0000000009be2800 952969605  0000000000009ce1.dat

Error: incomplete input file 1: E:\DeusEx\DeusEx\data\content\bigfile-wiiu.020
       Can't read 927744 bytes from offset 000000001f400000.
       Anyway don't worry, it's possible that the BMS script has been written
       to exit in this way if it's reached the end of the archive so check it
       or contact its author or verify that all the files have been extracted.
       Please check the following coverage information to know if it's ok.

  coverage file 1    68%   360831040  524288000

Last script line before the error or that produced the error:
  60  log "" OFFSET SIZE 1

Strange

[aluigi]

@Ekey
Maybe it's a file splitted between 2 archives?