Shadow of Mordor embb

Extraction and unpacking of game archives and compression, encryption, obfuscation, decoding of unknown files
Skykila
Posts: 7
Joined: Fri Aug 08, 2014 8:24 am

Shadow of Mordor embb

Post by Skykila »

aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Shadow of Mordor embb

Post by aluigi »

aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Shadow of Mordor embb

Post by aluigi »

A recap regarding the structure of these files and archives.
embb and tex0 are compressed, they are just a sequence of zlib chunks.
emb is an archive that contains many types of files, tex is one of them.
tex is a container of one DDS file.
There are other file types but only LTMI was a container because it embeds the file name of the original resource, the others are skel, mesh and so on.

The script makes a complete job by unpacking and extracting the files automatically, so an embb one will be unpacked in memory and all its files will be extracted.
The only thing that it doesn't do is removing the container of tex and ltmi files, you need to do that manually by reusing the script on the files extracted from the emb archive.
Skykila
Posts: 7
Joined: Fri Aug 08, 2014 8:24 am

Re: Shadow of Mordor embb

Post by Skykila »

many thanks!
raykingnihong
Posts: 71
Joined: Fri Oct 24, 2014 3:13 pm

Re: Shadow of Mordor embb

Post by raykingnihong »

aluigi wrote:http://aluigi.org/papers/bms/others/shadow_of_mordor.bms
Very good, my friends, thank you
spudmuffin
Posts: 1
Joined: Wed Jan 11, 2017 6:56 pm

Re: Shadow of Mordor embb

Post by spudmuffin »

OK, old thread. But I'm new, and having a hell of an issue with this arch05 explorer, and this script.

Particularly, some things I've noticed are 1:
-The game is PC but the script is set for PS3?
-Arch05 extract function does not seem to work. Like, I click what I want, click extract and uh...then, nothing.


So, I need to figure out how to get the actual EMBB files FROM the arch05 file.

--
I have downloaded someones embb file (player talion intro) that was linked through this site and the script worked just fine-- however, the embb doesn't have the file I'm looking for. (which can be found in corecharacter.arch05). So I guess I really need help with extracting the EMBB. Once I have that door broke through, I've alreayd used the script on one EMBB and it worked.

So, help, anyone?
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Shadow of Mordor embb

Post by aluigi »

Upload your embb file.

The script has ever worked with all the files of all the platforms as far as I remember, in fact there are no reports or complains from 2014.
Graesholt
Posts: 15
Joined: Thu Mar 02, 2017 1:54 pm

Re: Shadow of Mordor embb

Post by Graesholt »

aluigi wrote:Upload your embb file.

The script has ever worked with all the files of all the platforms as far as I remember, in fact there are no reports or complains from 2014.


Aluigi, first of all, thank you for all the things you do.
This is the second time time I'm using your software, and it is simply remarkable.

One thing, however, when trying to extract more than one .EMBB file with shadow_of_mordor.bms I encounter this error

- error in src\extra\xalloc.c line 618: xdbg_malloc()

Error: memory allocation problem
Not enough storage is available to process this command.

I am able to export the archives seperately, but reluctant to, since there are just about a million of them in the files i extracted from the original .ARCH05 files.

Is there anything I can do to resolve this?

Thank you, and thanks again, just in general...
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Shadow of Mordor embb

Post by aluigi »

First check if you are using quickbms 0.8.1 and the script 0.3.6
If you are still experiencing the problem then upload the embb file
Graesholt
Posts: 15
Joined: Thu Mar 02, 2017 1:54 pm

Re: Shadow of Mordor embb

Post by Graesholt »

aluigi wrote:First check if you are using quickbms 0.8.1 and the script 0.3.6
If you are still experiencing the problem then upload the embb file


Thank you for your answer, Aluigi.

I have confirmed that I use the versions you describe.
I encounter this problem with any number of .embb files, but only when I attempt to extract more than one.
I encounter the error with both normal QuickBMS and the over 4 gb version.

Because I am somehow unable to upload to this site, I hope it's okay to share from my dropbox instead. Here are two files that I have confirmed to produce the error on my system.
https://www.dropbox.com/s/txazr6m59ui3i ... s.rar?dl=0
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Shadow of Mordor embb

Post by aluigi »

Uhmmm no, here everything works perfectly by using command-line and gui and both one single file or a folder containing the two files you provided.
Graesholt
Posts: 15
Joined: Thu Mar 02, 2017 1:54 pm

Re: Shadow of Mordor embb

Post by Graesholt »

aluigi wrote:Uhmmm no, here everything works perfectly by using command-line and gui and both one single file or a folder containing the two files you provided.


Well ain't that just the weirdest thing?
I guess that I'll try putting it on another machine and see if it runs...

Thanks again...
Graesholt
Posts: 15
Joined: Thu Mar 02, 2017 1:54 pm

Re: Shadow of Mordor embb

Post by Graesholt »

aluigi wrote:Uhmmm no, here everything works perfectly by using command-line and gui and both one single file or a folder containing the two files you provided.


Damn, I really wish I had something else I could think of trying instead of bothering you again.
Do you have any Idea how one might overcome an issue like this?

I have tried it on a different computer now, with a fresh download of both QuickBMS and the Shadow of Mordor script.
I have tried running as admin.
I have tried anything I can think of.

Still I am able to export the files seperately, but encounter the very same error every time I attempt to unpack more than one file, whether that is two or all of them.

Is this because my machines run 64bit systems?
Sorry if that's a dumb question...
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Shadow of Mordor embb

Post by aluigi »

In my opinion it's a bug in quickbms, one of those that are difficult to catch and replicate unfortunately.
The problem is that I can do nothing if I'm unable to replicate it.
How many embb files you have in the input folder?
Graesholt
Posts: 15
Joined: Thu Mar 02, 2017 1:54 pm

Re: Shadow of Mordor embb

Post by Graesholt »

aluigi wrote:In my opinion it's a bug in quickbms, one of those that are difficult to catch and replicate unfortunately.
The problem is that I can do nothing if I'm unable to replicate it.
How many embb files you have in the input folder?


I understand that fully.

In the input folder and subfolders there are 8045 .embb files.
That would be the total I have extraced from the games .arch05 archives with new_fear.bms

However, as I say the error for some damn reason occurs regardles of me putting them all in or just two.
As long as the number of input files is greater than one.

Would any information about my system(s) be helpful?
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Shadow of Mordor embb

Post by aluigi »

Wow lot of files but if that happens even with just 2, that's not the cause of the problem.
Can you check if you have the same problem if you use the following script? It's just a "cut" of the original one:

Code: Select all

idstring "BNDL"
        get DUMMY long
        get NAMES_SIZE long
        get OFFSET long
        get ZERO long
        get OTHER_NAMES long
        get FILES long
        savepos TMP
        log MEMORY_FILE TMP NAMES_SIZE
        math OFFSET + TMP

        goto OFFSET
        for i = 0 < OTHER_NAMES
            get NAME_OFF long
        next i
        savepos OFFSET

        for i = 0 < FILES
            goto OFFSET
            get NAME_OFF long
            get SIZE long
            savepos OFFSET

            goto NAME_OFF MEMORY_FILE
            get NAME string MEMORY_FILE

            log NAME OFFSET SIZE
            math OFFSET + SIZE
        next i

After this test (both if it works or not) try also running quickbms.exe with the -9 option, you can do that from command-line or with a shortcut to quickbms.exe and adding -9 in the Target field of its properties
Graesholt
Posts: 15
Joined: Thu Mar 02, 2017 1:54 pm

Re: Shadow of Mordor embb

Post by Graesholt »

aluigi wrote:Wow lot of files but if that happens even with just 2, that's not the cause of the problem.
Can you check if you have the same problem if you use the following script? It's just a "cut" of the original one:

Code: Select all

idstring "BNDL"
        get DUMMY long
        get NAMES_SIZE long
        get OFFSET long
        get ZERO long
        get OTHER_NAMES long
        get FILES long
        savepos TMP
        log MEMORY_FILE TMP NAMES_SIZE
        math OFFSET + TMP

        goto OFFSET
        for i = 0 < OTHER_NAMES
            get NAME_OFF long
        next i
        savepos OFFSET

        for i = 0 < FILES
            goto OFFSET
            get NAME_OFF long
            get SIZE long
            savepos OFFSET

            goto NAME_OFF MEMORY_FILE
            get NAME string MEMORY_FILE

            log NAME OFFSET SIZE
            math OFFSET + SIZE
        next i

After this test (both if it works or not) try also running quickbms.exe with the -9 option, you can do that from command-line or with a shortcut to quickbms.exe and adding -9 in the Target field of its properties


Thank you so much for still looking into this.

Running the cut script, I case I did that correctly (copied it into a .txt file, changing the extension to .bms, and choosing it as the script to use when running QuickBMS), does work when choosing the two files I sent you the other day.
It produces files and does not produce any errors.

Running QuickBMS through a shortcut with the target postfix '-9' produces this error.
I assumed you would want me to choose the original shadow_of_mordor.bms script, and the same files as usual.

- error in src\utils.c line 2124: myalloc()
Error: Not enough space

Last script line before the error or that produced the error:
229 clog TEMPORARY_FILE OFFSET ZSIZE SIZE

Thanks again, and standing by (:
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Shadow of Mordor embb

Post by aluigi »

The error you got with -9 means that the input file is a compressed embb but the samples you provided were not compressed.
You should copy&paste also the lines of quickbms from the last "- open input file" till the error message.

In the meantime I have rechecked the script to see if there is any bug, maybe something in the "if" statements, but the only thing I found was a missing "cleanexit" for the "SKDB" archives that is not your case.
Graesholt
Posts: 15
Joined: Thu Mar 02, 2017 1:54 pm

Re: Shadow of Mordor embb

Post by Graesholt »

aluigi wrote:The error you got with -9 means that the input file is a compressed embb but the samples you provided were not compressed.


I'm not doubting your correctness, as you've been doing this for years, and I am so very new to it all...
I just... Don't get it...
These are the exact files I sent you, how can they be compressed on my drive, and not on yours?

aluigi wrote:You should copy&paste also the lines of quickbms from the last "- open input file" till the error message.


Do you mean like this?
- open input file D:\System\Dropbox\SoW\bundles\.\artifacts\caragath.bndlxml05
- open script D:\System\Downloads\shadow_of_mordor.bms
- set output folder C:\Users\Mathias\Desktop\SoM Output

offset filesize filename
--------------------------------------

- error in src\utils.c line 2124: myalloc()
Error: Not enough space

Last script line before the error or that produced the error:
229 clog TEMPORARY_FILE OFFSET ZSIZE SIZE
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Shadow of Mordor embb

Post by aluigi »

Definitely NOT a bug in quickbms.
"caragath.bndlxml05" that's the cause: BNDLXML05, not EMBB. A completely different format.
You told me that your input folder had only embb file while that's false as demonstrated by that file.

If you launch quickbms with the option -F "{}.embb" it will parse only the embb files ignoring all the others.

Please pay more attention next time.