Problem with witcher 3 bundle files

[t_ice]

Hey, good day to all people reading this. And also huge thanks to aluigi for making this program this useful.

Currently i'm working on a localisation project for witcher 3. Since there's a tool for "w3strings" file types, i managed to translate normal in-game subtitles.

but w3string files doesnt include in-game rendered video subtitles so i had to stop the project.

But i discovered QuickBMS and extracted the movies.bundle located in the witcher 3 files and i managed to to get some of subtitle files.

Problem is program extracts %99 of the files and i have the other %1.

So i want to ask aluigi or other well informated ppl, is there anyway to extract these subtitles also? because they are there along with other subtitle files but they didnt extracted because of %1

My english writing could be bad but i'll try to explain it via pictures also,

Here i'm extracting the movies bundle and program is wonderfully extracting %99 of it.



here is some of the extracted files,



As you can see st6, 7, 8,9 and some other subtitle files are missing and these files are probably in the missing %1 which quickbsm tells.

So i really need these files, somebody could help me maybe? i would really appreciate

[aluigi]

From an "extraction" point of view, it seems all ok because that 99% is correct.
Hope other users can help you with the subtitles.

[t_ice]

I hope man, i hope. I would really like to translate these subtitles to but i cannot find them anywhere.

i tried to decodec usm video file to m2v and watch the video and it wasn't subtitled so subtitles are not embeded with video , but still they are nowhere to be found

do you have any idea where these other subtitle files could be? can you give me some leads to find them or where to search them?

[aluigi]

I don't even have the game
As far as I know there is a HUGE modding community behind this game, are you really sure nobody else is working on the same thing?

[t_ice]

no sadly. im in turkey and im the first one to start a localisation project.

other modder groups and people are afread to start this project because of lack of modding tools. i only have w3string editor which allows me to edit normal subtitle files in the game (about %99) But it is still an uncomplete tool and hasn't got a proper dialouge order.

and on the other half, this is my problem too as you can see. cutscene subtitles are not translateable right now.

[aluigi]

Have you read the other threads and forums about this game?
viewtopic.php?p=6859#p6859

[theendoffear]

Hello t_ice, sorry for a bit late, but I think I've answer for your question if you didn't figure it out already. Those subtitles you extracted are "alternative" subtitles for the game progess, the main subtitles were "muxed" inside the .usm files (like .mkv). So I think you might need to learn how to make .usm file from scratch for your translation.

P/s: Thank you so much, aluigi, for making this game and many other games mod-able

[t_ice]

Yeah bro... they were alternative really. just sample like subtitles.

thankfully i just opened these USM files via cheat engine, and subtitles were directly READ-ABLE and change-able. of course i cannot type more than the original line. but still editable.

again thx to you, aluigi and other people contribute and share experience thorughout forums

[gbaoye]

Yeah bro... they were alternative really. just sample like subtitles.

thankfully i just opened these USM files via cheat engine, and subtitles were directly READ-ABLE and change-able. of course i cannot type more than the original line. but still editable.

again thx to you, aluigi and other people contribute and share experience thorughout forums

First, my English is very bad
You and I encountered the same problem
If you solve
I want you to tell me the method
thank you very much

[Savage]

Hi! i don't know if it's a problem, actually i made some tests.

I cleared some files and reimported to a big bundle, then i reimported againg the original files, i checked the MD5 and i had an error, looks the reimporter changes the compression of the zlib files, then we have a different CRC, i don't know if the game will work if the crc is not the same

Example of the original file

xœí]|SÕ÷¿é¢Œ²WÙ{)ÝŒ–6m¡Ì

Example of the same file reimported using the script http://aluigi.altervista.org/bms/witcher3.bms

xÚì]\GÛŸ;Š¨ XPQP±`1"Ý(VT

As you can see the header of the zlib is not the same,that means the compression of the reimportation is not the same too, this is why i had a different CRC.

Maybe is nothing and the game works, any idea? suggestions?

Now extracted the data from the "injected" bundle with the same bms, compared the MD5 of very file and i had

Errors: 43

43 files (of 13561) unpacked have an error checking the MD5 of all of them, looks the reimportation is not working well?

[aluigi]

It's not a problem. Different deflate libraries with different settings give different compressed data.
The reimporting feature simply replaces the original data, doesn't change the crc or hash fields.

[Savage]

Hi, how i can extract the data (from the .bundle files) without decompression? i just want to check the size of the compressed files
Thanks!

[Savage]

Never mind, i already solved , works great

[Savage]

It's not a problem. Different deflate libraries with different settings give different compressed data.
The reimporting feature simply replaces the original data, doesn't change the crc or hash fields.

I changed some non-zlib files using Zopfli, the importation worked, but if i try to extract with bms script i get error, looks is searching for the original compression.

Question:
If we change the non-zlib files compressed to Zopfli the game will work?

[aluigi]

If you change also the ZIP field in the file to 1, probably yes.
It's the last 32bit field at the end of each file entry, use quickbms -V to see the offset and make the test.

You can even change it on the original archive and then use quickbms in reimport mode which will do automatically all the job since quickbms uses zopfli or kzip

[Savage]

You means change ?

if ZIP == 0
log NAME OFFSET SIZE
elif ZIP == 1
comtype zlib
clog NAME OFFSET ZSIZE SIZE
elif ZIP == 2
comtype snappy
clog NAME OFFSET ZSIZE SIZE
elif ZIP == 2
comtype doboz
clog NAME OFFSET ZSIZE SIZE
else # 4 and 5
comtype lz4
clog NAME OFFSET ZSIZE SIZE
endif

for

if ZIP == 1
log NAME OFFSET SIZE
elif ZIP == 1
comtype zlib
clog NAME OFFSET ZSIZE SIZE
elif ZIP == 2
comtype snappy
clog NAME OFFSET ZSIZE SIZE
elif ZIP == 2
comtype doboz
clog NAME OFFSET ZSIZE SIZE
else # 4 and 5
comtype lz4
clog NAME OFFSET ZSIZE SIZE
endif

I tried and i get this error

0000000000424000 1382 characters\models\common\woman_average\body\model\
woman_old__body_a01.xbm
Info: algorithm 249
offset 0000000000424000
input size 0x0000000000000566 1382
output size 0x0000000000000566 1382
result 0xffffffffffffffe9 -23

Error: the uncompressed data (-23) is bigger than the allocated buffer (1382)

Last script line before the error or that produced the error:
40 clog NAME OFFSET ZSIZE SIZE

If i make this change

if ZIP == 0
log NAME OFFSET SIZE
elif ZIP == 1
comtype zlib
clog NAME OFFSET ZSIZE SIZE
elif ZIP == 2
comtype snappy
clog NAME OFFSET ZSIZE SIZE
elif ZIP == 1
comtype doboz
clog NAME OFFSET ZSIZE SIZE
else # 4 and 5
comtype lz4
clog NAME OFFSET ZSIZE SIZE
endif

elif ZIP == 1
comtype doboz

It crashes too but some data is extracted

000000000090e000 2310164 animations\animals\wolf\wolf_animation.w2anims
Info: algorithm 249
offset 000000000090e000
input size 0x00000000000b646f 746607
output size 0x0000000000234014 2310164
result 0xfffffffffffffff5 -11

Error: the uncompressed data (-11) is bigger than the allocated buffer (2310164)


Last script line before the error or that produced the error:
40 clog NAME OFFSET ZSIZE SIZE

[aluigi]

Oh no no.
I mean hex editing the archive.

[Savage]

Sorry but i don't get it

Where i need to make the change?

I attach an small example compressed with zopfli

[aluigi]

How big is the archive?
If you can upload it, I will show you what I mean step-by-step.

If it's too big, the first 10mb should be enough.

[Savage]

splited blob.bundle file (10mb's)
http://www64.zippyshare.com/v/yD6SO1a6/file.html

Full file blob.bundle (131Mb's) uncompressed (297mb's)
http://www110.zippyshare.com/v/NyWj7105/file.html