Game Maker Studio data.win format - An idea for a tool

Extraction and unpacking of game archives and compression, encryption, obfuscation, decoding of unknown files
The_Reaper_CooL
Posts: 69
Joined: Sat Dec 05, 2015 2:31 pm

Game Maker Studio data.win format - An idea for a tool

Post by The_Reaper_CooL »

Hey there people!

I've started researching Game Maker Studio's data.win file, and thought I'd share some stuff with you.

Lately I've been into translating Game Maker Studio games, but I quickly realised that it's not an easy task, yet I still want to continue on. Looking on the Internet I've found out that some people have managed to translate Undertale into Spanish language. Since Undertale is a GMS game, I wanted to ask the person in charge of the localization on how to do what he did. To my surprise he wrote a complete tutorial on it, and I've read it thoroughly.

Sadly I can't test my theories yet, but I'll post if what I have discovered is true or not. But I know these things are certain, and someone more talented than me could create a universal program for data.win files (IF I'm not mistaken, that is).

My game in question would be Fran Bow, I'd localize that first, but I'm not looking for a tool for just this one game, I'm looking for a universal one for all GMS games (well, most of them, anyways).

Here's how a data.win file looks like for a translators point of view, or what I need to look for:

1. If I open up the file in a HEX Editor, then it immediately starts with the text "FORM". After that 4 bytes store the file's lenght minus 8 bytes AND it's in reverse order. So in my case Fran Bow's data.win file is 474 042 532 bytes, and if I look at the bytes after FORM it says "9C 50 41 1C". If I reverse order it, then it becomes "1C 41 50 9C", which translates to 474 042 524. The program could get the file's size in bytes, substract 8 from it, get that value in hex and reverse it, then replace the 4 bytes after FORM in the beginning with the new data. Another method is to go to the very end of the file, then go back 8 bytes, and where we are standing is the size of the file (but we still have to reverse it). In case you want to know where we are standing, in HEX Workshop if you stand on a byte you can look for the "Caret" section in the bottom right corner of the program. That's the value we need to reverse and put after FORM.

2. Then I need to look for the STRG section of the file. This has 2 sections, the first one has Pointer which determine where a certain string starts, and then the strings themselves.

Strings are also divided up to 3 parts:
Firstly there are 4 bytes as header, and the 1st byte of that determines the strings' length in Uint32 format, and the next 3 bytes are just null characters.
Then comes the actual string, which is as long as said header's first byte determines so.
And then when it finishes it closes with a null character, and then the next string comes (with header, actual string and a null character).

Okay, but there's a catch: The pointers.
After the STRG section (which you can search for, just like for "FORM", although that one's at the beginning of the file), there are lots of characters.
I think we don't need to edit the first 8 bytes after STRG, just the ones after it.

Every 4 bytes store the offset at which our strings start. There's no division between them, they come right after each other. So in my case the very first string's first header byte started at "02 06 A0 08" (if I look at the Caret thingy). Now from the 9th byte after the STRG, I need to write down the REVERSE of this, so "08 A0 06 02", then I get my next string's header's first byte, and write that for the next 4 bytes and so on.

So the program should determine how much strings the game has (based on the number of pointers), and generate the strings according to it.

It inserts the strings in the game, then the pointers to them. Note that the STRG section can end with lots of null characters, and then a new section called TXTR (I assume this is Texture) begins. We don't need to worry about that, we just need to edit 4 bytes after FORM, a lot of bytes (from like 9 bytes after STRG), and then insert actual strings.


The only thing I don't understand yet (and I think we don't even need to edit that) is what those 8 bytes after STRG mean. The number of strings in the game? The whole lenght of it? It could be something like that, because when the last pointer ends (4 bytes like I've said before), then a string begins (with header, string and null). So there's no distinguishing between where the pointers end and where the strings start. It has to be in the first 8 bytes after STRG...

EDIT:
Okay, I know what it is (or I assume it is): The first 8 bytes' Uint32 values are actually two different 4 byte values.
The first 4 byte value determines the overall length of the STRG section, after STRG's G letter to the very last letter before TXTR (so before T), minus 4. I've selected all of the bytes after STRG's G letter (so from the 5th byte, S being the first) and allllll the way to TXTR, and the value I've got is 2D 1F DC. I've noticed that this is almost the exact same as the 4 bytes after STRG, but there's a null separator.

After that null separator there's another Uint32 value, which says 63319. This is the number of strings (and pointers!!!) in the file. This is also a 4 byte header-type thingy, because it has 2 null characters in it, and after that the very first pointer immediately starts.



That's all I could come up with, but will continue my research tomorrow with live tests on it. If you guys have any ideas on this, or you could create a program that does all of this (and not just for Fran Bow, for all GMS games with data.win files), then I think we just made something big :D

QUICK RECAP:

data.win starts with FORM, after FORM there are 4 bytes that determine the file's overall lenght (in Uint32).
Somewhere there's the STRG section, followed by the TXTR section.
Between these two the first 4 bytes of the STRG section determines the overall length of this section in Uint32 format, from the 5th byte counting from STRG's S to the character before TXTR's T.
The next 4 bytes store how much strings there are actually here.
Immediately after these 4 bytes the pointers start. These are 4 byte HEX values pointing to a string's beginning in reverse HEX order (so if something is at "00 01 AC 3B", this pointer becomes "3B AC 01 00" in value). These pointers come one after another, with no dividing character between them.
After every pointer has been inserted, a null character is written as a separator, then the strings begin.
A string has 3 parts: the first 4 bytes determine it's length, then the second part is the string itself, then it ends with a null character. After that another string goes on and on and on until it has ended. Note that no matter how long the whole section is, because the STRG's first header's say how long the STRG section is, we can fill the end up with null characters if we want to (so we have 5412 pointers and string with a length of 32010 characters, and if we only write 32000, then we can insert 10 null characters in the end before TXTR, so that the whole section is as long as it was written in HEX).

Now I'm off to sleep :D

EDIT:
Added images here to demonstrate what I'm saying.

Image

Image

Image

Image

Image
Last edited by The_Reaper_CooL on Fri Aug 05, 2016 9:00 am, edited 1 time in total.
The_Reaper_CooL
Posts: 69
Joined: Sat Dec 05, 2015 2:31 pm

Re: Game Maker Studio data.win format - An idea for a tool

Post by The_Reaper_CooL »

Ekey wrote:http://aluigi.altervista.org/bms/yoyogames.bms


Yes, thanks, I know about that, and that script works good, because if there's a picture I could easily edit it.

But this doesn't change the strings' header (how long a string is), and also it doesn't change the 4 bytes after the FORM part (how long a file actually is), and doesn't put a null character after the string, and doesn't modify the pointers.

That's why I've asked for a universal program, and the details are written above.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Game Maker Studio data.win format - An idea for a tool

Post by aluigi »

What you want is a just rebuilder.
The script works perfectly in extraction while in reimporting it has the usual size limitations of this method.
The_Reaper_CooL
Posts: 69
Joined: Sat Dec 05, 2015 2:31 pm

Re: Game Maker Studio data.win format - An idea for a tool

Post by The_Reaper_CooL »

aluigi wrote:What you want is a just rebuilder.
The script works perfectly in extraction while in reimporting it has the usual size limitations of this method.


Yes, I also know that.

And can a rebuilder like this be made?
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: Game Maker Studio data.win format - An idea for a tool

Post by aluigi »

If you have a big desire, skill and time, everything is possible :)
The_Reaper_CooL
Posts: 69
Joined: Sat Dec 05, 2015 2:31 pm

Re: Game Maker Studio data.win format - An idea for a tool

Post by The_Reaper_CooL »

aluigi wrote:If you have a big desire, skill and time, everything is possible :)


Well I have a big desire for this, as if this is made then almost every Game Maker Studio game could be translated.

I also have time for this, because if I want to translate like 9331 lines (Risk of Rain), then I need to be patient to do so.

But do I have the skill for it? Well that's a different story :D

I could only reverse the process on how this is made, but I can't program this. The only way I could make it to work is that I'd create a macro in Macro Express Pro, and then it goes through the steps I'd go through manually, but sped up a bit. I've made a similar thing for Unity games, and what takes me like 5 hours it does in 2 hours or so.

So this is why I've made this topic, hoping that maybe someone could help me develop a program like this :)
The_Reaper_CooL
Posts: 69
Joined: Sat Dec 05, 2015 2:31 pm

Re: Game Maker Studio data.win format - An idea for a tool

Post by The_Reaper_CooL »

And there you go, I've created a "simple" Excel file that re-writes these things, but I have to manually re-insert them. At least I know how to use Excel for these kind of things, lol :D
ghylard
Posts: 77
Joined: Wed Oct 08, 2014 1:03 pm

Re: Game Maker Studio data.win format - An idea for a tool

Post by ghylard »

The tools available on this page Github works perfectly to translate Fran Bow and Memoranda.
They allow to translate the subtitles without constraint of length.

https://github.com/fjay69/UndertaleTools/releases

Image
Image
Image