New compression algorithms to add

Doubts, help and support about QuickBMS and other game research tools
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

New compression algorithms to add

Post by aluigi »

Feel free to link here any compression algorithm that is not currently available in quickbms.

Doesn't matter if you have the source code or only the binary dump of the function, everything is welcome :D
Ekey
Posts: 1383
Joined: Sat Aug 09, 2014 2:34 pm

Re: New compression algorithms to add

Post by Ekey »

Ok! Here one - for Zen Studios games. Masm32 :D
RetroHelix
Posts: 23
Joined: Sat Aug 09, 2014 2:28 pm

Re: New compression algorithms to add

Post by RetroHelix »

Would be nice if these algorithms could be added: http://www.romhacking.net/utilities/826/ The download comes with source files.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: New compression algorithms to add

Post by aluigi »

@ RetroHelix
I think that some of them are already implemented in quickbms, but without samples for each algorithm I'm sure that for me is more simple to add all of them directly to the next quickbms rather than checking each one :)
RetroHelix
Posts: 23
Joined: Sat Aug 09, 2014 2:28 pm

Re: New compression algorithms to add

Post by RetroHelix »

aluigi wrote:@ RetroHelix
I think that some of them are already implemented in quickbms, but without samples for each algorithm I'm sure that for me is more simple to add all of them directly to the next quickbms rather than checking each one :)

I encoded the history.txt that came with the tool to make some sample files in case you want to test your implementation in quickbms.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: New compression algorithms to add

Post by aluigi »

Thanks a lot, I have checked it and the following are already implemented:

Code: Select all

LZSS history (LZ10).txt = LZ77WII and NITROSDK
LZX-evb history (LZ11).txt = LZ77WII
RLE history.txt = LZ77WII and NITROSDK
So those to implement are:

Code: Select all

BLZ history.txt
LZE history.txt
LZX-ewl history (LZ40).txt
RetroHelix
Posts: 23
Joined: Sat Aug 09, 2014 2:28 pm

Re: New compression algorithms to add

Post by RetroHelix »

aluigi wrote:Thanks a lot, I have checked it and the following are already implemented:

Code: Select all

LZSS history (LZ10).txt = LZ77WII and NITROSDK
LZX-evb history (LZ11).txt = LZ77WII
RLE history.txt = LZ77WII and NITROSDK
So those to implement are:

Code: Select all

BLZ history.txt
LZE history.txt
LZX-ewl history (LZ40).txt

Very nice! Thank you very much.
puggsoy
Posts: 161
Joined: Sat Dec 13, 2014 1:01 am

Re: New compression algorithms to add

Post by puggsoy »

Can you implement LZEXE? The code for both compression and decompression can be found here: http://bellard.org/lzexe.html
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: New compression algorithms to add

Post by aluigi »

If you mean the algorithm with the magic "FAB", yes it will be implemented in the next version.
It's used in scummvm so it's very easy for me to implement it.
I don't know if the one in lzexe is the same but I will implement also the code of unlzexe5.c
Ekey
Posts: 1383
Joined: Sat Aug 09, 2014 2:34 pm

Re: New compression algorithms to add

Post by Ekey »

STALKER compression open source'd (code) from OpenXRay Engine - https://github.com/OpenXRay/xray-16/blo ... /LzHuf.cpp
Last edited by Ekey on Wed Feb 11, 2015 8:32 pm, edited 1 time in total.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: New compression algorithms to add

Post by aluigi »

Great, added to the TODO.
tsanford01
Posts: 10
Joined: Tue May 26, 2015 3:58 pm

Re: New compression algorithms to add

Post by tsanford01 »

Hello again, Please add the updated LZ4 r129 as we discussed in a previous post. Just wanted to tack it here for the official to do list.

Thank you again,
Tom
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: New compression algorithms to add

Post by aluigi »

I just released the new quickbms.
eri619
Posts: 21
Joined: Sun Nov 29, 2015 11:06 pm

Re: New compression algorithms to add

Post by eri619 »

Could you add the compression algorithm for yukes.bms(BPE/Byte Pair Encoding) please?
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: New compression algorithms to add

Post by aluigi »

If you have the source code of the recompression algorithm yes, otherwise no.
eri619
Posts: 21
Joined: Sun Nov 29, 2015 11:06 pm

Re: New compression algorithms to add

Post by eri619 »

please take a look at this
viewtopic.php?f=13&t=1882
i will soon post the BPE Code.
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: New compression algorithms to add

Post by aluigi »

That error is caused by the missing algorithm.
ThatTrueStruggle
Posts: 20
Joined: Tue Nov 17, 2015 12:11 am

Re: New compression algorithms to add

Post by ThatTrueStruggle »

Could you add a new decompression algorithm? This one is a variant of LZSS, from Donkey Kong: Tropical Freeze. http://www.metroid2002.com/retromodding ... ompression
Basically all this an updated algorithm but it adds some extra features, including different modes.

I also have an example, if needed: https://www.dropbox.com/s/qem0thhn4q7vm ... e.bin?dl=0
Compressed Size: 0x13E6
Uncompressed Size: 0x145E

Thank you so much!
aluigi
Site Admin
Posts: 12984
Joined: Wed Jul 30, 2014 9:32 pm

Re: New compression algorithms to add

Post by aluigi »

Added in my TODO list
Ekey
Posts: 1383
Joined: Sat Aug 09, 2014 2:34 pm

Re: New compression algorithms to add

Post by Ekey »