Spider-Man Shattered Dimensions and Edge of Time .dat files

[Enigma]

We in the MarvelMods community are trying to get into these files. They are too big to post, but here is all the info I could find on them.

The archives apparently contain raw PCM tracks with the specs saved in the TOC.

Apparently, Beenox XBOX 360 version games use XMA audio contained inside the Streams.dat archive, while the Wii versions use DSP and the PS3 version Sony ADPCM.

Apparently the Wave Scanner script works on Amazing Spider-Man 2 but I couldn't get it to work for either of these games.

In the PC version of Shattered Dimensions, there are cab files on the disc instead of the .dat files that are the same names as the .dat files.

Here are some threads about these .dat files, in these and other Beenox games.

https://zenhax.com/viewtopic.php?f=9&t=3335

https://zenhax.com/viewtopic.php?t=8450 (Monsters vs Aliens bms script didn't work, but it's the same kind of Beenox .dat files)

https://hcs64.com/mboard/forum.php?show ... owpage=199

https://hcs64.com/mboard/forum.php?show ... owpage=200


I'm really at a loss here. Does anyone have any ideas?

[kyoon]

I'm also trying to get the voice files from Edge of Time, did you succeed?

[Enigma]

Nope. I never figured anything out and no one else has responded. Please post here if you do figure it out thought. The mystery of how to get into these files has gone unsolved long enough.

[BloodRaynare]

Without any files, we can't help you.
Just upload the TOC files if it's too big. Or split the the dat file with the aluigi's Filecutter script (Use quickbms for this).

[Enigma]

I don't think the TOC is a separate file/files. That's just what some information I found online said. I had hoped someone else knew what "TOC" meant. And I had hoped that with as much info as I provided via those links, someone read through them and could have an idea on how to help and I could avoid upload these very massive files. Since that's hasn't turned out to be the case, here's the links.
I'll probably have to pull the files and remove the links in couple months (so, end of February) if there isn't any action on this.
Sorry, but for files this massive, that's all I can do.

Here's the Edge of Time Streams.dat (800mb):
https://www.mediafire.com/file/lfcvhjds ... s.dat/file

Here's the the Shattered Dimensions Streams.dat (2.6 gb):

https://www.mediafire.com/file/ebjoknnt ... s.dat/file

Hopefully this can finally get solved, as there have been so many false starts and abandoned attempts online by various people over the years.

[BloodRaynare]

Okay, just checked the two of the files, and I can only say, that these files are encrypted and I have no idea what the encryption algorithm is nor the key to decrypt it.

[kyoon]

Bump

[Enigma]

Someone on my xentax thread about these asked about reuploading them.

So here's the deal: I simply do not have the space to leave both of these incredibly large .dat files up on my MediaFire indefinitely in the hopes someone will eventually want to take a look. I left them up until March, as I said I would, which is 2 months, without really much interest.
I have reuploaded the smaller of the 2 .dat files, which is the EOT one. I'll leave it up until April.
(Edge of Time streams.dat = 800mb vs Shattered Dimensions streams.dat = 2.6gb)
If anyone is really serious about this, let me know and I can upload the other one.
Again, I'm sorry, but due to the size of these files, and the lack of interest, this is the best I can do.
If your interest in these is more of a casual interest, these can be gotten other ways than me.
Thanks for any interest anyone might show. I do really appreciate it.

https://www.mediafire.com/file/3kk05mef ... AT.7z/file

[kyoon]

Any news?

[Enigma]

No. And it doesn't look like there's going to be. There's just not that much interest, I guess. With 15 downloads of the file since I reuploaded it, and that's with threads both here and xentax.
I really appreciate anyone who tried, but it's pretty clear there just isn't the interest in this I thought there would be.
I've got to pull the link. I need the space on Mediafire too badly.
There are other ways to get the files anyway.
If anyone has any ideas, please post them here so this can finally get solved.
I will, of course, do the same.

[Enigma]

https://www.mediafire.com/file/nfdwqmk1 ... io.7z/file

This is the Streams.dat from the Xbox 360 Prototype of Spider-Man Shattered Dimensions.
It is only 78mb in the z7 archive and extracts to 87mb.
This is much much much smaller and is at the very least an easier file to host long term.
Do with it what you will.
Please post here if you try.
Thank you.

[JackTheRipper]

Number of songs/files at @0x8 depending on the endian.

Interleave is 0x8000 even for the Nintendo versions.

For the 360 version of SMEoT, the spacing is 0x78, so start at 0x38. Uses XMA2

For the 360 version of SMSD, the spacing is 0x6C, so start at 0x10c. Uses XMA2

For the Wii version of SMEoT, the spacing is 0x50, so start at 0x2c. Also, has a standard BE DSP header.

For the Wii version of SMSD, the spacing is 0x44, so start at 0x100. Also, has a standard BE DSP header.

For the 3DS version of SMEoT, the spacing is 0x50, so start at 0x24. Also, has a standard LE DSP header.

For the PS3 version of SMEoT, the spacing is 0x48, so start at 0x2c. Uses ATRAC3

Code: Select all

#Example of SMEOT (PS3)
body_file = Streams.dat
header_file = Streams.dat

codec = ATRAC3

subsong_count = @0x08:BE
subsong_spacing = 0x48

start_offset = @0x2c:BE
data_size = @0x58:BE
sample_rate = @0x60:BE

channels = @0x5c:BE
interleave = 0xC0 * channels
num_samples = data_size

For the PS3 version of SMSD, the spacing is 0x40, so start at 0x100. Uses PSX

Code: Select all

#Example of SMSD (PS3)
body_file = Streams.dat
header_file = Streams.dat

codec = PSX

subsong_count = @0x08:BE
subsong_spacing = 0x40

start_offset = @0x100:BE
channels = @0x12c:BE
#data_size = @0x130:BE
sample_rate = @0x134:BE

num_samples = data_size

interleave = 0x10
interleave_last = auto

You might try making a TXTH. This must be named Streams.txth

Alternately if unsure for the PS3 version of SMSD, use VGMToolbox's Sony ADPCM extractor, the interleave is 0x10.

[Enigma]

Wow!
Thanks so much!
This is certainly more info than I've ever found before about this!
I'm not entirely sure what to do with it all, but it's more info about it.

I tried VGMtoolbox's ADPCM extractor using all the different PS3 values you suggested on the PS3 Streams.dat for both games, but nothing happened.
I tried putting what you gave me in a Streams.dat.txth in the same folder as the PS3 SMSD Streams.dat and opening the Streams.dat in foobar with vgmstream installed and nothing happened.
I then tried putting the info you gave me in a file called ".dat.txth" and then opening Streams.dat in the standalone vgmstream, but it said "failed opening streams.dat"
I'm sorry, but I don't entirely know what you're talking about and even though I tried what you suggested to the best of my understanding, none of it worked.
Could you please explain in more detail what I'm supposed to do to extract the audio from these files?

[Enigma]

I saw your update to your post.
Naming it Streams.txth didn't change anything for either PS3 game.
Same result as before.

[kyoon]

You just need to create a txt file and copy the PS3 exemple in and name the txt file as "streams.txth" in the same folder as the Streams.dat, then you drag both files in Foobar and it's done.
Some files can't be played and some are just empty, so it doesn't seem perfect but it's the best result so far.

I just didn't succeed in changing the content of the PS3 exemple for other supports and it's not working with the European version of the PS3 game (other I have are European that may explain why)
Here's the European one if you could help with this one, thanks.

https://mega.nz/folder/MbBlVRQR#Oq2AQr0ONFAfE5Yv7jcXnA

[Enigma]

But that's what I'm saying. I've done exactly that and it doesn't work.
I know I have the vgmstream Foobar plugin installed correctly because I've used it for other things and it works fine.
But doing what you suggested didn't work for the US versions I have and that's why it didn't work for the European version you have. Because it doesn't work at all.

[Enigma]

So, I tried again and it's the weirdest thing.
I'm not sure why, but I guess only PS3 Disc Dumper works to extract the files?
None of the extraction and decryption methods I tried before did.
Not sure why, I followed the guides.
Sorry about the confusion.
It does work. I'm not sure it extracted all of the audio, but it got a lot of it at least.
So, using this for the PS3 US version will work, but make sure to use PS3 Disc Dumper first.
Thanks so much for all the help!
One thing's for sure, it'll take me a long time to sort though all the audio for both games.

[Puterboy1]

I hope it works, because I am very interested in all those sounds.