ZenHAX

Free Game Research Forum | Official QuickBMS support | twitter @zenhax
It is currently Wed Sep 28, 2022 5:41 am

All times are UTC




Post new topic  Reply to topic  [ 30 posts ]  Go to page 1 2 Next
Author Message
 Post subject: [PS4] Dirt 5 .dat files
PostPosted: Mon Mar 29, 2021 1:48 pm 
User avatar

Joined: Mon Apr 29, 2019 3:49 pm
Posts: 6
Hello! I need help to unpack files from .dat and pack back the modified ones. Here a .zip archive that contains a sample .dat file (0_DISC_INIT.dat).
Also here is a link to dat.ndx, maybe it contains all the filenames that are in .dat
https://www.mediafire.com/file/936xyj88 ... x.zip/file


Attachments:
ps4_dirt5_dat.zip [1.75 MiB]
Downloaded 204 times
Top
   
PostPosted: Wed May 12, 2021 6:07 pm 
Site Admin
User avatar

Joined: Wed Jul 30, 2014 9:32 pm
Posts: 12984
I'm quite sure to have already seen this format in the past since I remember the index file located in a sub-folder of the dat archives.
Anyway I made a new script from scratch:
http://aluigi.org/bms/dirt5.bms

Just select dat.ndx and it will do the rest.

Most of the files are without name and it's normal because they are not referenced so I decided to extract them anyway (maybe there is some old/hidden content)


Top
   
PostPosted: Sun Jun 06, 2021 10:42 pm 
User avatar

Joined: Mon Apr 29, 2019 3:49 pm
Posts: 6
aluigi wrote:
I'm quite sure to have already seen this format in the past since I remember the index file located in a sub-folder of the dat archives.
Anyway I made a new script from scratch:
http://aluigi.org/bms/dirt5.bms

Just select dat.ndx and it will do the rest.

Most of the files are without name and it's normal because they are not referenced so I decided to extract them anyway (maybe there is some old/hidden content)

Thanks a lot for the script! Sorry for the late respond, only now I saw your post. It worked, but there are a couple of problems =(
1. In process of unpacking files at some point the following error appears: https://imgur.com/Mrtmobx But there is no 9_DISC_XB.dat file in the dat folder. That's all we have:
Code:
0_DISC_INIT.dat
1_DISC_DEV.dat
2_DISC_FPX.dat
3_DISC_FPX.dat
4_DISC_ARC.dat
5_DISC_ARC.dat
6_DISC_ARC.dat
7_DISC_AUC.dat
8_DISC_PS.dat
11_DISC_OTH.csv
11_DISC_OTH.dat
12_DISC_OTH.csv
12_DISC_OTH.dat
13_DISC_OTH.csv
13_DISC_OTH.dat
14_DISC_OTH.csv
14_DISC_OTH.dat
15_DISC_OTH.csv
15_DISC_OTH.dat
16_DISC_OTH.csv
16_DISC_OTH.dat
17_DISC_OTH.csv
17_DISC_OTH.dat
18_DISC_OTH.csv
18_DISC_OTH.dat
19_DISC_OTH.csv
19_DISC_OTH.dat
datfiles.version

2. It seems all the *.cfg or *.json or other text files are not readable (encrypted or compressed?). I've attach the zip archive with some of this files.

Is any chance to extract all files from .dat and make them readable? (*.cfg, *.json etc)

And thanks again for your hard work! Many times your scripts helped me to modify games =)


Attachments:
unpacked_files.zip [50.75 KiB]
Downloaded 182 times
Top
   
PostPosted: Wed Aug 11, 2021 9:38 pm 

Joined: Wed Aug 11, 2021 9:34 pm
Posts: 14
I get this error trying to unpack them:- enter in folder C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index
- open input file C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index\../0_DISC_INIT.dat

- error in src\file.c line 615: fdnum_open()
Error: No such file or directory

Last script line before the error or that produced the error:
66 open FDSE TMP 1
coverage file 0 100%! 34995622 28926946 . offset 005c99f4
coverage file -1 80% 6421746 7928470 . offset 0078fa96

Press ENTER or close the window to quit

Edit: I tried a different method now i get a different error: - enter in folder C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index
- open input file C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\index\../0_DISC_INIT.dat
00000008 83849 00000000.dat

Error: incomplete input file 1: C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat\0_DISC_INIT.dat
Can't read 64 bytes from offset 00000008.
Anyway don't worry, it's possible that the BMS script has been written
to exit in this way if it's reached the end of the archive so check it
or contact its author or verify that all the files have been extracted.
Please check the following coverage information to know if it's ok.


Last script line before the error or that produced the error:
70 log NAME OFFSET SIZE 1

- OFFSET 0x00000008
- SIZE 0x00014789
coverage file 0 100%! 34995622 28926946 . offset 005c99f4
coverage file -1 80% 6421746 7928470 . offset 0078fa96

Press ENTER or close the window to quit


Top
   
PostPosted: Fri Aug 27, 2021 4:04 pm 
Site Admin
User avatar

Joined: Wed Jul 30, 2014 9:32 pm
Posts: 12984
Please upload the index file.


Top
   
PostPosted: Sat Sep 11, 2021 2:13 am 

Joined: Wed Aug 11, 2021 9:34 pm
Posts: 14
the website says .ndx isnt allowed


Top
   
PostPosted: Sat Sep 11, 2021 2:18 am 

Joined: Fri Aug 26, 2016 3:11 pm
Posts: 190
x1SlowSBCx wrote:
the website says .ndx isnt allowed

you can put it in a zip or add .bin to extension etc.


Top
   
PostPosted: Sat Sep 11, 2021 2:28 am 

Joined: Wed Aug 11, 2021 9:34 pm
Posts: 14
its too big, its 28mb


Top
   
PostPosted: Tue Sep 14, 2021 11:09 am 
Site Admin
User avatar

Joined: Wed Jul 30, 2014 9:32 pm
Posts: 12984
Why don't you just use a file sharing website like mega, mediafire, dropbox, google drive, or any of the thousands available nowadays?


Top
   
PostPosted: Sun Dec 19, 2021 10:46 am 

Joined: Sun Dec 19, 2021 10:40 am
Posts: 7
aluigi wrote:
Why don't you just use a file sharing website like mega, mediafire, dropbox, google drive, or any of the thousands available nowadays?



I have uploaded the file. Is it possible this file unpack ?


https://www.mediafire.com/file/kixlflot ... at.7z/file


Top
   
PostPosted: Thu Jan 06, 2022 6:24 pm 
Site Admin
User avatar

Joined: Wed Jul 30, 2014 9:32 pm
Posts: 12984
The script seems to be correct and it expects 0_DISC_INIT.dat to be 931 Mb, isn't that size?
Can you provide a screenshot or directory list of the files in "C:\Program Files (x86)\Steam\steamapps\common\DIRT 5\dat" ?


Top
   
PostPosted: Sun Jan 09, 2022 5:19 pm 

Joined: Wed Aug 11, 2021 9:34 pm
Posts: 14
https://imgur.com/a/sjtePzz
https://imgur.com/a/Gf1DSSS
Heres the NDX file.
https://mega.nz/file/jBlCnBrZ#QHQ2nR3el ... d8EYjsQ4HE
Heres the error i get
https://imgur.com/a/wMJWpvq
Thanks :D


Top
   
PostPosted: Sun Jan 09, 2022 5:58 pm 
Site Admin
User avatar

Joined: Wed Jul 30, 2014 9:32 pm
Posts: 12984
Here is the explanation:
dat.ndx is a sort of incremental index file, everytime there is a patch that modifies or removes the "dat" archives, the new information are appended to this dat.ndx and the old information are simply made "unavailable" by setting FILE_ID to 0xffffffff.

For example the problem with 0_DISC_INIT.dat may have been caused by this patch https://steamdb.info/patchnotes/6239635/ that indeed seems to delete its content (and therefore keeping a 0bytes file), which is now like the one you took in the screenshot: https://steamdb.info/depot/1038251/

Long story short I just updated the script by checking if the filename is valid because I have no other simple way to check FILE_ID 0xffffffff handled in two different locations of the script, but the result is correct:
http://aluigi.org/bms/dirt5.bms


Top
   
PostPosted: Sun Jan 09, 2022 6:05 pm 

Joined: Wed Aug 11, 2021 9:34 pm
Posts: 14
Interesting. So i ran the new script and this is what i got.
https://imgur.com/a/gr2PFTy


Top
   
PostPosted: Sun Jan 09, 2022 6:20 pm 
Site Admin
User avatar

Joined: Wed Jul 30, 2014 9:32 pm
Posts: 12984
Are you using the new script 0.1.1?
Code:
# Dirt 5 NDX/DAT (script 0.1.1)


Top
   
PostPosted: Sun Jan 09, 2022 7:03 pm 

Joined: Wed Aug 11, 2021 9:34 pm
Posts: 14
aluigi wrote:
Are you using the new script 0.1.1?
Code:
# Dirt 5 NDX/DAT (script 0.1.1)


Ya, and i just double checked. Maybe im doing something wrong?


Top
   
PostPosted: Sun Jan 09, 2022 8:35 pm 
Site Admin
User avatar

Joined: Wed Jul 30, 2014 9:32 pm
Posts: 12984
I don't know what to say because I redownloaded the script and it works correctly in my test.
For sure it's impossible that it tries to dump the file 00000000.dat because there is a line in the script (line 65 'if NAME != ""') that doesn't allow empty skips empty filenames like the one in your screenshot.


Top
   
PostPosted: Mon Jan 10, 2022 1:15 am 

Joined: Wed Aug 11, 2021 9:34 pm
Posts: 14
Hmm. Ill try and reinstall the game maybe??


Top
   
PostPosted: Mon Jan 10, 2022 8:06 am 
Site Admin
User avatar

Joined: Wed Jul 30, 2014 9:32 pm
Posts: 12984
Why reinstalling the game? It's a problem of the script.

Are you sure that the last screenshot is the correct one?
As already said, it's impossible that you get that error so maybe you posted an old screenshot?


Top
   
PostPosted: Tue Jan 11, 2022 1:16 am 

Joined: Wed Aug 11, 2021 9:34 pm
Posts: 14
idk maybe the files were messed up somehow... anyways yep i just ran it again its the same error. Interesting.


Top
   
Display posts from previous:  Sort by  
Post new topic  Reply to topic  [ 30 posts ]  Go to page 1 2 Next

All times are UTC


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Powered by phpBB® Forum Software © phpBB Limited