SC4Reader Tool

[Tropod]

@cogeo;
-DBPF access & read/write exemplars; no library. I've just written my own code.
-compressions/decompressions. This is pretty much same as ilives reader, except slightly modified version.

@memo;
I meant to include screen shot before; this is what TGI/scanner should look like while it's scanning;




I might add some screenies to my first post later. I'm having some issues with my ISP right now, internet barely working  . Think maybe storm we had on weekend is causing some issues  . I feel like I'm in the 90's again using dial-up.

[memo]

TGI checker & Plugins Scanner:
The plugins/conflict scanner scans & cross references all files (ie installation &/or custom plugins) whereas the TGI checker only checks TGIs selected inside a dat you've got loaded (against all install/plugin files). Both are based on file/folder settings (so 1 possible reason no files were scanned?), as is the File Listings pane. Both load *.dat header & *.dat index, read data & do a TGI compare for possible conflicts.

RULs;
If you go to Options menu there is a text option (default, hex, text), however you may encounter out of memory issue with the larger RULs when saving. Not sure if I can improve upon that or not at this stage, which is why I've take the approach I have. The default view will allow you to save multiple lines of data in the lower section, it will basically insert/append it to the current line/area you're working on.

Thanks for the clarification. The problem with the scanner was indeed that I did not properly set the directories. They seemed right, but weren't actually correct.

Now the scanner works, but gives me the following message, the first time I invoke it:



The second time, the message appears twice; the third time, three times, and so on.


By the way, do you plan to publish your sources some day? I'd find it interesting to see how it all works behind the scenes. I may eventually release my own collection of classes for accessing DBPF files, too.

[Interoceter]

I love the tool; it's coming in very handy. It seems have problems with the floralpreferences exemplar property. This consist of 256 float32 values. Rather than entering them in by hand, I've been working in notepad and copying/pasting them over. Sometimes it works, and sometimes it fails and corrupts the dat file.

Also when I open the property to edit, I seem to have to right click on the property on the right hand pane, then click on the property to ditch the menu, and then go to the edit tab. If I don't right click first, it sits on the exemplar type property. I'm using windows 7.

[Tropod]

@memo
Was this using the TGI checker or full scanner? And are you getting the "!m_Identifier" warning everytime you run the scanner? I'll have to look at some way of better implementing this.
source code: not sure as it's quite the spaghetti really . I've written a handfew programs before but not one the likes of this. It's not real professional & it's over 170MBs in size.
EDIT: I meant to point out/ask, regarding hex view & fixed column width; if you resize the frame it will resize the column width automatically. If this is not suitable let me know. I found ilives reader to be restrictive in this regard so I made sure the design of this was a bit more flexible.


@Interoceter
Thank you for the feedback.
Could you please provide a copy of the data when it's causing it to corrupt? ie the *.dat file itself if possible (just upload here as an attachment). This'll help me track down any issues with this.
Regarding Editing of exemplars; there's a safety check in place to prevent issues if user hasn't selected a property, it shouldn't effect right-mouse click (or left for that matter) though as there's no logic for mice    .

[vortext]

Rather than entering them in by hand, I've been working in notepad and copying/pasting them over. Sometimes it works, and sometimes it fails and corrupts the dat file.

This may actually be due to Notepad. I used the same method when making tree controllers and observed that Notepad will insert a 'hard return' at the end of every line when you save. This is an invisible character which the Reader cannot deal with and consequently all entries following behind a hard return are not pasted over. Though I haven't tried it yet, I wouldn't be surprised if this tool acts similarly.

At any rate, to get rid of hard returns put the cursor at the end of a line and hit 'delete'. If nothing seems to happen, you've probably just deleted the hard return so hit delete again. If the first character on the next line disappears it's good.

[Tropod]

update done, see first post for link. Summary of this update as follows;

-a few fixes. Unfortunately haven't been able to address all recent items that've been mentioned sorry.
-FSH (color) viewing.
-BMP viewing.
-clone function; currently clones TGI file(s) with same TGI, TGIs can be edited/changed though via "Item/File Info".
-export TGI(s) to *.dat. Exports/Saves selected TGIs to a newly created *.dat file.
-export TGI(s); exports selected TGIs individually in their uncompressed state. If you've selected 2 or more TGIs it will automatically save the 2nd/3rd/etc based on the name you've given the 1st in format of "filename_#.extType.rdr" where "_#" is incremented number, "extType" is type of (internal) TGI file it is ie .bmp for BMPs, .s3d for S3Ds, .rul for RULs etc. ".rdr" is ext type for exporting/importing of TGIs. This function will also generate *.tgi text file with TGI inside it which is necessary for importing files properly, otherwise if this is missing while importing files will be allocated "unknown" with no TGI.
-logging.txt implemented. This file currently only logs info relating to a handfew errors around file loading/parsing (no more constant popups). If you encounter an issue please upload logging.txt file along with relevant *dat listed in logging.txt.


Hopefully this'll be the last release I make........on my old XP set up  .

[memo]

Was this using the TGI checker or full scanner? And are you getting the "!m_Identifier" warning everytime you run the scanner? I'll have to look at some way of better implementing this.

Yes, this happened every time I used the TGI conflict checker.

source code: not sure as it's quite the spaghetti really . I've written a handfew programs before but not one the likes of this. It's not real professional & it's over 170MBs in size.

If you had releasing the code in mind, this might help you to write cleaner code and reduce the spaghetti, but 170 MB is quite a size. Not sure what that would comprise.

EDIT: I meant to point out/ask, regarding hex view & fixed column width; if you resize the frame it will resize the column width automatically. If this is not suitable let me know. I found ilives reader to be restrictive in this regard so I made sure the design of this was a bit more flexible.

You are right, indeed. That way, I can choose any desired column count – although I have rarely felt the need for anything other than 16 columns in a hex editor.

[Tropod]

Yes, this happened every time I used the TGI conflict checker.

Can you see how you go with the last version? A warning may come up once, but if this problem keeps happening the program *should* log the DBPF header ID (just first 4 bytes) along with *dat file location. If you can open this particular dat normally, the conflict scanner may be causing false errors (ie not loading properly) . EDIT: if it does, can you post/upload the logging file along with *dat file so I can investigate?

If you had releasing the code in mind, this might help you to write cleaner code and reduce the spaghetti, but 170 MB is quite a size. Not sure what that would comprise.

By comparison, ilives reader source code is somewhat larger in size depending on which portions of it you reference. I'm hoping that moving to Win7 I'll actually get around to cleaning it all up (it is on my to-do list), possibly even re-working it all from scratch. Just need to see how I go timewise.

[memo]

Can you see how you go with the last version? A warning may come up once, but if this problem keeps happening the program *should* log the DBPF header ID (just first 4 bytes) along with *dat file location. If you can open this particular dat normally, the conflict scanner may be causing false errors (ie not loading properly) . EDIT: if it does, can you post/upload the logging file along with *dat file so I can investigate?

Indeed, the message showed up only once, this time. The logging.txt file contains:

Code Select Expand


Archive.cpp(411): !m_Identifier: 4476744: C:\Program Files\Maxis\SimCity 4 Deluxe\Apps\SimCity 4 StartupManager.dat


I now see the problem. That dat file (whatever it is – I don't know) is not a DBPF file. I have never got the startup manager to work successfully, anyway. The file is attached to this post.

By comparison, ilives reader source code is somewhat larger in size depending on which portions of it you reference.

Must be due to the language...

[Tropod]

Thank you for uploading that. I've just had a quick look at that file, and as you say it's not a DBPF at all (not sure if that's intended or not, I don't have that app installed), hence why sc4reader won't load it . SC4Reader attempts to load it due to *.dat ext but bails as it doesn't recognise header. Good to know it's doing its job ........

Well I've pretty much completely moved to Win7  & I must say, I should've done this sooner  .

[HurricaneMod10]

Is it effect dir is released to be very modifiable with even creating puzzle pieces are look like a add new effect dir yet? I am waiting for come up new Effect Dir should be able to get a very modifiable with even creating severe thunderstorms, microbursts, tropical depressions, tropical storms, hurricanes and even major hurricanes should be on the way with my very own hurricane mod soon.

Thank you for your interesting about the programming in SC4 Reader Tool.

[Tropod]

Is it effect dir is released to be very modifiable with even creating puzzle pieces are look like a add new effect dir yet? I am waiting for come up new Effect Dir should be able to get a very modifiable with even creating severe thunderstorms, microbursts, tropical depressions, tropical storms, hurricanes and even major hurricanes should be on the way with my very own hurricane mod soon.

Thank you for your interesting about the programming in SC4 Reader Tool.

The tool can indeed edit effect dir type files (& many more), much more easily than any other tool (that I'm aware of - someone correct me if I wrong). As far as what *new* can be added, well that's to be seen still; anyone using this aspect should cross reference the format specs. The tool in itself currently does not have ability to add new lines of data, I've done this intentially at this stage to get feedback & to minimise any issues users may encounter with any bugs. Later versions I intend to implement this but again users really need to refer to the specs http://www.wiki.sc4devotion.com/index.php?title=Category:File_Formats.

[Egi]

Some of us are on win8 already ... do you want to wait it out again until win 9 comes around?
I like it, but it is not a must have update like win7 compared to xp or vista was *G*

Advertisement aside, what I actually want to know, are you going to upload the sources for the reader on a platform like sourceforge someday under whatever licence?
Just in case that you stop the development of that tool, so that others can continue where you left off.

[Tropod]

Some of us are on win8 already ... do you want to wait it out again until win 9 comes around?
I like it, but it is not a must have update like win7 compared to xp or vista was *G*

Advertisement aside, what I actually want to know, are you going to upload the sources for the reader on a platform like sourceforge someday under whatever licence?
Just in case that you stop the development of that tool, so that others can continue where you left off.

I don't like Win8 at all, but not going to discuss that  . ilives Reader source code can be found on sourceforge. As for source code for this; as I've stated, not sure if I'll be releasing sourcecode for this. If/when I do certainly not going to be anytime soon, as I'm currently reworking & tidying it all up (& I'm still transitioning all of my stuff to my new setup). Maybe then I will . As for now, I haven't left/taken off . It might just be a little while before next version comes out, which I'm hoping will support 64bit.

[HurricaneMod10]

I normally have got a winXP service pack 2 but Win7 as well.

[NCGAIO]

Regarding EffDir
Will be possible to view the relations between sections in future?


Any chance to implement sorting ?

[memo]

Testing v125:

I tried editing an exemplar file. What I did exactly is appending 4 characters to its exemplar name property. Afterwards, the exemplar was displayed corruptedly for all the properties following the exemplar name. To my surprise, after saving the file, the exemplar was not corrupted at all, but the change of the exemplar name was not saved either. Also, it would be nice to have a more prominent warning if an entry is corrupted.

While loading a file, if you click "fill the list" before the progress bar has filled three times, nothing is displayed at all; even after the loading is completed.

For FSH files, it would be great, if mipmaps and multiple image entries would be displayed, too, rather than just the first image.

[Tropod]

@NCGAIO
Relations; I'd have to say at this stage unlikely, main reason being time but also because there's still a lot of unknowns in the spec. It took months as it was to get effects dir editor where it is now. As for sorting; I've put that on the to do list .

@memo
I've made note about FSH & fill list. Some issues/shortcomings I am aware of, some like these I am not, so it's great that you're posting these issues. Thank you  .
Corrupted Entires: I could add a warning on the main Exemplar list view at the top?
Regarding Exemplar (if this doesn't cover your issue let me know); is this for text or binary exemplars, I'm guessing binary as I've been able to replicate the problem? At the moment it doesn't automatically update the "REP" item (for binary/text) so if you're adding extra items (or in this case extra text) the REP value needs to be manually updated (but not for text-based exemplar strings). Not ideal I know;  I could add a warning on the edit screen next to the REP item itself to make sure users update rep value until I have this handled properly, alternatively I could add a pop up warning.

[memo]

Corrupted Entires: I could add a warning on the main Exemplar list view at the top?

That's exactly what I had in mind.

Regarding Exemplar (if this doesn't cover your issue let me know); is this for text or binary exemplars, I'm guessing binary as I've been able to replicate the problem? At the moment it doesn't automatically update the "REP" item (for binary/text) so if you're adding extra items (or in this case extra text) the REP value needs to be manually updated (but not for text-based exemplar strings). Not ideal I know;  I could add a warning on the edit screen next to the REP item itself to make sure users update rep value until I have this handled properly, alternatively I could add a pop up warning.

Yes, it was a binary exemplar. I'd imagine there is not much use for being able to manually set the rep value separately, is there? Except maybe when it comes to rep 0 vs rep 1 to distinguish between the two binary formats.

Also, I would not mind if your program automatically converted text exemplars to binary exemplars when the user tries to change its properties. It would save you from those distinctions in encoding different formats. At least, that's how I have done it before.

[HurricaneMod10]

it says: * Can't find mfc100u.dll *
I can't be able to get the work with Microsoft Visual C++ 2010 SP1 Redistributable from the Windows XP Service Packs 3. ERRORS!