Difference between revisions of "Wiimms SZS Tools"

From Custom Mario Kart
Jump to navigation Jump to search
(Wiimms SZS Tools v2.42a released)
 
(233 intermediate revisions by 15 users not shown)
Line 1: Line 1:
 
{| class="textbox float-right grid"
 
{| class="textbox float-right grid"
 
|+ Wiimms SZS Tools
 
|+ Wiimms SZS Tools
| colspan=2 style="text-align:center" | [[file:Wiimms-SZS-Tools.png]]
+
| colspan=2 style="text-align:center" | [[File:Wiimms SZS Tools Logo.png]]
 
|-
 
|-
 
! Author:
 
! Author:
 
| [[user:Wiimm|Wiimm]]
 
| [[user:Wiimm|Wiimm]]
 +
|-
 +
! Operating Systems:
 +
| Linux (i386/x86_64),<br/>Windows (Cygwin), <br/>Mac (x86_64).
 
|-
 
|-
 
! Software Type:
 
! Software Type:
| [[SZS]], [[BMG]] and [[StaticR.rel]] Manager
+
| File manager, decoding and encoding toolset.
 +
|-
 +
! Compression Formats:
 +
| [[Yaz0]], Yaz1, XYZ, BZ, BZIP2, LZ, LZMA, [[WBZ]], [[WLZ]], [[YBZ]], [[YLZ]].
 +
|-
 +
! Archive Formats:
 +
| [[SZS]], [[U8]], [[WU8]], [[LTA]], [[LFL]], PACK, [[RARC]], [[BRRES]], [[BREFF]], [[BREFT]].
 
|-
 
|-
 
! File Formats:
 
! File Formats:
| [[SZS]], [[U8]], [[BRRES]], [[BREFF]], [[BREFT]], [[BMG]], [[StaticR.rel]]
+
| [[BMG]], [[BTI]], [[KCL]], [[KMG]], [[KMP]], [[MDL0]], [[PAT0]], [[TPL]], [[TEX0]], [[PNG]], [[OBJ]], [[StaticR.rel]], [[main.dol]], [[CT-CODE]], [[LE-CODE]], [[LEX]], [[LPAR]], [[ObjFlow.bin|ObjFlow]], [[GeoHitTableItem.bin|GeoHit]], [[ItemSlot.bin|ItemSlot]], [[minigame.kmg|minigame]].
 +
|-
 +
! Image formats:
 +
| I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2, CMPR.
 
|-
 
|-
 
! Current Version:
 
! Current Version:
| 0.11a
+
| v2.42a, 2024-03-26
 
|-
 
|-
 
! Website:
 
! Website:
| [http://szs.wiimm.de/ szs.wiimm.de]
+
| [https://szs.wiimm.de/ szs.wiimm.de]
 
|}
 
|}
 +
 +
'''Wiimms SZS Tools''' has a punctuation error, but you should see it as a brand name.
  
 
== Introduction ==
 
== Introduction ==
  
'''Wiimms SZS Tools''' is a set of different tools to manipulate [[SZS]], [[U8]], [[BRRES]] and [[BMG]] files. All tools are command line tools and run without any interaction. The tools are available for Linux, mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are two tools:
+
'''Wiimms SZS Tools''' is a set of different tools to manipulate [[SZS]], [[U8]], [[WU8]], [[LTA]], [[LFL]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]] archives and [[BMG]], [[BTI]], [[KCL]], [[KMP]], [[MDL0]], [[TPL]], [[TEX0]], [[DOL]] and [[StaticR.rel]] files. All tools are command line tools and run without any interaction. The tools are available for Linux, Mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are 9 tools:
* '''wszst''' : Wiimms SZS Tool (handles [[SZS]], [[U8]], [[BRRES]], [[BREFF]] and [[BREFT]] archives)
+
* '''wszst''' : Wiimms SZS Tool (handles [[SZS]], [[U8]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]] archives)
* '''wbmgt''' : Wiimms BMG Tool (handles raw and text [[BMG]] files).
+
* '''wbmgt''' : Wiimms BMG Tool (convert and patch [[BMG]] files in binary and text format).
* '''wstrt''' : Wiimms StaticR Tool (handles [[StaticR.rel]] files of [[Mario Kart Wii]]).
+
* '''wimgt''' : Wiimms Image Tool (convert and patch image files of [[Mario Kart Wii]]).
One main goal is the fully automated [[Wiimms SZS Tools/How To#Replace Track Names|track name replacement]]. Both tools together can do this. This toolset will not replace the [[SZS Modifier]] or the [[CTools]], because they are interactive tools with GUI support and can work directly with many sub file formats.
+
* '''wkclt''' : Wiimms KCL Tool (convert raw [[KCL]] files from/into obj format).
 +
* '''wkmpt''' : Wiimms KMP Tool (handles raw and text [[KMP]] files, read text files like a compiler).
 +
* '''wpatt''' : Wiimms PAT Tool (handles raw and text [[PAT0]] files, read text files like a compiler).
 +
* '''wstrt''' : Wiimms StaticR Tool (handles [[StaticR.rel]] and [[main.dol]] files of [[Mario Kart Wii]]).
 +
* '''wctct''' : Wiimms CT-CODE Tool (handles [[CT-CODE]] and [[LE-CODE]] files).
 +
* '''wlect''' : Wiimms LE-CODE Tool (handles [[LE-CODE]], [[LPAR]] and [[LEX]] files)
 +
One main goal is the fully automated [[Wiimms SZS Tools/How To#Replace Track Names|track name replacement]]. The tools together can do this. Another goal is to extract all sub files recursively and transforming they into user friendly file formats (like text of png files) and support recreation of the original source files.
  
'''There is also an little [[Wiimms SZS Tools/How To|How To]].'''
+
'''There is also a little [[Wiimms SZS Tools/How To|how to]].'''
 +
 
 +
== Main Features ==
 +
 
 +
* The tools are ''command line tools''. This means, that there is no GUI support. The main advantage is, that you can place commands into scripts (batch files) for fully automated execution &rarr; [https://szs.wiimm.de/info/cli More about ''command line''].
 +
* '''wszst''' is the main [[SZS]] tool. It has a fast [[Yaz0]] compressor with the best compression rates.
 +
* The '''wszst''' command '''CHECK''' can help you to find bugs in your track.
 +
* The new '''wszst''' command '''SLOTS''' makes a track proposal for working and non working slots.
 +
* The [[KCL]] tool '''wkclt''' can create KCL files from scratch (they become as small as possible) by reading an OBJ file. It can also export an existing [[KCL]] to an OBJ file with colors to make a KCL visible.
 +
* The [[KMP]] tool '''wkmpt''' can decode and compile (yes, it's a real compiler with loops and other control structures) [[KMP]] files.
 +
** While compiling, it can overide some parameters for debugging or optimization.
 +
** The KMP compiler can use the KCL to find optimal vertical positions of objects and route points. This is good for visual debugging.
 +
* The '''wkmpt''' command '''DRAW''' creates an OBJ file with [[KCL]] and add route positions and other objects of the [[KMP]].
 +
* The '''wszst''' command '''PATCH''' can transform whole tracks inkl. [[KCL]], [[KMP]], MODEL, MINIMAP and VRCORN. Transforming means any combinations of scaling, [[Rotation|rotating]] and shifting with different factors for each axis.
 +
* The '''wszst''' command '''MINIMAP''' can center the minimap automatically. You can use this command with [[SZS]], [[U8]], [[BRRES]] and [[MDL0]] files.
 +
* The image tool '''wimgt''' can convert images of all formats:
 +
** It can convert the file formats  [[TPL]], [[TEX0]], [[BTI]], [[BREFT]] and [[PNG]] to any other.
 +
** It can convert the [[Image Formats]] I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR to any other.
 +
** It supports the palette formats IA8, RGB565 and RGB5A3.
 +
** It can automatically create mipmaps, or it can use user defined mipmaps and create only missed mipmaps automatically.
 +
** It can patch images with other images.
 +
 
 +
== Last Features ==
 +
 
 +
=== <span id=bmg>Cygwin</span> ===
 +
 
 +
As of v2.21a, 2 Cygwin version are supported: One for 32-bit Windows and one for 64-bit Windows.
 +
 
 +
=== <span id=bmg>Porting and other address calculations</span> ===
 +
 
 +
As of v2.25a, tool ''wstrt'' supports address porting from one to all other regions. Therefore the new commands [https://szs.wiimm.de/cmd/wstrt/port PORT] and [https://szs.wiimm.de/cmd/wstrt/port WHERE] were implemented.
 +
 
 +
As of v2.26a, both commands are improved in many ways. Entered addresses can be real addresses, or file offsets, or cheat codes. By options the user can define the output format (with or without ''0x'' prefix, with or without file offsets, with or without table headers).
 +
 
 +
Please read [https://szs.wiimm.de/cmd/wstrt/port#desc wstrt PORT] and [https://szs.wiimm.de/cmd/wstrt/port#desc wstrt WHERE] for details.
  
 
== History and Download ==
 
== History and Download ==
  
=== What's new ===
+
[[Wiimm]] started the development of his SZS Tools in March 2011. The first goal was to automate the insertions of the track names for [[Wiimms Mario Kart Fun]] distributions. Therefore 2 tools have been needed: A [[SZS]] extractor and creator and a [[BMG]] manipulator. The 2 tools '''wszst''' and '''wbmgt''' were ready in April 2011. After this, [[Wiimm]] implemented an Image-Tool ('''wimgt'''),  an [[StaticR.rel]] tool ('''wstrt'''), a [[KMP]] tool ('''wkmpt''') and a [[KCL]] tool ('''wkclt'''). Other tools were added later. The last added tool is '''wlect''' to manage [[LE-CODE]] and [[LEX]] files. All tools are command line tools to support scripts and fully automated operations.
  
* Tool '''wszst''' can now list and extract [[BREFF and BREFT (File Format)|BREFF and BREFT]] files.
+
=== Latest Change Log ===
  
=== Change Log ===
 
 
<pre>
 
<pre>
szs v0.11a r2670 - 2011-06-04
+
szs v2.42a r8989 - 2024-03-26
 +
 
 +
- Updated prefix database: Added CTGPS, EX, EXTR, GK2, GK3, GK7, HGSS, HWTA,
 +
  SBSPLCP, SKK, TGO. Removed LCP.
 +
 
 +
- Bug fix for option --lex-purge: The tools occasionally crashed when
 +
  attempting to delete an existing but unneeded LEX file.
  
  - New option: --single-line (-1): No continuation lines for BMG text output.
+
  - Added support for compression methods YBZ and YLZ (Yaz0 header, but
 +
  alternative compressions bzip2 or LZMA). Use one of the new options --cybz,
 +
  --ybz, --cylz or --ylz to select the new methods. LE-CODE supports YLZ.
  
  - Support for BREFF and BREFT files: Listing and extraction, but not creation:
+
  - New option --zero (-z): This option affects the exit status of the
 +
  programs. Instead of an exit status, the value 0 is returned for OK. This
 +
  happens for notices (-v, status<15), warnings (-vv, status<29), errors
 +
  (-vvv, status<115) and fatal errors (-vvvv). The exit status for INTERRUPT
 +
  (112) is never replaced.
  
    - wszst LIST: List also BREFF and BREFT files inlcuding recursive lists.
+
- Information only: wszst now knows 243 different options.
  
    - wszst EXTRACT: Extract also BREFF and BRRES files. Recursive extraction
 
      of theses file types is implemented but disabled because of not
 
      implemented creation support.
 
  
</pre>
+
szs v2.41b r8971 - 2024-02-23
 +
 
 +
- Cygwin only: Fixed a silent stack overflow if reordering the tracks.
 +
 
 +
- New image format TPLx: Technically, TPLx is a TPL file with 2 extensions.
 +
  The main feature is the conversion of width and height so that images with
 +
  a height >65535 lines can be used. Cup icons are an example of this.
 +
 
 +
- New virtual image type CUPICON: Alias for TPLx.CMPR.
 +
 
 +
 
 +
szs v2.41a r8953 - 2024-02-17
 +
 
 +
- Update to LE-CODE build 40.
  
=== Links ===
+
- Updated prefix database: Added LEGO_Racers, Muppet_RM, POD, PP2WB, SR,
 +
  Spyro_1, Wii_U, Zelda_OoT, Zelda_TP, Zelda_WW.
  
* [http://szs.wiimm.de/changelog.html Complete History]
+
- wszst ANALYSE prints attribute "license" if file "license.txt" is detected.
* [http://szs.wiimm.de/download.html Downloads]
 
* [http://szs.wiimm.de/#l-sources Source code]
 
  
== wszst (Wiimms SZS Tool) ==
+
- File format LTA supports now an optional list with file extensions. The
 +
  idea is that tools show the correct file extensions without having to load
 +
  the entire LTA file for analysis.
  
'''wszst''' is a command driven tool to manipulate [[SZS]] files.
+
- Command wlect DISTRIB:
* [http://szs.wiimm.de/wszst Tool wszst: Features, commands and options]
+
    - WU8, WBZ and WLZ files are accepted now.
 +
    - Support of new file type USE-LTA (redirection file for LE-CODE).
 +
      Instruction lta= of command wlect DISTRIB creates such a file with
 +
      filename lta.szs if option REDIR is set.
 +
    - The new processing options +PR0, +PR1 to +PR60 control the output of
 +
      progress messages.
 +
    - New options for instruction lta=: EXT, REDIR, PR0, PR1 .. PR60.
  
=== Features ===
+
- Command wszst WILDCARDS supports options --sh and --bash to quote results.
  
* '''wszst''' supports compressed and uncompressed [[SZS]] files. Uncompressed files are good for analysis. Supported archive formats are [[U8]], [[BRRES]], [[BREFF]] and [[BREFT]]. The format of each source file is detected independent of the file name.
+
- Command wstrt PATCH and option --add-section:
* '''wszst LIST''' lists the content of a [[SZS]], [[U8]], [[BRRES]], [[BREFF]] and [[BREFT]] archives and directories. It lists also extracted file systems to preview the creation process.
+
    - GCT text files are now accepted now and converted to binary data if the
* '''wszst DIFF''' compares 2 SZS files on file level. This comparing is independent of the compression and of file order.
+
      very first 4 characters are "#GCT".
* '''wszst NORMALIZE''' read an [[U8]] archive, compressed or not, and write it back in a normalized form.
+
    - The memory map output with options -vv has been completely revised.
** The files are sorted in a ''Nintendo like'' order.
 
** Unused data holes are removed.
 
** If directory <tt>'.'</tt> is available it becomes the root directory for all others.
 
** Compressed sources are compressed again with maximum compression (level 9).
 
** The destination is only written if any data changed.
 
* '''wszst COMPRESS''' and '''wszst DECOMPRESS''' convert SZS files from and to compressed format.
 
* '''wszst EXTRACT''' extract the directories and files to the local file system to make access very easy.  Recursive extraction and automatic decoding of some file formats is also possible.
 
* '''wszst CREATE''' creates SZS files from directory structures. All files are included, include and exlcude lists are supported. Recursive creation and automatic encoding of some file formats is also possible.
 
* '''wszst CAT''' allow to access one or more sub files within SZS files. The output of all sources is concatenated and written to stdout.
 
* Extrating a [[SZS]] file and creating again results in the same SZS file. Only the internal order of the files may be changed.
 
* '''wszst DIFF''' compares 2 SZS files on file level. This comparing is independent of the compression and of file order.
 
  
=== wszst LIST ===
+
- Bug fix for commands wszst NORMALIZE and wszst PATCH: If the content has
 +
  not been changed, then the compression has not been checked. Therefore the
 +
  file was not always normalized.
  
The command '''LIST''' list the sub files of [[SZS]] files.
+
- Bug fix for wszst PATCH: A copy to the non existing cache was created even
 +
  if --cache was not set.
  
&rArr; [http://szs.wiimm.de/cmd/wszst/list wszst LIST]
+
- Implemented support for LE-CODE with 8192 tracks and 2048 cups. For this
 +
  purpose, the BMG messages for mkw-ana had to be moved to other areas.
  
'''Example:'''
+
- wlect dump: Warnings are issued if the tool can manage fewer LPAR settings
<pre>
+
  or fewer track slots than the LE-CODE image offers.
# wszst lll Award_G.szs
 
  
* Files of Award_G.szs
+
- New global option --le-04x: Use format %04x instead of %03x for LE-CODE
 +
  slots to enable uniform slot numbers if slots >4095 are used.
  
off/hex siz/hex size/dec magic file or directory/
+
  - New LPAR setting: SLOT-04X.
-------------------------------------------------------------------------------
 
      -      -        -  -    ./
 
      -      -        -  -    ./award/
 
      -      -        -  -    ./dpd_pointer/
 
      -      -        -  -    ./message/
 
    120    2580    9600  MESG  ./message/Common.bmg
 
  26a0  18300    99072  MESG  ./message/Menu.bmg
 
  1a9a0    1fc0    8128  MESG  ./message/Race.bmg
 
      -      -        -  -    ./message_window/
 
      -      -        -  -    ./pad_recognize/
 
      -      -        -  -    ./winning_run/
 
 
</pre>
 
</pre>
  
=== wszst DIFF ===
+
=== Links ===
  
The command '''DIFF''' compares two sources (each [[SZS]], [[U8]], [[BRRES]] or directory)
+
* [https://szs.wiimm.de/changelog.html Complete History]
on file level and report mismatches for each sub file.
+
* [https://szs.wiimm.de/download.html Downloads]
 +
* [https://szs.wiimm.de/#l-sources Source code]
 +
* [https://szs.wiimm.de/doc/cli Command Line Interface (CLI)]
 +
* [https://github.com/Wiimm/wii-ct-code GitHub: Wiimm/wii-ct-code]
  
&rArr; [http://szs.wiimm.de/cmd/wszst/diff wszst DIFF]
+
== Tools Overview ==
  
'''Example:'''
+
=== wszst (Wiimms SZS Tool) ===
<pre>
 
# wszst diff Award_G.szs MenuMulti_E.szs
 
  
* Only in source #1: ./award/
+
'''wszst''' is a command driven tool to manipulate archives:
* Only in source #2: ./bg/
+
* Supported archive formats: [[SZS]], [[U8]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]].
* Only in source #2: ./button/
+
* It can extract all subfiles of any archive.
* Only in source #2: ./control/
+
* While extracting some file formats can be decoded (converted to text or PNG files).
* Only in source #2: ./globe/
+
* It can create all (but not [[RARC]] archives) while readind and scanning a directory structure. Decoded files are encoded automatically.
* File size differ:  ./message/Common.bmg [9984+256=10240]
+
&rarr; [https://szs.wiimm.de/wszst Tool wszst: Features, commands and options]
* File size differ:  ./message/Menu.bmg [97920-7552=90368]
 
* Only in source #1: ./message/Race.bmg
 
* Only in source #2: ./model/
 
* Only in source #1: ./winning_run/
 
Content differ: Award_G.szs : MenuMulti_E.szs
 
</pre>
 
  
=== wszst NORMALIZE ===
+
=== wbmgt (Wiimms BMG Tool) ===
  
The command '''NORMALIZE''' read an [[U8]] archive, compressed or not,
+
'''wbmgt''' is a command driven tool to manipulate [[BMG]] (message) files.
and write it back in a normalized form:
+
<br/>&rarr; [https://szs.wiimm.de/wbmgt Tool wbmgt: Features, commands and options]
* The files are sorted in a ''Nintendo like'' order.
 
** ('/' is less than) '.' is less than digits is less than letters is less than others.
 
** The case of letters is ignored.
 
** For same group of characters use ASCII order.
 
** For each directory: Real files are inserted before sub directories.
 
* Unused data holes are removed.
 
* If directory <tt>'.'</tt> is available it becomes the root directory for all others.
 
* Compressed sources are compressed again with maximum compression (level 9).
 
* The destination is only written if any data changed.
 
  
Normalized files are for archives and to find files with the same content.
+
=== wkclt (Wiimms KCL Tool) ===
  
&rArr; [http://szs.wiimm.de/cmd/wszst/normalize wszst NORMALIZE]
+
'''wkclt''' is a command driven tool to convert [[KCL]] files into/from binary KCL from/into Wavefront OBJ files.
 +
<br/>&rarr; [https://szs.wiimm.de/wkclt Tool wkclt: Features, commands and options]
 +
<br/>&rarr; [https://szs.wiimm.de/doc/syntax General parser syntax and semantics]
 +
<br/>&rarr; [https://szs.wiimm.de/doc/kcl KCL export and import guide]
  
== wbmgt (Wiimms BMG Tool) ==
+
=== wkmpt (Wiimms KMP Tool) ===
  
'''wbmgt''' is a command driven tool to manipulate [[BMG]] files.
+
'''wkmpt''' is a command driven tool to convert [[KMP]] files into/from binary from/into text files. A special compiler is used to allow variables, expressions, if..then..else, loops, macros and user defined functions while reading a KMP text file.
* [http://szs.wiimm.de/wbmgt Tool wbmgt: Features, commands and options]
+
<br/>&rarr; [https://szs.wiimm.de/wkmpt Tool wkmpt: Features, commands and options]
 +
<br/>&rarr; [https://szs.wiimm.de/doc/syntax General parser syntax and semantics]
 +
<br/>&rarr; [https://szs.wiimm.de/doc/kmp/syntax KMP text syntax and semantics]
 +
<br/>&rarr; [https://szs.wiimm.de/doc/kmp/func KMP parser functions]
 +
<br/>&rarr; [[Wiimms SZS Tools/KMP|How to edit KMP files]]
  
=== Features ===
+
=== wimgt (Wiimms Image Tool) ===
  
* '''wbmgt''' supports raw and text BMG files. '''Raw BMG''' is the file format needed by Nintendos software. '''Text BMG''' is a user readable and editable format. '''wbmgt''' includes in every text export a little syntax documentation.
+
'''wimgt''' is a command driven tool to convert and aptch graphic images:
* When reading a file, '''wbmgt''' detect the format of each source file independent of the file name. This make the usage of raw and text BMG files interchangeable.
+
* '''wimgt''' supports the file formats [[BREFT]], [[BTI]], [[TEX0]], [[TPL]] and [[PNG]] as export and import type.
* '''wbmgt''' may read BMG files directly from SZS files. Just enter the path and assume that the SZS file is a directory. Example: <tt>pathto/my.szs/message/Common.bmg</tt>
+
* '''wimgt''' supports the internal image formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR (and also different PNG formats).
* '''wbmgt LIST''' lists the contained strings for a fast preview.
+
&rarr; [https://szs.wiimm.de/wimgt Tool wimgt: Features, commands and options]
* '''wbmgt DIFF''' compares the strings of 2 BMG files and reports the differences.
 
* '''wbmgt PATCH''' patches each source by using a list of patch files. There are several patching modes: REPLACE, INSERT, OVERWRITE, DELETE, MASK, EQUAL and NONEQUAL. Like every source, raw and text BMG files are accepted as patch.
 
* '''wbmgt DECODE''' converts each source file into text mode. Patching while decoding is possible.
 
* '''wbmgt ENCODE''' converts each source file into raw mode. Patching while encoding is possible.
 
* Decoding a raw BMG file and encoding again results in the same BMG file.
 
  
== wstrt (Wiimms StaticR Tool) ==
+
=== wstrt (Wiimms StaticR Tool) ===
  
 
'''wstrt''' is a command driven tool to manipulate [[StaticR]] files of [[Mario Kart Wii]].
 
'''wstrt''' is a command driven tool to manipulate [[StaticR]] files of [[Mario Kart Wii]].
* [http://szs.wiimm.de/wstrt Tool wstrt: Features, commands and options]
+
<br/>&rarr; [https://szs.wiimm.de/wstrt Tool wstrt: Features, commands and options]
 +
 
 +
=== wctct (Wiimms CT-CODE Tool) ===
 +
 
 +
'''wctct ''' is a command driven tool to manage [[CT-CODE]] distributions. It also supports [[LE-CODE]] distributions.
 +
 
 +
=== wlect (Wiimms LE-CODE Tool) ===
  
=== Features ===
+
'''wlect ''' is a command driven tool to manage [[LE-CODE]] distributions. See [[LE-CODE/Distribution Tutorial|LE-CODE Distribution Tutorial]] for details.
  
* '''wstrt''' can analyze and patch StaticR files of Mario Kart Wii (PAL and NTSC).
 
* '''wstrt ANALYZE''' analyzes StaticR files and detects CTGP 4.4 patches and modifications of track and arena orders. A possible patch is virtually applied before prinbting.
 
* '''wstrt PATCH''' modifies the track and arena order of StaticR files. So it is possible to move tracks with special features (like snow or fog) to other slots.
 
* '''wstrt TRACKS''' and '''wstrt ARENAS''' print a list of tracks or arenas with slots and filenames (track and sound files). If a StaticR file is entered, the track/arena order of that StaticR is used. A possible patch is virtually applied before prinbting.
 
* '''wstrt FILES''' prints a list of filenames of all tracks and arenas in machine readable format. If a StaticR file is entered, the track and arena order of that StaticR is used. A possible patch is virtually applied before prinbting.
 
  
== Tests ==
+
== Links ==
 +
* How To
 +
** [[Wiimms SZS Tools/How To|General How To]]
 +
** [[Wiimms SZS Tools/KMP|KMP How To]]
 +
** [[Creating a KCL with Wiimms Tools]]
 +
** [[wkmpt DRAW]]
  
I have made several tests with the following files:
+
* [https://szs.wiimm.de/ Wiimms SZS Tools]
* All files of <tt>Scene/UI/</tt>.
+
** Features, commands and options: [https://szs.wiimm.de/wszst wszst], [https://szs.wiimm.de/wbmgt wbmgt],  [https://szs.wiimm.de/wkmpt wkmpt], [https://szs.wiimm.de/wimgt wimgt], [https://szs.wiimm.de/wstrt wstrt], [https://szs.wiimm.de/wctct wctct]
* All files of <tt>Race/Course/</tt>, some of the tracks have been replaced by custom tracks before.
+
** [https://szs.wiimm.de/download.html Downloads]
  
The tests:
+
* Graphical user interfaces (GUI)
* Decompress and compress and decompress again [[SZS]] files and compare the results.
+
** [[Wiimm's Tool Manager]]
* Extract all files, create SZS and extract again. The both extracted file system are equal.
+
** [[Speed & Lap Modifier Tool]]
* Extract some of the files with SZS Explorer and compare them to my extracted files.
 
* Extract all files and create a new SZS files. Then create a new ISO image with the new SZS files and play it.
 
* Read [[BMG]] file, convert to internal representation and write a new BMG file. Then compare the new BMG with the original one.
 
* Convert all BMG files into the text format and back again. Then compare the new BMG with the original one.
 
  
All tests run without errors.
+
* [[KMP]] & [[KCL]] Parser
 +
** [https://szs.wiimm.de/doc/syntax General parser syntax and semantics]
 +
** [https://szs.wiimm.de/doc/kmp/syntax KMP text syntax and semantics]
 +
** [https://szs.wiimm.de/doc/kmp/func KMP parser functions]
 +
** [https://szs.wiimm.de/doc/kcl KCL export and import guide]
 +
** [https://szs.wiimm.de/info/respawn-setup.html Automatic setup of respawn points]
  
== Links ==
+
* Forums
* [http://szs.wiimm.de/ Wiimms SZS Tools]
+
** [https://gbatemp.net/threads/wiimms-szs-tools.286476/ Discussion at GBAtemp.net]
** [http://szs.wiimm.de/wszst Tool wszst: Features, commands and options]
+
** [https://forum.wii-homebrew.com/index.php/Thread/28447-Wiimms-SZS-Tools/ Discussion at Wii-Homebrew.com] (german forum)
** [http://szs.wiimm.de/wbmgt Tool wbmgt: Features, commands and options]
 
** [http://szs.wiimm.de/download.html Downloads]
 
* [http://www.mariokartwii.com/f72/wiimms-szs-tools-75689.html Discussion at MarioKartWii.com]
 
* [http://gbatemp.net/t286476-wiimms-szs-tools?view=findpost&p=3559819 Discussion at GBAtemp.net]
 
* [http://forum.wii-homebrew.com/board197-pc-tools/p319981-wiimms-szs-tools/#post319981 Discussion at Wii-Homebrew.com] (german forum)
 
  
 +
* Misc.
 +
** [[Automated height correction]]
  
{{Custom Track Tutorial}}
 
 
{{User-Wiimm-Link}}
 
{{User-Wiimm-Link}}
 
[[category:Software]]
 
[[category:Software]]
 +
[[category:Wiimms SZS Tools]]
 +
[[category:LE-CODE]]

Latest revision as of 09:58, 26 March 2024

Wiimms SZS Tools
Wiimms SZS Tools Logo.png
Author: Wiimm
Operating Systems: Linux (i386/x86_64),
Windows (Cygwin),
Mac (x86_64).
Software Type: File manager, decoding and encoding toolset.
Compression Formats: Yaz0, Yaz1, XYZ, BZ, BZIP2, LZ, LZMA, WBZ, WLZ, YBZ, YLZ.
Archive Formats: SZS, U8, WU8, LTA, LFL, PACK, RARC, BRRES, BREFF, BREFT.
File Formats: BMG, BTI, KCL, KMG, KMP, MDL0, PAT0, TPL, TEX0, PNG, OBJ, StaticR.rel, main.dol, CT-CODE, LE-CODE, LEX, LPAR, ObjFlow, GeoHit, ItemSlot, minigame.
Image formats: I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2, CMPR.
Current Version: v2.42a, 2024-03-26
Website: szs.wiimm.de

Wiimms SZS Tools has a punctuation error, but you should see it as a brand name.

Introduction

Wiimms SZS Tools is a set of different tools to manipulate SZS, U8, WU8, LTA, LFL, RARC, BRRES, BREFF and BREFT archives and BMG, BTI, KCL, KMP, MDL0, TPL, TEX0, DOL and StaticR.rel files. All tools are command line tools and run without any interaction. The tools are available for Linux, Mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are 9 tools:

  • wszst : Wiimms SZS Tool (handles SZS, U8, RARC, BRRES, BREFF and BREFT archives)
  • wbmgt : Wiimms BMG Tool (convert and patch BMG files in binary and text format).
  • wimgt : Wiimms Image Tool (convert and patch image files of Mario Kart Wii).
  • wkclt : Wiimms KCL Tool (convert raw KCL files from/into obj format).
  • wkmpt : Wiimms KMP Tool (handles raw and text KMP files, read text files like a compiler).
  • wpatt : Wiimms PAT Tool (handles raw and text PAT0 files, read text files like a compiler).
  • wstrt : Wiimms StaticR Tool (handles StaticR.rel and main.dol files of Mario Kart Wii).
  • wctct : Wiimms CT-CODE Tool (handles CT-CODE and LE-CODE files).
  • wlect : Wiimms LE-CODE Tool (handles LE-CODE, LPAR and LEX files)

One main goal is the fully automated track name replacement. The tools together can do this. Another goal is to extract all sub files recursively and transforming they into user friendly file formats (like text of png files) and support recreation of the original source files.

There is also a little how to.

Main Features

  • The tools are command line tools. This means, that there is no GUI support. The main advantage is, that you can place commands into scripts (batch files) for fully automated execution → More about command line.
  • wszst is the main SZS tool. It has a fast Yaz0 compressor with the best compression rates.
  • The wszst command CHECK can help you to find bugs in your track.
  • The new wszst command SLOTS makes a track proposal for working and non working slots.
  • The KCL tool wkclt can create KCL files from scratch (they become as small as possible) by reading an OBJ file. It can also export an existing KCL to an OBJ file with colors to make a KCL visible.
  • The KMP tool wkmpt can decode and compile (yes, it's a real compiler with loops and other control structures) KMP files.
    • While compiling, it can overide some parameters for debugging or optimization.
    • The KMP compiler can use the KCL to find optimal vertical positions of objects and route points. This is good for visual debugging.
  • The wkmpt command DRAW creates an OBJ file with KCL and add route positions and other objects of the KMP.
  • The wszst command PATCH can transform whole tracks inkl. KCL, KMP, MODEL, MINIMAP and VRCORN. Transforming means any combinations of scaling, rotating and shifting with different factors for each axis.
  • The wszst command MINIMAP can center the minimap automatically. You can use this command with SZS, U8, BRRES and MDL0 files.
  • The image tool wimgt can convert images of all formats:
    • It can convert the file formats TPL, TEX0, BTI, BREFT and PNG to any other.
    • It can convert the Image Formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR to any other.
    • It supports the palette formats IA8, RGB565 and RGB5A3.
    • It can automatically create mipmaps, or it can use user defined mipmaps and create only missed mipmaps automatically.
    • It can patch images with other images.

Last Features

Cygwin

As of v2.21a, 2 Cygwin version are supported: One for 32-bit Windows and one for 64-bit Windows.

Porting and other address calculations

As of v2.25a, tool wstrt supports address porting from one to all other regions. Therefore the new commands PORT and WHERE were implemented.

As of v2.26a, both commands are improved in many ways. Entered addresses can be real addresses, or file offsets, or cheat codes. By options the user can define the output format (with or without 0x prefix, with or without file offsets, with or without table headers).

Please read wstrt PORT and wstrt WHERE for details.

History and Download

Wiimm started the development of his SZS Tools in March 2011. The first goal was to automate the insertions of the track names for Wiimms Mario Kart Fun distributions. Therefore 2 tools have been needed: A SZS extractor and creator and a BMG manipulator. The 2 tools wszst and wbmgt were ready in April 2011. After this, Wiimm implemented an Image-Tool (wimgt), an StaticR.rel tool (wstrt), a KMP tool (wkmpt) and a KCL tool (wkclt). Other tools were added later. The last added tool is wlect to manage LE-CODE and LEX files. All tools are command line tools to support scripts and fully automated operations.

Latest Change Log

szs v2.42a r8989 - 2024-03-26

 - Updated prefix database: Added CTGPS, EX, EXTR, GK2, GK3, GK7, HGSS, HWTA,
   SBSPLCP, SKK, TGO. Removed LCP.

 - Bug fix for option --lex-purge: The tools occasionally crashed when
   attempting to delete an existing but unneeded LEX file.

 - Added support for compression methods YBZ and YLZ (Yaz0 header, but
   alternative compressions bzip2 or LZMA). Use one of the new options --cybz,
   --ybz, --cylz or --ylz to select the new methods. LE-CODE supports YLZ.

 - New option --zero (-z): This option affects the exit status of the
   programs. Instead of an exit status, the value 0 is returned for OK. This
   happens for notices (-v, status<15), warnings (-vv, status<29), errors
   (-vvv, status<115) and fatal errors (-vvvv). The exit status for INTERRUPT
   (112) is never replaced.

 - Information only: wszst now knows 243 different options.


szs v2.41b r8971 - 2024-02-23

 - Cygwin only: Fixed a silent stack overflow if reordering the tracks.

 - New image format TPLx: Technically, TPLx is a TPL file with 2 extensions.
   The main feature is the conversion of width and height so that images with
   a height >65535 lines can be used. Cup icons are an example of this.

 - New virtual image type CUPICON: Alias for TPLx.CMPR.


szs v2.41a r8953 - 2024-02-17

 - Update to LE-CODE build 40.

 - Updated prefix database: Added LEGO_Racers, Muppet_RM, POD, PP2WB, SR,
   Spyro_1, Wii_U, Zelda_OoT, Zelda_TP, Zelda_WW.

 - wszst ANALYSE prints attribute "license" if file "license.txt" is detected.

 - File format LTA supports now an optional list with file extensions. The
   idea is that tools show the correct file extensions without having to load
   the entire LTA file for analysis.

 - Command wlect DISTRIB:
    - WU8, WBZ and WLZ files are accepted now.
    - Support of new file type USE-LTA (redirection file for LE-CODE).
      Instruction lta= of command wlect DISTRIB creates such a file with
      filename lta.szs if option REDIR is set.
    - The new processing options +PR0, +PR1 to +PR60 control the output of
      progress messages.
    - New options for instruction lta=: EXT, REDIR, PR0, PR1 .. PR60.

 - Command wszst WILDCARDS supports options --sh and --bash to quote results.

 - Command wstrt PATCH and option --add-section:
    - GCT text files are now accepted now and converted to binary data if the
      very first 4 characters are "#GCT".
    - The memory map output with options -vv has been completely revised.

 - Bug fix for commands wszst NORMALIZE and wszst PATCH: If the content has
   not been changed, then the compression has not been checked. Therefore the
   file was not always normalized.

 - Bug fix for wszst PATCH: A copy to the non existing cache was created even
   if --cache was not set.

 - Implemented support for LE-CODE with 8192 tracks and 2048 cups. For this
   purpose, the BMG messages for mkw-ana had to be moved to other areas.

 - wlect dump: Warnings are issued if the tool can manage fewer LPAR settings
   or fewer track slots than the LE-CODE image offers.

 - New global option --le-04x: Use format %04x instead of %03x for LE-CODE
   slots to enable uniform slot numbers if slots >4095 are used.

 - New LPAR setting: SLOT-04X.

Links

Tools Overview

wszst (Wiimms SZS Tool)

wszst is a command driven tool to manipulate archives:

  • Supported archive formats: SZS, U8, RARC, BRRES, BREFF and BREFT.
  • It can extract all subfiles of any archive.
  • While extracting some file formats can be decoded (converted to text or PNG files).
  • It can create all (but not RARC archives) while readind and scanning a directory structure. Decoded files are encoded automatically.

Tool wszst: Features, commands and options

wbmgt (Wiimms BMG Tool)

wbmgt is a command driven tool to manipulate BMG (message) files.
Tool wbmgt: Features, commands and options

wkclt (Wiimms KCL Tool)

wkclt is a command driven tool to convert KCL files into/from binary KCL from/into Wavefront OBJ files.
Tool wkclt: Features, commands and options
General parser syntax and semantics
KCL export and import guide

wkmpt (Wiimms KMP Tool)

wkmpt is a command driven tool to convert KMP files into/from binary from/into text files. A special compiler is used to allow variables, expressions, if..then..else, loops, macros and user defined functions while reading a KMP text file.
Tool wkmpt: Features, commands and options
General parser syntax and semantics
KMP text syntax and semantics
KMP parser functions
How to edit KMP files

wimgt (Wiimms Image Tool)

wimgt is a command driven tool to convert and aptch graphic images:

  • wimgt supports the file formats BREFT, BTI, TEX0, TPL and PNG as export and import type.
  • wimgt supports the internal image formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR (and also different PNG formats).

Tool wimgt: Features, commands and options

wstrt (Wiimms StaticR Tool)

wstrt is a command driven tool to manipulate StaticR files of Mario Kart Wii.
Tool wstrt: Features, commands and options

wctct (Wiimms CT-CODE Tool)

wctct is a command driven tool to manage CT-CODE distributions. It also supports LE-CODE distributions.

wlect (Wiimms LE-CODE Tool)

wlect is a command driven tool to manage LE-CODE distributions. See LE-CODE Distribution Tutorial for details.


Links