Difference between revisions of "Wiimms SZS Tools"

From Custom Mario Kart
Jump to navigation Jump to search
(Wiimms SZS Tools v2.37a released)
(Wiimms SZS Tools v2.42a released)
 
(9 intermediate revisions by 2 users not shown)
Line 13: Line 13:
 
|-
 
|-
 
! Compression Formats:
 
! Compression Formats:
| [[Yaz0]], Yaz1, [[WBZ]].
+
| [[Yaz0]], Yaz1, XYZ, BZ, BZIP2, LZ, LZMA, [[WBZ]], [[WLZ]], [[YBZ]], [[YLZ]].
 
|-
 
|-
 
! Archive Formats:
 
! Archive Formats:
Line 25: Line 25:
 
|-
 
|-
 
! Current Version:
 
! Current Version:
| v2.37a, 2023-09-09
+
| v2.42a, 2024-03-26
 
|-
 
|-
 
! Website:
 
! Website:
Line 35: Line 35:
 
== Introduction ==
 
== Introduction ==
  
'''Wiimms SZS Tools''' is a set of different tools to manipulate [[SZS]], [[U8]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]] archives and [[BMG]], [[BTI]], [[KCL]], [[KMP]], [[MDL0]], [[TPL]], [[TEX0]] and [[StaticR.rel]] files. All tools are command line tools and run without any interaction. The tools are available for Linux, Mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are 9 tools:
+
'''Wiimms SZS Tools''' is a set of different tools to manipulate [[SZS]], [[U8]], [[WU8]], [[LTA]], [[LFL]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]] archives and [[BMG]], [[BTI]], [[KCL]], [[KMP]], [[MDL0]], [[TPL]], [[TEX0]], [[DOL]] and [[StaticR.rel]] files. All tools are command line tools and run without any interaction. The tools are available for Linux, Mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are 9 tools:
 
* '''wszst''' : Wiimms SZS Tool (handles [[SZS]], [[U8]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]] archives)
 
* '''wszst''' : Wiimms SZS Tool (handles [[SZS]], [[U8]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]] archives)
 
* '''wbmgt''' : Wiimms BMG Tool (convert and patch [[BMG]] files in binary and text format).
 
* '''wbmgt''' : Wiimms BMG Tool (convert and patch [[BMG]] files in binary and text format).
Line 74: Line 74:
  
 
As of v2.21a, 2 Cygwin version are supported: One for 32-bit Windows and one for 64-bit Windows.
 
As of v2.21a, 2 Cygwin version are supported: One for 32-bit Windows and one for 64-bit Windows.
 
=== <span id=bmg>Mac OS</span> ===
 
 
As of v2.24a, the ARM version for Mac is supported.
 
  
 
=== <span id=bmg>Porting and other address calculations</span> ===
 
=== <span id=bmg>Porting and other address calculations</span> ===
  
As of v2.25a, tool ''wstrt'' supports address porting from one to all other regions. Therefor the new commands [https://szs.wiimm.de/cmd/wstrt/port PORT] and [https://szs.wiimm.de/cmd/wstrt/port WHERE] were implemented.
+
As of v2.25a, tool ''wstrt'' supports address porting from one to all other regions. Therefore the new commands [https://szs.wiimm.de/cmd/wstrt/port PORT] and [https://szs.wiimm.de/cmd/wstrt/port WHERE] were implemented.
  
 
As of v2.26a, both commands are improved in many ways. Entered addresses can be real addresses, or file offsets, or cheat codes. By options the user can define the output format (with or without ''0x'' prefix, with or without file offsets, with or without table headers).
 
As of v2.26a, both commands are improved in many ways. Entered addresses can be real addresses, or file offsets, or cheat codes. By options the user can define the output format (with or without ''0x'' prefix, with or without file offsets, with or without table headers).
Line 94: Line 90:
  
 
<pre>
 
<pre>
szs v2.37a r8863 - 2023-09-09
+
szs v2.42a r8989 - 2024-03-26
  
  - Option --max-file-size=SIZE now accepts sizes up to 2 GiB. For LTA files
+
  - Updated prefix database: Added CTGPS, EX, EXTR, GK2, GK3, GK7, HGSS, HWTA,
   it is automatically set to 2 GiB.
+
   SBSPLCP, SKK, TGO. Removed LCP.
  
  - New file format: LTA = LE-CODE Track Archive.
+
  - Bug fix for option --lex-purge: The tools occasionally crashed when
   Sometime in the future such archives will replace the individual track
+
   attempting to delete an existing but unneeded LEX file.
  files to save space (smaller file list) in LE-CODE distributions. In
 
  addition, common files are to be managed so that the extraction of these
 
  files by the distribution creator is no longer necessary.
 
  
  - New file format: LFL = LE-CODE File List
+
  - Added support for compression methods YBZ and YLZ (Yaz0 header, but
   The file format was developed to store the common files in LTA files in
+
  alternative compressions bzip2 or LZMA). Use one of the new options --cybz,
  a way that LE-CODE can use easily.
+
   --ybz, --cylz or --ylz to select the new methods. LE-CODE supports YLZ.
  
  - wlect distrib:
+
  - New option --zero (-z): This option affects the exit status of the
    - New string type 'PATH', which manages paths to the track files.
+
  programs. Instead of an exit status, the value 0 is returned for OK. This
    - New instructions LTA=DIRECTORY and LTA-RM=DIRECTORY, which will create
+
  happens for notices (-v, status<15), warnings (-vv, status<29), errors
      LE-CODE Track Archives.
+
  (-vvv, status<115) and fatal errors (-vvvv). The exit status for INTERRUPT
 +
  (112) is never replaced.
  
  - wszst XCOMMON: If at least 1 file is extracted, then file "avail.txt" is
+
  - Information only: wszst now knows 243 different options.
  created. This helps LE-CODE to detect extracted common files, because we
 
  don't know how to detect directories by LE-CODE.
 
  
- New LPAR setting: USE-AVAIL-TXT.
 
  
 +
szs v2.41b r8971 - 2024-02-23
  
szs v2.36a r8834 - 2023-07-22
+
- Cygwin only: Fixed a silent stack overflow if reordering the tracks.
  
  - Wildcard parsing has been reworked. In particular, the pipe character is
+
  - New image format TPLx: Technically, TPLx is a TPL file with 2 extensions.
  now used as a special control character. In addition, the combined use with
+
   The main feature is the conversion of width and height so that images with
   sub-files has been implemented for some commands. See built-in help and
+
   a height >65535 lines can be used. Cup icons are an example of this.
   https://szs.wiimm.de/doc/wildcards for details.
 
  
  - New global option --no-wildcards: Disable wildcard parsing and use each
+
  - New virtual image type CUPICON: Alias for TPLx.CMPR.
  filename exactly as specified.
 
  
- The 114 commands of the following list including their short cuts accept
 
  wildcards as source now:
 
    - wszst: ANALYZE AUTOADD BINARY BMG BRSUB CAT CHECK COMPRESS COPY CREATE
 
            DECOMPRESS DISTRIBUTION DUMP ENCODE EXTRACT FEATURES FILETYPE
 
            GHOST ILIST INFO INSTALL IS-ARENA IS-TEXTURE KCL KMP LEX MEMORY
 
            MINIMAP NAME-REF NORMALIZE PATCH SHA1 SLOTS SPLIT STGI TEXT
 
            UPDATE XALL XCOMMON XDECODE XEXPORT YAZDUMP
 
    - wbmgt: CAT DECODE ENCODE FILETYPE LIST MIX SECTIONS PATCH SLOTS
 
    - wctct: CAT CREATE DECODE DUMP FILETYPE PATCH
 
    - wimgt: CONVERT COPY DECODE ENCODE FILETYPE LIST
 
    - wkclt: ANALYZE BLOW CAT CFF CHECK COPY DECODE DUMP ENCODE FILETYPE
 
            FLAGS LIST SHA1 TRIANGLES
 
    - wkmpt: CAT CHECK DECODE DRAW ENCODE FILETYPE GAMEMODES GOBJ KTPT ROUTES
 
            STGI
 
    - wlect: CAT DECODE DUMP ENCODE FILETYPE LPAR PATCH TIMESTAMP
 
    - wmdlt: CAT DECODE ENCODE FILETYPE GEOMETRY STRINGS XTEST
 
    - wpatt: CAT DECODE ENCODE FILETYPE
 
    - wstrt: ANALYZE DUMP EXTRACT FILETYPE HEXDUMP HTTPS PATCH
 
  
- Tool wszst: New option --9laps patches files Race*.szs to enable lap 9.
+
szs v2.41a r8953 - 2024-02-17
  It is based on https://wiki.tockdom.com/wiki/Lap_Texture_Fix by Wingcapman.
 
  
  - For LE-CODE developers only:
+
  - Update to LE-CODE build 40.
    - LPAR:DEVELOPER-MODES can allow or forbid different developer modes.
 
    - LPAR:DEV-MODE1 .. LPAR:DEV-MODE3: Define some global developer modes.
 
    - New LEX section DEV1: Define some track dependent developer modes.
 
  
 +
- Updated prefix database: Added LEGO_Racers, Muppet_RM, POD, PP2WB, SR,
 +
  Spyro_1, Wii_U, Zelda_OoT, Zelda_TP, Zelda_WW.
  
szs v2.35a r8801 - 2023-07-11
+
- wszst ANALYSE prints attribute "license" if file "license.txt" is detected.
  
  - Updated prefix database: Added MK8DX (alias of SW), MK8S, SBSPBfBB, SMB,
+
  - File format LTA supports now an optional list with file extensions. The
   SMBM, TFR, ZeldaWW (alias of WW).
+
   idea is that tools show the correct file extensions without having to load
 +
  the entire LTA file for analysis.
  
  - Support for online-time-limit by LPAR and LEX:SET1.
+
  - Command wlect DISTRIB:
 +
    - WU8, WBZ and WLZ files are accepted now.
 +
    - Support of new file type USE-LTA (redirection file for LE-CODE).
 +
      Instruction lta= of command wlect DISTRIB creates such a file with
 +
      filename lta.szs if option REDIR is set.
 +
    - The new processing options +PR0, +PR1 to +PR60 control the output of
 +
      progress messages.
 +
    - New options for instruction lta=: EXT, REDIR, PR0, PR1 .. PR60.
  
  - Support for new LEX section RITP (Random next-links @KMP:ITPH).
+
  - Command wszst WILDCARDS supports options --sh and --bash to quote results.
  
  - Fixed end-of-line bugs in LEX text output (CR+LF required for Windows).
+
  - Command wstrt PATCH and option --add-section:
 +
    - GCT text files are now accepted now and converted to binary data if the
 +
      very first 4 characters are "#GCT".
 +
    - The memory map output with options -vv has been completely revised.
  
  - wlect dump: Colored flags.
+
- Bug fix for commands wszst NORMALIZE and wszst PATCH: If the content has
 +
  not been changed, then the compression has not been checked. Therefore the
 +
  file was not always normalized.
 +
 
 +
- Bug fix for wszst PATCH: A copy to the non existing cache was created even
 +
  if --cache was not set.
 +
 
 +
- Implemented support for LE-CODE with 8192 tracks and 2048 cups. For this
 +
  purpose, the BMG messages for mkw-ana had to be moved to other areas.
 +
 
 +
  - wlect dump: Warnings are issued if the tool can manage fewer LPAR settings
 +
  or fewer track slots than the LE-CODE image offers.
 +
 
 +
- New global option --le-04x: Use format %04x instead of %03x for LE-CODE
 +
  slots to enable uniform slot numbers if slots >4095 are used.
 +
 
 +
- New LPAR setting: SLOT-04X.
 
</pre>
 
</pre>
  
Line 180: Line 177:
 
* [https://szs.wiimm.de/doc/cli Command Line Interface (CLI)]
 
* [https://szs.wiimm.de/doc/cli Command Line Interface (CLI)]
 
* [https://github.com/Wiimm/wii-ct-code GitHub: Wiimm/wii-ct-code]
 
* [https://github.com/Wiimm/wii-ct-code GitHub: Wiimm/wii-ct-code]
 
=== <span id=beta>v2.28.beta2</span> ===
 
 
Wiimm released a beta version:
 
* [https://szs.wiimm.de/changelog.html#r8627​ Change Log]
 
* [https://szs.wiimm.de/download.html#beta​ Download]
 
  
 
== Tools Overview ==
 
== Tools Overview ==

Latest revision as of 09:58, 26 March 2024

Wiimms SZS Tools
Wiimms SZS Tools Logo.png
Author: Wiimm
Operating Systems: Linux (i386/x86_64),
Windows (Cygwin),
Mac (x86_64).
Software Type: File manager, decoding and encoding toolset.
Compression Formats: Yaz0, Yaz1, XYZ, BZ, BZIP2, LZ, LZMA, WBZ, WLZ, YBZ, YLZ.
Archive Formats: SZS, U8, WU8, LTA, LFL, PACK, RARC, BRRES, BREFF, BREFT.
File Formats: BMG, BTI, KCL, KMG, KMP, MDL0, PAT0, TPL, TEX0, PNG, OBJ, StaticR.rel, main.dol, CT-CODE, LE-CODE, LEX, LPAR, ObjFlow, GeoHit, ItemSlot, minigame.
Image formats: I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2, CMPR.
Current Version: v2.42a, 2024-03-26
Website: szs.wiimm.de

Wiimms SZS Tools has a punctuation error, but you should see it as a brand name.

Introduction

Wiimms SZS Tools is a set of different tools to manipulate SZS, U8, WU8, LTA, LFL, RARC, BRRES, BREFF and BREFT archives and BMG, BTI, KCL, KMP, MDL0, TPL, TEX0, DOL and StaticR.rel files. All tools are command line tools and run without any interaction. The tools are available for Linux, Mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are 9 tools:

  • wszst : Wiimms SZS Tool (handles SZS, U8, RARC, BRRES, BREFF and BREFT archives)
  • wbmgt : Wiimms BMG Tool (convert and patch BMG files in binary and text format).
  • wimgt : Wiimms Image Tool (convert and patch image files of Mario Kart Wii).
  • wkclt : Wiimms KCL Tool (convert raw KCL files from/into obj format).
  • wkmpt : Wiimms KMP Tool (handles raw and text KMP files, read text files like a compiler).
  • wpatt : Wiimms PAT Tool (handles raw and text PAT0 files, read text files like a compiler).
  • wstrt : Wiimms StaticR Tool (handles StaticR.rel and main.dol files of Mario Kart Wii).
  • wctct : Wiimms CT-CODE Tool (handles CT-CODE and LE-CODE files).
  • wlect : Wiimms LE-CODE Tool (handles LE-CODE, LPAR and LEX files)

One main goal is the fully automated track name replacement. The tools together can do this. Another goal is to extract all sub files recursively and transforming they into user friendly file formats (like text of png files) and support recreation of the original source files.

There is also a little how to.

Main Features

  • The tools are command line tools. This means, that there is no GUI support. The main advantage is, that you can place commands into scripts (batch files) for fully automated execution → More about command line.
  • wszst is the main SZS tool. It has a fast Yaz0 compressor with the best compression rates.
  • The wszst command CHECK can help you to find bugs in your track.
  • The new wszst command SLOTS makes a track proposal for working and non working slots.
  • The KCL tool wkclt can create KCL files from scratch (they become as small as possible) by reading an OBJ file. It can also export an existing KCL to an OBJ file with colors to make a KCL visible.
  • The KMP tool wkmpt can decode and compile (yes, it's a real compiler with loops and other control structures) KMP files.
    • While compiling, it can overide some parameters for debugging or optimization.
    • The KMP compiler can use the KCL to find optimal vertical positions of objects and route points. This is good for visual debugging.
  • The wkmpt command DRAW creates an OBJ file with KCL and add route positions and other objects of the KMP.
  • The wszst command PATCH can transform whole tracks inkl. KCL, KMP, MODEL, MINIMAP and VRCORN. Transforming means any combinations of scaling, rotating and shifting with different factors for each axis.
  • The wszst command MINIMAP can center the minimap automatically. You can use this command with SZS, U8, BRRES and MDL0 files.
  • The image tool wimgt can convert images of all formats:
    • It can convert the file formats TPL, TEX0, BTI, BREFT and PNG to any other.
    • It can convert the Image Formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR to any other.
    • It supports the palette formats IA8, RGB565 and RGB5A3.
    • It can automatically create mipmaps, or it can use user defined mipmaps and create only missed mipmaps automatically.
    • It can patch images with other images.

Last Features

Cygwin

As of v2.21a, 2 Cygwin version are supported: One for 32-bit Windows and one for 64-bit Windows.

Porting and other address calculations

As of v2.25a, tool wstrt supports address porting from one to all other regions. Therefore the new commands PORT and WHERE were implemented.

As of v2.26a, both commands are improved in many ways. Entered addresses can be real addresses, or file offsets, or cheat codes. By options the user can define the output format (with or without 0x prefix, with or without file offsets, with or without table headers).

Please read wstrt PORT and wstrt WHERE for details.

History and Download

Wiimm started the development of his SZS Tools in March 2011. The first goal was to automate the insertions of the track names for Wiimms Mario Kart Fun distributions. Therefore 2 tools have been needed: A SZS extractor and creator and a BMG manipulator. The 2 tools wszst and wbmgt were ready in April 2011. After this, Wiimm implemented an Image-Tool (wimgt), an StaticR.rel tool (wstrt), a KMP tool (wkmpt) and a KCL tool (wkclt). Other tools were added later. The last added tool is wlect to manage LE-CODE and LEX files. All tools are command line tools to support scripts and fully automated operations.

Latest Change Log

szs v2.42a r8989 - 2024-03-26

 - Updated prefix database: Added CTGPS, EX, EXTR, GK2, GK3, GK7, HGSS, HWTA,
   SBSPLCP, SKK, TGO. Removed LCP.

 - Bug fix for option --lex-purge: The tools occasionally crashed when
   attempting to delete an existing but unneeded LEX file.

 - Added support for compression methods YBZ and YLZ (Yaz0 header, but
   alternative compressions bzip2 or LZMA). Use one of the new options --cybz,
   --ybz, --cylz or --ylz to select the new methods. LE-CODE supports YLZ.

 - New option --zero (-z): This option affects the exit status of the
   programs. Instead of an exit status, the value 0 is returned for OK. This
   happens for notices (-v, status<15), warnings (-vv, status<29), errors
   (-vvv, status<115) and fatal errors (-vvvv). The exit status for INTERRUPT
   (112) is never replaced.

 - Information only: wszst now knows 243 different options.


szs v2.41b r8971 - 2024-02-23

 - Cygwin only: Fixed a silent stack overflow if reordering the tracks.

 - New image format TPLx: Technically, TPLx is a TPL file with 2 extensions.
   The main feature is the conversion of width and height so that images with
   a height >65535 lines can be used. Cup icons are an example of this.

 - New virtual image type CUPICON: Alias for TPLx.CMPR.


szs v2.41a r8953 - 2024-02-17

 - Update to LE-CODE build 40.

 - Updated prefix database: Added LEGO_Racers, Muppet_RM, POD, PP2WB, SR,
   Spyro_1, Wii_U, Zelda_OoT, Zelda_TP, Zelda_WW.

 - wszst ANALYSE prints attribute "license" if file "license.txt" is detected.

 - File format LTA supports now an optional list with file extensions. The
   idea is that tools show the correct file extensions without having to load
   the entire LTA file for analysis.

 - Command wlect DISTRIB:
    - WU8, WBZ and WLZ files are accepted now.
    - Support of new file type USE-LTA (redirection file for LE-CODE).
      Instruction lta= of command wlect DISTRIB creates such a file with
      filename lta.szs if option REDIR is set.
    - The new processing options +PR0, +PR1 to +PR60 control the output of
      progress messages.
    - New options for instruction lta=: EXT, REDIR, PR0, PR1 .. PR60.

 - Command wszst WILDCARDS supports options --sh and --bash to quote results.

 - Command wstrt PATCH and option --add-section:
    - GCT text files are now accepted now and converted to binary data if the
      very first 4 characters are "#GCT".
    - The memory map output with options -vv has been completely revised.

 - Bug fix for commands wszst NORMALIZE and wszst PATCH: If the content has
   not been changed, then the compression has not been checked. Therefore the
   file was not always normalized.

 - Bug fix for wszst PATCH: A copy to the non existing cache was created even
   if --cache was not set.

 - Implemented support for LE-CODE with 8192 tracks and 2048 cups. For this
   purpose, the BMG messages for mkw-ana had to be moved to other areas.

 - wlect dump: Warnings are issued if the tool can manage fewer LPAR settings
   or fewer track slots than the LE-CODE image offers.

 - New global option --le-04x: Use format %04x instead of %03x for LE-CODE
   slots to enable uniform slot numbers if slots >4095 are used.

 - New LPAR setting: SLOT-04X.

Links

Tools Overview

wszst (Wiimms SZS Tool)

wszst is a command driven tool to manipulate archives:

  • Supported archive formats: SZS, U8, RARC, BRRES, BREFF and BREFT.
  • It can extract all subfiles of any archive.
  • While extracting some file formats can be decoded (converted to text or PNG files).
  • It can create all (but not RARC archives) while readind and scanning a directory structure. Decoded files are encoded automatically.

Tool wszst: Features, commands and options

wbmgt (Wiimms BMG Tool)

wbmgt is a command driven tool to manipulate BMG (message) files.
Tool wbmgt: Features, commands and options

wkclt (Wiimms KCL Tool)

wkclt is a command driven tool to convert KCL files into/from binary KCL from/into Wavefront OBJ files.
Tool wkclt: Features, commands and options
General parser syntax and semantics
KCL export and import guide

wkmpt (Wiimms KMP Tool)

wkmpt is a command driven tool to convert KMP files into/from binary from/into text files. A special compiler is used to allow variables, expressions, if..then..else, loops, macros and user defined functions while reading a KMP text file.
Tool wkmpt: Features, commands and options
General parser syntax and semantics
KMP text syntax and semantics
KMP parser functions
How to edit KMP files

wimgt (Wiimms Image Tool)

wimgt is a command driven tool to convert and aptch graphic images:

  • wimgt supports the file formats BREFT, BTI, TEX0, TPL and PNG as export and import type.
  • wimgt supports the internal image formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR (and also different PNG formats).

Tool wimgt: Features, commands and options

wstrt (Wiimms StaticR Tool)

wstrt is a command driven tool to manipulate StaticR files of Mario Kart Wii.
Tool wstrt: Features, commands and options

wctct (Wiimms CT-CODE Tool)

wctct is a command driven tool to manage CT-CODE distributions. It also supports LE-CODE distributions.

wlect (Wiimms LE-CODE Tool)

wlect is a command driven tool to manage LE-CODE distributions. See LE-CODE Distribution Tutorial for details.


Links