Difference between revisions of "Wiimms SZS Tools"

From Custom Mario Kart
Jump to navigation Jump to search
(Last Features)
(Wiimms SZS Tools v2.01b released (bug fix))
(19 intermediate revisions by 3 users not shown)
Line 7: Line 7:
 
|-
 
|-
 
! Operating Systems:
 
! Operating Systems:
| Linux (i386,x86_64),<br/>Mac (i386,x86_64),<br/>Windows (cygwin).
+
| Linux (i386,x86_64),<br/>Windows (Cygwin).
 
|-
 
|-
 
! Software Type:
 
! Software Type:
Line 19: Line 19:
 
|-
 
|-
 
! File Formats:
 
! File Formats:
| [[BMG]], [[BTI]], [[KCL]], [[KMP]], [[MDL0]], [[PAT0]], [[TPL]], [[TEX0]], [[PNG]], [[OBJ]], [[StaticR.rel]], [[main.dol]], CT-CODE.
+
| [[BMG]], [[BTI]], [[KCL]], [[KMP]], [[MDL0]], [[PAT0]], [[TPL]], [[TEX0]], [[PNG]], [[OBJ]], [[StaticR.rel]], [[main.dol]], [[CT-CODE]], [[LE-CODE]].
 
|-
 
|-
 
! Image formats:
 
! Image formats:
Line 25: Line 25:
 
|-
 
|-
 
! Current Version:
 
! Current Version:
| v1.59a, 2018-08-05
+
| v2.01b, 2019-03-21
 
|-
 
|-
 
! Website:
 
! Website:
Line 44: Line 44:
 
* '''wstrt''' : Wiimms StaticR Tool (handles [[StaticR.rel]] and main.dol files of [[Mario Kart Wii]]).
 
* '''wstrt''' : Wiimms StaticR Tool (handles [[StaticR.rel]] and main.dol files of [[Mario Kart Wii]]).
 
* '''wctct''' : Wiimms CT-CODE Tool (handles CT(GP)-CODE to allow >32 tracks).
 
* '''wctct''' : Wiimms CT-CODE Tool (handles CT(GP)-CODE to allow >32 tracks).
 +
* '''wlect''' : Wiimms LE-CODE Tool (handles the [[LE-CODE]] extension by [[User:Leseratte|Leseratte]])
 
One main goal is the fully automated [[Wiimms SZS Tools/How To#Replace Track Names|track name replacement]]. The tools together can do this. Another goal is to extract all sub files recursively and transforming they into user friendly file formats (like text of png files) and support recreation of the original source files.
 
One main goal is the fully automated [[Wiimms SZS Tools/How To#Replace Track Names|track name replacement]]. The tools together can do this. Another goal is to extract all sub files recursively and transforming they into user friendly file formats (like text of png files) and support recreation of the original source files.
  
'''There is also an little [[Wiimms SZS Tools/How To|How To]].'''
+
'''There is also a little [[Wiimms SZS Tools/How To|How To]].'''
  
 
== Main Features ==
 
== Main Features ==
  
* The tools are ''command line tools''. This means, that there is no GUI support. The main advantage is, that you can place commands into scripts (batch files) for fully automated execution &rarr; [https://szs.wiimm.se/info/cli More about ''command line''].
+
* The tools are ''command line tools''. This means, that there is no GUI support. The main advantage is, that you can place commands into scripts (batch files) for fully automated execution &rarr; [https://szs.wiimm.de/info/cli More about ''command line''].
 
* '''wszst''' is the main [[SZS]] tool. It has a fast [[Yaz0]] compressor with the best compression rates.
 
* '''wszst''' is the main [[SZS]] tool. It has a fast [[Yaz0]] compressor with the best compression rates.
 
* The '''wszst''' command '''CHECK''' can help you to find bugs in your track.
 
* The '''wszst''' command '''CHECK''' can help you to find bugs in your track.
Line 69: Line 70:
  
 
== Last Features ==
 
== Last Features ==
=== <span id=small>Ignoring small triangles</span> ===
 
  
Sometimes, the imported file contains very small triangles with an area smaller than 1 unit<sup>2</sup>. They were accidentally inserted into the model by the user. Because of the littleness, the user will not see them in the model view of its [[3D Tool]]. However, machines like the [[KCL]] importer of these tools see them and insert them into the KCL &mdash; this is not a bug of the tools. The Wii has (mathematical) problems to use them in a correct way with the result of KCL glitches like mini walls on the road.
+
=== <span id=lecode>LE-CODE</span> ===
  
As of v1.58a there exist 2 new options: '''--tri-area=EXPR''' and '''--tri-height=EXPR'''[https://szs.wiimm.de/info/kcl-guide.html#tri-min] to filter out too small triangles.
+
[[LE-CODE]] is a new MKW extension and works like [[CT-CODE]]. To support it, the new tool '''<tt>wlect</tt>''' was created. The tool and the complete LE-CODE support is experimental. No documentation is available, support will be denied for the moment, and there currently is no way for normal end users to create a [[LE-CODE]] distribution.  
  
Option [https://szs.wiimm.de/opt/tri-area --tri-area=EXPR] defines the minimal area size of KCL triangles. The intention is to '''ignore triangles that are generally to small'''. EXPR is a floating point number or expression. Triangles are invalidated if their area size is smaller than EXPR. Values between 0.01 and 4.0 are recommended. The careful value 1.0 is used as default. Value 0 disables this filter functionality.
+
=== <span id=mipmap>Mipmaps</span> ===
  
Option [https://szs.wiimm.de/opt/tri-height --tri-height=EXPR] defines the minimal height of KCL triangles. The intention is to '''ignore deformed triangles (very slim, but long)'''. EXPR is a floating point number or expression. Triangles are invalidated if at least 1 of the 3 heights is smaller than EXPR. Values between 0.01 and 2.0 are recommended. The careful value 1.0 is used as default. Value 0 disables this filter functionality.
+
With version v1.65a, the [[mipmap]] creation and the related options changed. Follow the links to SZS Docu for more details:
 
+
* [https://szs.wiimm.de/info/mipmap.html General mipmap discussion]
The tests for both options are executed after reading files, after transformations, and after calculating normals and lengths.
+
** [https://szs.wiimm.de/info/mipmap.html#opt Options to control mipmaps]
 
+
** [https://szs.wiimm.de/info/mipmap.html#resize Resize algorithm (used to create mipmaps)]
=== <span id=wim0>KMP section WIM0</span> ===
 
 
 
Version 1.59a supports the new KMP section »WIM0«.
 
The idea is to store settings of a KMP text file into the binary KMP and restore theses settings on extraction.
 
 
 
At the moment, only creation of section WIM0 without payload is possible to check the compaitibily of other tools. The Wii has no problem with additional and unknown sections; it simply ignores them.
 
  
 
== History and Download ==
 
== History and Download ==
Line 95: Line 89:
  
 
<pre>
 
<pre>
 +
szs v2.01b r7802 - 2019-03-21
 +
 +
- Bug fix for v2.01a: The string support of the text parser had an memory
 +
  allocation bug. wctct uses the new string functions since v2.01 and
 +
  produces occasional (~25%) wrong CT-CODE files (strap files).
  
szs v1.59a r7533 - 2018-08-05
 
  
- Option --kcl-min is not longer supported. Use option --tri-height instead.
+
szs v2.01a r7798 - 2019-03-16
  
  - The old file extension ".flag.txt" for KCL flag files is not longer
+
  - Bug fix for BMG processing: Tools ran into endless loop, if an incorrect
   supported.
+
   1A-escape tells a length of zero.
  
  - wszst/wkmpt CHECK: Battle arenas are now detected in 2 levels: "some hints
+
  - BMG Filter option --msg renamed to the more meaningful name --filter-bmg.
   found" and "is battle arena". Some hints and warnings are suppressed for
+
   The old name is still available.
  battle arenas.
 
  
  - wszst SLOTS: For battle arenas, the keyword ARENA is printed instead of a
+
  - BMG Filter option --filter-bmg=modes supports more keywords now.
   slot list.
+
   See https://szs.wiimm.de/opt/filter-bmg for details.
  
  - New option: --export-flags[=mode] (or short: --exflags): KMP compiler and
+
  - Option --patch-bmg=mode[cond][=param]: The new optional condition COND is
   scanner support the export and import of KMP flags for sections ENPT, ITPT
+
   either '?MID' or '!MID'. In case of '?MID', the patch is only applied if
  and JGPT through a binary KMP file. Therefore, the last byte of the scale
+
   the message id MID already exists. In case of '!MID', the patch is only
   or of the x-rotation is used. Values becomes inaccurate by 0.003% (not
+
   applied if the message id MID does not exists.
  relevant for scale or rotation and not noticeable while playing).
 
  MODE is either OFF, AUTO (default) or ON. Without value, ON is used. ON and
 
   OFF override the @EXPORT-FLAGS settings of a KMP text file.
 
  
  - New option: --wim0[=mode]: KMP compiler and scanner support the export and
+
  - New command: wszst NAME-REF: For each BRRES file or subfile, create a name
  KMP parameters through a special KMP section named "@WIM0@". MODE is either
+
   based cross reference and print the result as list in selectable order.
   OFF, AUTO (default) or ON. Without value, ON is used. ON and OFF override
 
  the @WIM0 setting of a KMP text file. This as an experimental feature at
 
  the moment to proof the compatibility with other KMP tools.
 
  
  - New command wkmpt WIM0: Analyze the WIM0 section of each KMP file (text,
+
  - Some minor bugs on arena name replication to CT/LE slots fixed.
  binary or szs) and print an info about it.
 
  
  - wkmpt DRAW: AREAs are drawn dependent of the mode either as a rectangle
+
  - New option: --links: Support hardlinks if creating U8 and WU8 archives.
   cuboid or as a cylinder (more exact: as an anti prism with 20 sides).
+
  Keep hardlinks if normalizing U8 and WU8 archives. On extracting, search
 +
   hardlinks in every archive and try to create hardlinks at local file system.
  
  - wkmpt: If creating a KMP by text file, the PREV and NEXT links of item
+
  - KMP object database updated by CT-Wiiki.
  routes are checked. If missed, a link to self is added to avoid a freeze.
 
  
  - Option --kmp FIX-CKPH,FIX-ENPH,FIX-ITPH: If a PREV or NEXT link is missed,
+
  - LE-CODE support completed for the moment.
  a link to itself is added. Before, a link to another group was inserted.
 
  
  - Camera types 0 (Goal) and 3 (KartFollow) are excluded from transformation
+
  - Support for new file format LEX (LE-CODE extension).
   and scaling now.
+
  Commands for tool wlect: CREATE, CAT, DECODE, ENCODE.
 +
   See http://wiki.tockdom.com/wiki/LEX for LEX details.
  
- KMP text files: STGI is printed with new column names according the new
 
  knowledge of CT-Wiiki.
 
  
- Internal KMP GOBJ database updated by CT-Wiiki object table.
+
szs v2.00a r7754 - 2019-02-22
  
 +
- Windows version only: Update to Cygwin DLL 3.0.0 / 2019-02-16.
  
szs v1.58b r7503 - 2018-05-18
+
- A binary KCL with different section order is accepted now (like KMP before).
  
  - Default value for options --tri-area and --tri-height is now 1.0.  
+
  - The new option --repair-magics[=MODE] controls the reparing of missing or
 +
  wrong magics of files and sub-files  by analysing file path and file
 +
  extension. MODE is one of OFF, ANALYSE or REPAIR.
  
  - Some more minor edits.
+
  - Command FLOAT accepts '+' and '-' to print the nearest successor and
 +
  predecessor of the previous value.
  
 +
- New command: wszst VR-CALC: Calculate a VR increment for each given delta
 +
  value (=VR_winner-VR_loser). Print results as table.
  
szs v1.58a r7499 - 2018-04-20
+
- New command: wszst VR-RACE: Print a table with VR calculations for a race.
 +
  Each VR is the current rating of a player.
  
  - Option --kcl-min=EXPR: This option is deprecated, but still supported. It
+
  - wstrt analyse StaticR.rel: Detect modifications of cannon parameters.
  is an alternative name for --tri-height=EXPR now.
 
  
  - New option --tri-area=EXPR: Define the minimal area size of KCL triangles.
+
  - wstrt: New option: --cannon=IDX,P1,P2,P3,P4: Define parameters of cannon
  The intention is to ignore triangles that are generally to small. EXPR is
+
   with index IDX (0..2).
  a floating point number or expression. Triangles are invalidated if their
 
  area size is smaller than EXPR. The test is executed after reading files,
 
  after transformations, and after calculating normals and lengths. Values
 
   between 0.01 and 4.0 are recommended. The careful value 1.0 is used as
 
  default. Value 0 disables this filter functionality.
 
  
  - New option --tri-height=EXPR: Define the minimal height of KCL triangles.
+
  - New mode for option --patch-bmg: 'REGEX=list', where LIST is a semicolon
  The intention is to ignore deformed triangles (very slim, but long). EXPR
+
   separated list of "/REGEX/REPLACE/" expressions (POSIX Extended Regex).
  is a floating point number or expression. Triangles are invalidated if at
+
   See https://szs.wiimm.de/opt/patch-bmg for details.
   least 1 of the 3 heights is smaller than EXPR. The test is executed after
 
   reading files, after transformations, and after calculating normals and
 
  lengths. Values between 0.01 and 2.0 are recommended. The careful value 0.1
 
  is used as default. Value 0 disables this filter functionality.
 
  
  - You can proof the impact of the options above by command wkclt TEST.
+
  - New command: wbmgt REGEXP: Test implementation of regular expressions.
  
  - Command wkclt DUMP has been expanded and shows metrics like side length,
+
  - New tool: wlect: Manage the LE-CODE (Leserattes CT-CODE) extension.
   area size and heights for each triangle.
+
   TOOL IS EXPERIMENTAL AND CAN'T BE USED WITHOUT ADDITIONAL FILES!
  
  - New command: wkclt LIST: Print a list of all triangles with metrics in
+
  - Tool wctct accept LE-BIN files (LE-CODE binaries) as input.
  human and machine readable text format. It is like command DUMP, but
 
  reduced to the list of triangles.
 
  
  - New implementation for OBJ groups without assigned KCL flag. They will be
+
  - Global option --le-code: Enable LE-CODE (Leserattes CT-CODE) support for all
   inserted into the OBJ export now.
+
   tools. It includes option --ct-code.
 
</pre>
 
</pre>
  
Line 267: Line 250:
 
** [[Automated height correction]]
 
** [[Automated height correction]]
  
{{Custom Track Tutorial}}
 
 
{{User-Wiimm-Link}}
 
{{User-Wiimm-Link}}
 
[[category:Software]]
 
[[category:Software]]
 +
[[category:Wiimms SZS Tools]]

Revision as of 17:52, 21 March 2019

Wiimms SZS Tools
File:Wiimms-SZS-Tools.png
Author: Wiimm
Operating Systems: Linux (i386,x86_64),
Windows (Cygwin).
Software Type: File manager, decoding and encoding toolset.
Compression Formats: Yaz0, Yaz1, WBZ.
Archive Formats: SZS, U8, WU8, PACK, RARC, BRRES, BREFF, BREFT.
File Formats: BMG, BTI, KCL, KMP, MDL0, PAT0, TPL, TEX0, PNG, OBJ, StaticR.rel, main.dol, CT-CODE, LE-CODE.
Image formats: I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2, CMPR.
Current Version: v2.01b, 2019-03-21
Website: szs.wiimm.de

Wiimms SZS Tools has a spelling error, you should see but as a brand name.

Introduction

Wiimms SZS Tools is a set of different tools to manipulate SZS, U8, RARC, BRRES, BREFF and BREFT archives and BMG, BTI, KCL, KMP, MDL0, TPL, TEX0 and StaticR.rel files. All tools are command line tools and run without any interaction. The tools are available for Linux, Mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are 8 tools:

  • wszst : Wiimms SZS Tool (handles SZS, U8, RARC, BRRES, BREFF and BREFT archives)
  • wbmgt : Wiimms BMG Tool (convert and patch BMG files in binary and text format).
  • wimgt : Wiimms Image Tool (convert and patch image files of Mario Kart Wii).
  • wkclt : Wiimms KCL Tool (convert raw KCL files from/into obj format).
  • wkmpt : Wiimms KMP Tool (handles raw and text KMP files, read text files like a compiler).
  • wpatt : Wiimms PAT Tool (handles raw and text PAT0 files, read text files like a compiler).
  • wstrt : Wiimms StaticR Tool (handles StaticR.rel and main.dol files of Mario Kart Wii).
  • wctct : Wiimms CT-CODE Tool (handles CT(GP)-CODE to allow >32 tracks).
  • wlect : Wiimms LE-CODE Tool (handles the LE-CODE extension by Leseratte)

One main goal is the fully automated track name replacement. The tools together can do this. Another goal is to extract all sub files recursively and transforming they into user friendly file formats (like text of png files) and support recreation of the original source files.

There is also a little How To.

Main Features

  • The tools are command line tools. This means, that there is no GUI support. The main advantage is, that you can place commands into scripts (batch files) for fully automated execution → More about command line.
  • wszst is the main SZS tool. It has a fast Yaz0 compressor with the best compression rates.
  • The wszst command CHECK can help you to find bugs in your track.
  • The new wszst command SLOTS makes a track proposal for working and non working slots.
  • The KCL tool wkclt can create KCL files from scratch (they become as small as possible) by reading an OBJ file. It can also export an existing KCL to an OBJ file with colors to make a KCL visible.
  • The KMP tool wkmpt can decode and compile (yes, it's a real compiler with loops and other control structures) KMP files.
    • While compiling, it can overide some parameters for debugging or optimization.
    • The KMP compiler can use the KCL to find optimal vertical positions of objects and route points. This is good for visual debugging.
  • The wkmpt command DRAW creates an OBJ file with KCL and add route positions and other objects of the KMP.
  • The wszst command PATCH can transform whole tracks inkl. KCL, KMP, MODEL, MINIMAP and VRCORN. Transforming means any combinations of scaling, rotating and shifting with different factors for each axis.
  • The wszst command MINIMAP can center the minimap automatically. You can use this command with SZS, U8, BRRES and MDL0 files.
  • The image tool wimgt can convert images of all formats:
    • It can convert the file formats TPL, TEX0, BTI, BREFT and PNG to any other.
    • It can convert the Image Formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR to any other.
    • It supports the palette formats IA8, RGB565 and RGB5A3.
    • It can automatically create mipmaps, or it can use user defined mipmaps and create only missed mipmaps automatically.
    • It can patch images with other images.

Last Features

LE-CODE

LE-CODE is a new MKW extension and works like CT-CODE. To support it, the new tool wlect was created. The tool and the complete LE-CODE support is experimental. No documentation is available, support will be denied for the moment, and there currently is no way for normal end users to create a LE-CODE distribution.

Mipmaps

With version v1.65a, the mipmap creation and the related options changed. Follow the links to SZS Docu for more details:

History and Download

Wiimm started the development of his SZS Tools in March 2011. The first goal was to automate the insertions of the track names for Wiimms Mario Kart Fun distributions. Therefore 2 tools have been needed: A SZS extractor and creator and a BMG manipulator. The 2 tools wszst and wbmgt were ready in April 2011. After this, Wiimm implemented an Image-Tool (wimgt), an StaticR.rel tool (wstrt), a KMP tool (wkmpt) and a KCL tool (wkclt). All tools are command line tools to support scripts and fully automated operations.

Latest Change Log

szs v2.01b r7802 - 2019-03-21

 - Bug fix for v2.01a: The string support of the text parser had an memory
   allocation bug. wctct uses the new string functions since v2.01 and
   produces occasional (~25%) wrong CT-CODE files (strap files).


szs v2.01a r7798 - 2019-03-16

 - Bug fix for BMG processing: Tools ran into endless loop, if an incorrect
   1A-escape tells a length of zero.

 - BMG Filter option --msg renamed to the more meaningful name --filter-bmg.
   The old name is still available.

 - BMG Filter option --filter-bmg=modes supports more keywords now.
   See https://szs.wiimm.de/opt/filter-bmg for details.

 - Option --patch-bmg=mode[cond][=param]: The new optional condition COND is
   either '?MID' or '!MID'. In case of '?MID', the patch is only applied if
   the message id MID already exists. In case of '!MID', the patch is only
   applied if the message id MID does not exists.

 - New command: wszst NAME-REF: For each BRRES file or subfile, create a name
   based cross reference and print the result as list in selectable order.

 - Some minor bugs on arena name replication to CT/LE slots fixed.

 - New option: --links: Support hardlinks if creating U8 and WU8 archives.
   Keep hardlinks if normalizing U8 and WU8 archives. On extracting, search
   hardlinks in every archive and try to create hardlinks at local file system.

 - KMP object database updated by CT-Wiiki.

 - LE-CODE support completed for the moment.

 - Support for new file format LEX (LE-CODE extension).
   Commands for tool wlect: CREATE, CAT, DECODE, ENCODE.
   See http://wiki.tockdom.com/wiki/LEX for LEX details.


szs v2.00a r7754 - 2019-02-22

 - Windows version only: Update to Cygwin DLL 3.0.0 / 2019-02-16.

 - A binary KCL with different section order is accepted now (like KMP before).

 - The new option --repair-magics[=MODE] controls the reparing of missing or
   wrong magics of files and sub-files  by analysing file path and file
   extension. MODE is one of OFF, ANALYSE or REPAIR.

 - Command FLOAT accepts '+' and '-' to print the nearest successor and
   predecessor of the previous value.

 - New command: wszst VR-CALC: Calculate a VR increment for each given delta
   value (=VR_winner-VR_loser). Print results as table.

 - New command: wszst VR-RACE: Print a table with VR calculations for a race.
   Each VR is the current rating of a player. 

 - wstrt analyse StaticR.rel: Detect modifications of cannon parameters.

 - wstrt: New option: --cannon=IDX,P1,P2,P3,P4: Define parameters of cannon
   with index IDX (0..2).

 - New mode for option --patch-bmg: 'REGEX=list', where LIST is a semicolon
   separated list of "/REGEX/REPLACE/" expressions (POSIX Extended Regex).
   See https://szs.wiimm.de/opt/patch-bmg for details.

 - New command: wbmgt REGEXP: Test implementation of regular expressions.

 - New tool: wlect: Manage the LE-CODE (Leserattes CT-CODE) extension.
   TOOL IS EXPERIMENTAL AND CAN'T BE USED WITHOUT ADDITIONAL FILES!

 - Tool wctct accept LE-BIN files (LE-CODE binaries) as input.

 - Global option --le-code: Enable LE-CODE (Leserattes CT-CODE) support for all
   tools. It includes option --ct-code.

Links

Tools Overview

wszst (Wiimms SZS Tool)

wszst is a command driven tool to manipulate archives:

  • Supported archive formats: SZS, U8, RARC, BRRES, BREFF and BREFT.
  • It can extract all subfiles of any archive.
  • While extracting some file formats can be decoded (converted to text or PNG files).
  • It can create all (but not RARC archives) while readind and scanning a directory structure. Decoded files are encoded automatically.

Tool wszst: Features, commands and options

wbmgt (Wiimms BMG Tool)

wbmgt is a command driven tool to manipulate BMG (message) files.
Tool wbmgt: Features, commands and options

wkclt (Wiimms KCL Tool)

wkclt is a command driven tool to convert KCL files into/from binary KCL from/into Wavefront OBJ files.
Tool wkclt: Features, commands and options
General parser syntax and semantics
KCL export and import guide

wkmpt (Wiimms KMP Tool)

wkmpt is a command driven tool to convert KMP files into/from binary from/into text files. A special compiler is used to allow variables, expressions, if..then..else, loops, macros and user defined functions while reading a KMP text file.
Tool wkmpt: Features, commands and options
General parser syntax and semantics
KMP text syntax and semantics
KMP parser functions
How to edit KMP files

wimgt (Wiimms Image Tool)

wimgt is a command driven tool to convert and aptch graphic images:

  • wimgt supports the file formats BREFT, BTI, TEX0, TPL and PNG as export and import type.
  • wimgt supports the internal image formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR (and also different PNG formats).

Tool wimgt: Features, commands and options

wstrt (Wiimms StaticR Tool)

wstrt is a command driven tool to manipulate StaticR files of Mario Kart Wii.
Tool wstrt: Features, commands and options

Links