Difference between revisions of "Wiimms SZS Tools"

From Custom Mario Kart
Jump to navigation Jump to search
(Wiimms SZS Tools v2.01a released)
(Wiimms SZS Tools v2.06a released: Support of ObjFlow.bin and GeoHitTable*.bin)
(5 intermediate revisions by the same user not shown)
Line 19: Line 19:
 
|-
 
|-
 
! File Formats:
 
! File Formats:
| [[BMG]], [[BTI]], [[KCL]], [[KMP]], [[MDL0]], [[PAT0]], [[TPL]], [[TEX0]], [[PNG]], [[OBJ]], [[StaticR.rel]], [[main.dol]], [[CT-CODE]], [[LE-CODE]].
+
| [[BMG]], [[BTI]], [[KCL]], [[KMP]], [[MDL0]], [[PAT0]], [[TPL]], [[TEX0]], [[PNG]], [[OBJ]], [[StaticR.rel]], [[main.dol]], [[CT-CODE]], [[LE-CODE]], [[ObjFlow.bin|ObjFlow]], [[GeoHitTableItem.bin|GeoHit]].
 
|-
 
|-
 
! Image formats:
 
! Image formats:
Line 25: Line 25:
 
|-
 
|-
 
! Current Version:
 
! Current Version:
| v2.01a, 2019-03-16
+
| v2.06a, 2019-07-01
 
|-
 
|-
 
! Website:
 
! Website:
Line 89: Line 89:
  
 
<pre>
 
<pre>
szs v2.01a r7798 - 2019-03-16
+
szs v2.06a r7905 - 2019-07-01
  
  - Bug fix for BMG processing: Tools ran into endless loop, if an incorrect
+
  - Bug fix for wszst CHECK: The summary will include BRRES error counters now.
  1A-escape tells a length of zero.
+
  A summary line is also printed, if a standalone BRRES file is checked.
  
  - BMG Filter option --msg renamed to the more meaningful name --filter-bmg.
+
  - New command: wlect DL: Short cut for: wlect DUMP --long
  The old name is still available.
 
  
  - BMG Filter option --filter-bmg=modes supports more keywords now.
+
  - New command: wlect DLL: Short cut for: wlect DUMP --long --long
  See https://szs.wiimm.de/opt/filter-bmg for details.
 
  
  - Option --patch-bmg=mode[cond][=param]: The new optional condition COND is
+
  - Tool wlect: Option --perf-mon=FORCE enables performance counter for Dolphin.
  either '?MID' or '!MID'. In case of '?MID', the patch is only applied if
 
  the message id MID already exists. In case of '!MID', the patch is only
 
  applied if the message id MID does not exists.
 
  
  - New command: wszst NAME-REF: For each BRRES file or subfile, create a name
+
  - Command wlect DUMP --verbose: Slot usage map is colored now.
  based cross reference and print the result as list in selectable order.
 
  
  - Some minor bugs on arena name replication to CT/LE slots fixed.
+
  - Command wszst ANALYZE prints more details now.
  
  - New option: --links: Support hardlinks if creating U8 and WU8 archives.
+
  - CT-CODE definition files: Added additional and optional field IDENTIFIER to
   Keep hardlinks if normalizing U8 and WU8 archives. On extracting, search
+
   optimize track-to-cup references.
  hardlinks in every archive and try to create hardlinks at local file system.
 
  
  - KMP object database updated by CT-Wiiki.
+
  - Support for outdated LE-CODE phase 1 removed.
  
  - LE-CODE support completed for the moment.
+
  - Bug fix for option --ktpt2: KMP is marked as modified now, so that the
 +
  KMP of the source file is updated..
  
  - Support for new file format LEX (LE-CODE extension).
+
  - Support of files ObjFlow.bin and GeoHitTable*.bin (binary and text).
  Commands for tool wlect: CREATE, CAT, DECODE, ENCODE.
 
  See http://wiki.tockdom.com/wiki/LEX for LEX details.
 
  
 +
- New commands: wszst BINARY and wszst TEXT: Both commands work like the
 +
  ENCODE and DECODE commands of the other tools. The main idea is to support
 +
  simple text-to-binary and binary-to-text conversions of new file formats by
 +
  tool wszst instead of creating own tools for every new file format.
  
szs v2.00a r7754 - 2019-02-22
+
    - Command wszst BINARY: Read each source file (binary or text, but not an
 +
      archive) and write it as binary file.
  
- Windows version only: Update to Cygwin DLL 3.0.0 / 2019-02-16.
+
    - Command wszst TEXT: Read each source file (binary or text, but not an
 +
      archive) and write it as text file.
  
- A binary KCL with different section order is accepted now (like KMP before).
+
    - Currently supported file formats are BMG, GEOHIT, KCL, KMP, LEX,
 +
      OBJFLOW, PAT and the related text formats.
  
  - The new option --repair-magics[=MODE] controls the reparing of missing or
+
  - New option: wszst --delta: Print only modified records on text output.
   wrong magics of files and sub-files  by analysing file path and file
+
   Supported file formats until now: GEOHIT, OBJFLOW
  extension. MODE is one of OFF, ANALYSE or REPAIR.
 
  
- Command FLOAT accepts '+' and '-' to print the nearest successor and
 
  predecessor of the previous value.
 
  
- New command: wszst VR-CALC: Calculate a VR increment for each given delta
+
szs v2.05a r7879 - 2019-06-09
  value (=VR_winner-VR_loser). Print results as table.
 
  
  - New command: wszst VR-RACE: Print a table with VR calculations for a race.
+
  - Warnings for not supported versions and for wrong number of sections of
   Each VR is the current rating of a player.
+
  BRRES sub files (CHR, CLR, MDL, PAT, SCN, SHP, SRT and TEX) implemented.
 +
   Some of these invalid sub files will freeze the Wii:
  
- wstrt analyse StaticR.rel: Detect modifications of cannon parameters.
+
    - New command: wszst BRSUB: If no file is defined, print a table with
 +
      known BRRES sub files consisting of file format, version, number of
 +
      sections and warn message. Otherwise analyse the version number and
 +
      number of sections of each BRRES sub file of each source and print
 +
      warnings about invalid sub files. This is like command CHECK, but only
 +
      for BRRES sub files.
  
- wstrt: New option: --cannon=IDX,P1,P2,P3,P4: Define parameters of cannon
+
    - Command wszst CHECK will check BRRES files now. For SZS files, all BRRES
  with index IDX (0..2).
+
      sub files are checked. At the moment only valid version numbers and
 +
      number of sections are tested.
  
- New mode for option --patch-bmg: 'REGEX=list', where LIST is a semicolon
+
    - Command wszst LIST: If displaying version numbers, invalid version
  separated list of "/REGEX/REPLACE/" expressions (POSIX Extended Regex).
+
      numbers for BRRES sub files will be marked by an appended "!" and
  See https://szs.wiimm.de/opt/patch-bmg for details.
+
      highlighted by magenta background if colors are activated.
  
  - New command: wbmgt REGEXP: Test implementation of regular expressions.
+
  - Bug fix for wszst DISTRIBUTION: Scanning of slot numbers failed.
  
  - New tool: wlect: Manage the LE-CODE (Leserattes CT-CODE) extension.
+
  - Option --ktpt2 accepts keyword AUTO now and calculates the position
   TOOL IS EXPERIMENTAL AND CAN'T BE USED WITHOUT ADDITIONAL FILES!
+
   automatically. The result is the recommendation of command wkmpt KTPT.
  
- Tool wctct accept LE-BIN files (LE-CODE binaries) as input.
 
  
- Global option --le-code: Enable LE-CODE (Leserattes CT-CODE) support for all
+
szs v2.04a r7864 - 2019-06-02
  tools. It includes option --ct-code.
 
  
 +
- New option for wszst and wimgt: --cmpr-default=rgb1[,rgb2]
 +
  Define 2 colors for the case, that all 16 pixels of a CMPR block are
 +
  transparent. The default is to calculate an average color of all
 +
  transparent pixels. Before v2.04 white was used.
  
szs v1.65a r7690 - 2018-12-23
+
  - Command wszst DISTRIBUTION: Added battle arena support.
 
 
- Support of BMG files without section MID1.
 
 
 
  - New Option: --bmg-mid=MODE: Control the creation of BMG section MID1.
 
  MODE is one of OFF, AUTO (default) or ON.
 
 
 
- The impact of options --n-mipmaps, --max-mipmaps and --mipmap-size changed.
 
  All 3 options together control the automatic creation of mipmaps.
 
  Read https://szs.wiimm.de/info/mipmap.html for details.
 
 
 
- Option --smart is deprecated and ignored now. The new option --fast-mipmaps
 
  will enable the old algorithm for images with odd width or with odd height.
 
  Read https://szs.wiimm.de/doc/img/resize for details.
 
  
 +
- Option --bmg-inline removed. It is deprecated since 2015.
 
</pre>
 
</pre>
  
Line 263: Line 255:
 
[[category:Software]]
 
[[category:Software]]
 
[[category:Wiimms SZS Tools]]
 
[[category:Wiimms SZS Tools]]
 +
[[category:LE-CODE]]

Revision as of 10:04, 1 July 2019

Wiimms SZS Tools
File:Wiimms-SZS-Tools.png
Author: Wiimm
Operating Systems: Linux (i386,x86_64),
Windows (Cygwin).
Software Type: File manager, decoding and encoding toolset.
Compression Formats: Yaz0, Yaz1, WBZ.
Archive Formats: SZS, U8, WU8, PACK, RARC, BRRES, BREFF, BREFT.
File Formats: BMG, BTI, KCL, KMP, MDL0, PAT0, TPL, TEX0, PNG, OBJ, StaticR.rel, main.dol, CT-CODE, LE-CODE, ObjFlow, GeoHit.
Image formats: I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2, CMPR.
Current Version: v2.06a, 2019-07-01
Website: szs.wiimm.de

Wiimms SZS Tools has a spelling error, you should see but as a brand name.

Introduction

Wiimms SZS Tools is a set of different tools to manipulate SZS, U8, RARC, BRRES, BREFF and BREFT archives and BMG, BTI, KCL, KMP, MDL0, TPL, TEX0 and StaticR.rel files. All tools are command line tools and run without any interaction. The tools are available for Linux, Mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are 8 tools:

  • wszst : Wiimms SZS Tool (handles SZS, U8, RARC, BRRES, BREFF and BREFT archives)
  • wbmgt : Wiimms BMG Tool (convert and patch BMG files in binary and text format).
  • wimgt : Wiimms Image Tool (convert and patch image files of Mario Kart Wii).
  • wkclt : Wiimms KCL Tool (convert raw KCL files from/into obj format).
  • wkmpt : Wiimms KMP Tool (handles raw and text KMP files, read text files like a compiler).
  • wpatt : Wiimms PAT Tool (handles raw and text PAT0 files, read text files like a compiler).
  • wstrt : Wiimms StaticR Tool (handles StaticR.rel and main.dol files of Mario Kart Wii).
  • wctct : Wiimms CT-CODE Tool (handles CT(GP)-CODE to allow >32 tracks).
  • wlect : Wiimms LE-CODE Tool (handles the LE-CODE extension by Leseratte)

One main goal is the fully automated track name replacement. The tools together can do this. Another goal is to extract all sub files recursively and transforming they into user friendly file formats (like text of png files) and support recreation of the original source files.

There is also a little How To.

Main Features

  • The tools are command line tools. This means, that there is no GUI support. The main advantage is, that you can place commands into scripts (batch files) for fully automated execution → More about command line.
  • wszst is the main SZS tool. It has a fast Yaz0 compressor with the best compression rates.
  • The wszst command CHECK can help you to find bugs in your track.
  • The new wszst command SLOTS makes a track proposal for working and non working slots.
  • The KCL tool wkclt can create KCL files from scratch (they become as small as possible) by reading an OBJ file. It can also export an existing KCL to an OBJ file with colors to make a KCL visible.
  • The KMP tool wkmpt can decode and compile (yes, it's a real compiler with loops and other control structures) KMP files.
    • While compiling, it can overide some parameters for debugging or optimization.
    • The KMP compiler can use the KCL to find optimal vertical positions of objects and route points. This is good for visual debugging.
  • The wkmpt command DRAW creates an OBJ file with KCL and add route positions and other objects of the KMP.
  • The wszst command PATCH can transform whole tracks inkl. KCL, KMP, MODEL, MINIMAP and VRCORN. Transforming means any combinations of scaling, rotating and shifting with different factors for each axis.
  • The wszst command MINIMAP can center the minimap automatically. You can use this command with SZS, U8, BRRES and MDL0 files.
  • The image tool wimgt can convert images of all formats:
    • It can convert the file formats TPL, TEX0, BTI, BREFT and PNG to any other.
    • It can convert the Image Formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR to any other.
    • It supports the palette formats IA8, RGB565 and RGB5A3.
    • It can automatically create mipmaps, or it can use user defined mipmaps and create only missed mipmaps automatically.
    • It can patch images with other images.

Last Features

LE-CODE

LE-CODE is a new MKW extension and works like CT-CODE. To support it, the new tool wlect was created. The tool and the complete LE-CODE support is experimental. No documentation is available, support will be denied for the moment, and there currently is no way for normal end users to create a LE-CODE distribution.

Mipmaps

With version v1.65a, the mipmap creation and the related options changed. Follow the links to SZS Docu for more details:

History and Download

Wiimm started the development of his SZS Tools in March 2011. The first goal was to automate the insertions of the track names for Wiimms Mario Kart Fun distributions. Therefore 2 tools have been needed: A SZS extractor and creator and a BMG manipulator. The 2 tools wszst and wbmgt were ready in April 2011. After this, Wiimm implemented an Image-Tool (wimgt), an StaticR.rel tool (wstrt), a KMP tool (wkmpt) and a KCL tool (wkclt). All tools are command line tools to support scripts and fully automated operations.

Latest Change Log

szs v2.06a r7905 - 2019-07-01

 - Bug fix for wszst CHECK: The summary will include BRRES error counters now.
   A summary line is also printed, if a standalone BRRES file is checked.

 - New command: wlect DL: Short cut for: wlect DUMP --long

 - New command: wlect DLL: Short cut for: wlect DUMP --long --long

 - Tool wlect: Option --perf-mon=FORCE enables performance counter for Dolphin.

 - Command wlect DUMP --verbose: Slot usage map is colored now.

 - Command wszst ANALYZE prints more details now.

 - CT-CODE definition files: Added additional and optional field IDENTIFIER to
   optimize track-to-cup references.

 - Support for outdated LE-CODE phase 1 removed.

 - Bug fix for option --ktpt2: KMP is marked as modified now, so that the
   KMP of the source file is updated..

 - Support of files ObjFlow.bin and GeoHitTable*.bin (binary and text).

 - New commands: wszst BINARY and wszst TEXT: Both commands work like the
   ENCODE and DECODE commands of the other tools. The main idea is to support
   simple text-to-binary and binary-to-text conversions of new file formats by
   tool wszst instead of creating own tools for every new file format.

    - Command wszst BINARY: Read each source file (binary or text, but not an
      archive) and write it as binary file.

    - Command wszst TEXT: Read each source file (binary or text, but not an
      archive) and write it as text file.

    - Currently supported file formats are BMG, GEOHIT, KCL, KMP, LEX,
      OBJFLOW, PAT and the related text formats.

 - New option: wszst --delta: Print only modified records on text output.
   Supported file formats until now: GEOHIT, OBJFLOW


szs v2.05a r7879 - 2019-06-09

 - Warnings for not supported versions and for wrong number of sections of
   BRRES sub files (CHR, CLR, MDL, PAT, SCN, SHP, SRT and TEX) implemented.
   Some of these invalid sub files will freeze the Wii:

    - New command: wszst BRSUB: If no file is defined, print a table with
      known BRRES sub files consisting of file format, version, number of
      sections and warn message. Otherwise analyse the version number and
      number of sections of each BRRES sub file of each source and print
      warnings about invalid sub files. This is like command CHECK, but only
      for BRRES sub files.

    - Command wszst CHECK will check BRRES files now. For SZS files, all BRRES
      sub files are checked. At the moment only valid version numbers and
      number of sections are tested.

    - Command wszst LIST: If displaying version numbers, invalid version
      numbers for BRRES sub files will be marked by an appended "!" and
      highlighted by magenta background if colors are activated.

 - Bug fix for wszst DISTRIBUTION: Scanning of slot numbers failed.

 - Option --ktpt2 accepts keyword AUTO now and calculates the position
   automatically. The result is the recommendation of command wkmpt KTPT.


szs v2.04a r7864 - 2019-06-02

 - New option for wszst and wimgt: --cmpr-default=rgb1[,rgb2]
   Define 2 colors for the case, that all 16 pixels of a CMPR block are
   transparent. The default is to calculate an average color of all
   transparent pixels. Before v2.04 white was used.

 - Command wszst DISTRIBUTION: Added battle arena support.

 - Option --bmg-inline removed. It is deprecated since 2015.

Links

Tools Overview

wszst (Wiimms SZS Tool)

wszst is a command driven tool to manipulate archives:

  • Supported archive formats: SZS, U8, RARC, BRRES, BREFF and BREFT.
  • It can extract all subfiles of any archive.
  • While extracting some file formats can be decoded (converted to text or PNG files).
  • It can create all (but not RARC archives) while readind and scanning a directory structure. Decoded files are encoded automatically.

Tool wszst: Features, commands and options

wbmgt (Wiimms BMG Tool)

wbmgt is a command driven tool to manipulate BMG (message) files.
Tool wbmgt: Features, commands and options

wkclt (Wiimms KCL Tool)

wkclt is a command driven tool to convert KCL files into/from binary KCL from/into Wavefront OBJ files.
Tool wkclt: Features, commands and options
General parser syntax and semantics
KCL export and import guide

wkmpt (Wiimms KMP Tool)

wkmpt is a command driven tool to convert KMP files into/from binary from/into text files. A special compiler is used to allow variables, expressions, if..then..else, loops, macros and user defined functions while reading a KMP text file.
Tool wkmpt: Features, commands and options
General parser syntax and semantics
KMP text syntax and semantics
KMP parser functions
How to edit KMP files

wimgt (Wiimms Image Tool)

wimgt is a command driven tool to convert and aptch graphic images:

  • wimgt supports the file formats BREFT, BTI, TEX0, TPL and PNG as export and import type.
  • wimgt supports the internal image formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR (and also different PNG formats).

Tool wimgt: Features, commands and options

wstrt (Wiimms StaticR Tool)

wstrt is a command driven tool to manipulate StaticR files of Mario Kart Wii.
Tool wstrt: Features, commands and options

Links