Difference between revisions of "Wiimms SZS Tools"

From Custom Mario Kart
Jump to navigation Jump to search
(Wiimms SZS Tools v2.08a released)
(Wiimms SZS Tools v2.19b released)
(20 intermediate revisions by the same user not shown)
Line 7: Line 7:
 
|-
 
|-
 
! Operating Systems:
 
! Operating Systems:
| Linux (i386,x86_64),<br/>Windows (Cygwin).
+
| Linux (i386,x86_64),<br/>Windows (Cygwin), <br/>Mac (x86_64).
 
|-
 
|-
 
! Software Type:
 
! Software Type:
Line 13: Line 13:
 
|-
 
|-
 
! Compression Formats:
 
! Compression Formats:
| [[Yaz0]], [[Yaz1]], [[WBZ]].
+
| [[Yaz0]], Yaz1, [[WBZ]].
 
|-
 
|-
 
! Archive Formats:
 
! Archive Formats:
| [[SZS]], [[U8]], [[WU8]], [[PACK]], [[RARC]], [[BRRES]], [[BREFF]], [[BREFT]].
+
| [[SZS]], [[U8]], [[WU8]], PACK, [[RARC]], [[BRRES]], [[BREFF]], [[BREFT]].
 
|-
 
|-
 
! File Formats:
 
! File Formats:
| [[BMG]], [[BTI]], [[KCL]], [[KMP]], [[MDL0]], [[PAT0]], [[TPL]], [[TEX0]], [[PNG]], [[OBJ]], [[StaticR.rel]], [[main.dol]], [[CT-CODE]], [[LE-CODE]], [[ObjFlow.bin|ObjFlow]], [[GeoHitTableItem.bin|GeoHit]].
+
| [[BMG]], [[BTI]], [[KCL]], [[KMG]], [[KMP]], [[MDL0]], [[PAT0]], [[TPL]], [[TEX0]], [[PNG]], [[OBJ]], [[StaticR.rel]], [[main.dol]], [[CT-CODE]], [[LE-CODE]], [[LEX]], [[LPAR]], [[ObjFlow.bin|ObjFlow]], [[GeoHitTableItem.bin|GeoHit]], [[ItemSlot.bin|ItemSlot]], [[minigame.kmg|minigame]].
 
|-
 
|-
 
! Image formats:
 
! Image formats:
Line 25: Line 25:
 
|-
 
|-
 
! Current Version:
 
! Current Version:
| v2.08a, 2019-09-05
+
| v2.19b, 2020-08-03
 
|-
 
|-
 
! Website:
 
! Website:
Line 35: Line 35:
 
== Introduction ==
 
== Introduction ==
  
'''Wiimms SZS Tools''' is a set of different tools to manipulate [[SZS]], [[U8]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]] archives and [[BMG]], [[BTI]], [[KCL]], [[KMP]], [[MDL0]], [[TPL]], [[TEX0]] and [[StaticR.rel]] files. All tools are command line tools and run without any interaction. The tools are available for Linux, Mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are 8 tools:
+
'''Wiimms SZS Tools''' is a set of different tools to manipulate [[SZS]], [[U8]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]] archives and [[BMG]], [[BTI]], [[KCL]], [[KMP]], [[MDL0]], [[TPL]], [[TEX0]] and [[StaticR.rel]] files. All tools are command line tools and run without any interaction. The tools are available for Linux, Mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are 9 tools:
 
* '''wszst''' : Wiimms SZS Tool (handles [[SZS]], [[U8]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]] archives)
 
* '''wszst''' : Wiimms SZS Tool (handles [[SZS]], [[U8]], [[RARC]], [[BRRES]], [[BREFF]] and [[BREFT]] archives)
 
* '''wbmgt''' : Wiimms BMG Tool (convert and patch [[BMG]] files in binary and text format).
 
* '''wbmgt''' : Wiimms BMG Tool (convert and patch [[BMG]] files in binary and text format).
Line 42: Line 42:
 
* '''wkmpt''' : Wiimms KMP Tool (handles raw and text [[KMP]] files, read text files like a compiler).
 
* '''wkmpt''' : Wiimms KMP Tool (handles raw and text [[KMP]] files, read text files like a compiler).
 
* '''wpatt''' : Wiimms PAT Tool (handles raw and text [[PAT0]] files, read text files like a compiler).
 
* '''wpatt''' : Wiimms PAT Tool (handles raw and text [[PAT0]] files, read text files like a compiler).
* '''wstrt''' : Wiimms StaticR Tool (handles [[StaticR.rel]] and main.dol files of [[Mario Kart Wii]]).
+
* '''wstrt''' : Wiimms StaticR Tool (handles [[StaticR.rel]] and [[main.dol]] files of [[Mario Kart Wii]]).
* '''wctct''' : Wiimms CT-CODE Tool (handles CT(GP)-CODE to allow >32 tracks).
+
* '''wctct''' : Wiimms CT-CODE Tool (handles [[CT-CODE]] and [[LE-CODE]] files).
* '''wlect''' : Wiimms LE-CODE Tool (handles the [[LE-CODE]] extension by [[User:Leseratte|Leseratte]])
+
* '''wlect''' : Wiimms LE-CODE Tool (handles [[LE-CODE]] and [[LEX]] files)
 
One main goal is the fully automated [[Wiimms SZS Tools/How To#Replace Track Names|track name replacement]]. The tools together can do this. Another goal is to extract all sub files recursively and transforming they into user friendly file formats (like text of png files) and support recreation of the original source files.
 
One main goal is the fully automated [[Wiimms SZS Tools/How To#Replace Track Names|track name replacement]]. The tools together can do this. Another goal is to extract all sub files recursively and transforming they into user friendly file formats (like text of png files) and support recreation of the original source files.
  
Line 77: Line 77:
 
=== <span id=lecode>LE-CODE</span> ===
 
=== <span id=lecode>LE-CODE</span> ===
  
[[LE-CODE]] is a new MKW extension and works like [[CT-CODE]]. To support it, the new tool '''<tt>wlect</tt>''' was created. The tool and the complete LE-CODE support is experimental. No documentation is available, support will be denied for the moment, and there currently is no way for normal end users to create a [[LE-CODE]] distribution.
+
[[LE-CODE]] is a new MKW extension and works like [[CT-CODE]]. To support it, the new tool '''<tt>wlect</tt>''' was created.
 
 
=== <span id=mipmap>Mipmaps</span> ===
 
 
 
As of v1.65a, the [[mipmap]] creation and the related options changed. Follow the links to SZS Docu for more details:
 
* [https://szs.wiimm.de/info/mipmap.html General mipmap discussion]
 
** [https://szs.wiimm.de/info/mipmap.html#opt Options to control mipmaps]
 
** [https://szs.wiimm.de/info/mipmap.html#resize Resize algorithm (used to create mipmaps)]
 
  
 
== History and Download ==
 
== History and Download ==
  
[[Wiimm]] started the development of his SZS Tools in March 2011. The first goal was to automate the insertions of the track names for [[Wiimms Mario Kart Fun]] distributions. Therefore 2 tools have been needed: A [[SZS]] extractor and creator and a [[BMG]] manipulator. The 2 tools '''wszst''' and '''wbmgt''' were ready in April 2011. After this, [[Wiimm]] implemented an Image-Tool ('''wimgt'''),  an [[StaticR.rel]] tool ('''wstrt'''), a [[KMP]] tool ('''wkmpt''') and a [[KCL]] tool ('''wkclt'''). All tools are command line tools to support scripts and fully automated operations.
+
[[Wiimm]] started the development of his SZS Tools in March 2011. The first goal was to automate the insertions of the track names for [[Wiimms Mario Kart Fun]] distributions. Therefore 2 tools have been needed: A [[SZS]] extractor and creator and a [[BMG]] manipulator. The 2 tools '''wszst''' and '''wbmgt''' were ready in April 2011. After this, [[Wiimm]] implemented an Image-Tool ('''wimgt'''),  an [[StaticR.rel]] tool ('''wstrt'''), a [[KMP]] tool ('''wkmpt''') and a [[KCL]] tool ('''wkclt'''). Other tools were added later. The last added tool is '''wlect''' to manage [[LE-CODE]] and [[LEX]] files. All tools are command line tools to support scripts and fully automated operations.
  
 
=== Latest Change Log ===
 
=== Latest Change Log ===
  
 
<pre>
 
<pre>
szs v2.08a r7979 - 2019-09-05
+
szs v2.19b r8243 - 2020-08-03
 
 
- BMG: Encoding of types CP1252, UTF-16be, Shift-JIS and UTF-8 are fully
 
  supported now.
 
 
 
- New command: wbmgt SLOTS source...: Print a slot ordered list with slot
 
  number, message id, delta and attributes.
 
 
 
- BMG supports predifined slots now. These slot assignments are detected
 
  automatically while reading binary BMG files. Slot assignments are saved to
 
  and scanned from BMG text files.
 
 
 
- BMG text files: Each message ID can be followed by '@SLOT' to force a slot
 
  number for the message.
 
 
 
- BMG: Unknown sections are stored as hex dumps into BMG text files. The hex
 
  dumps can be edited and are scanned on reading. Each section is started by
 
  parameter "@SECTION NAME".
 
 
 
- BMG section INF1: Maximum attribute length increased from 32 to 40 bytes.
 
 
 
 
 
szs v2.07a r7960 - 2019-08-30
 
 
 
- New file formats to distinguish GeoHitTable*.bin (standard variant) from
 
  GeoHitTable*Obj.bin ("Obj" variant).
 
 
 
- Command wszst TEXT for OBJFLOW and GEOHIT updated to support new file
 
  formats and new features.
 
 
 
- If extracting an U8 or WU8 archive, then course.kcl.*, course.kmp.txt and
 
  course.lex.txt are always added to the exclude list of control file
 
  wszst-setup.txt. Files course.kcl, course.kmp and course.lex are added to
 
  the encode list. Before the files were only added, if the binary file
 
  exists and option --decode was set.
 
 
 
- Command wlect CREATE CANNON: Create a LEX text file with cannon section
 
  only.
 
 
 
- Command wszst ANALYZE updated to support calculated attributes of tracks
 
  for web site https://ct.wiimm.de/
 
 
 
- BMG: Supported attribute length of section INF1 increased from 16 to 32
 
  bytes.
 
 
 
- BMG: The tools support only BMG encoding #2 (UTF-16/be) fully. Encoding #1
 
  (CP1252) can be read, but not be stored as binary BMG file. Error messages
 
  are printed for unsupported encodings.
 
 
 
- BMG: Unknown parameters of sections INF1 and MID1 are scanned and written.
 
 
 
- New BMG option: --bmg-encoding=NAME: Force a BMG encoding. It is only
 
  relevant if creating a BMG file. Accepted encoding names are: CP-1252,
 
  UTF-16BE (or UTF-16), SHIFT-JIS, UTF-8 and AUTO for automatic detection
 
  (default). Same keywords without minus signs are accepted too.
 
  At the moment, only encodings CP-1252 and UTF-16BE are supported on reading
 
  and only encoding UTF-16BE on writing a binary BMG. MKWii uses UTF-16BE.
 
 
 
- New command: wbmgt EXTRACT name source: Extract BMG section NAME of file
 
  SOURCE and write the binary data to standard output. If NAME consists of
 
  less than 4 characters, then the first section that starts with these
 
  characters is dumped.
 
 
 
- New command: wbmgt SECTIONS source...: List all sections of each binary
 
  BMG file. Print offset, size, magic and a short info. If known, print
 
  number and size of elements too.
 
 
 
 
 
szs v2.06a r7905 - 2019-07-01
 
 
 
- Bug fix for wszst CHECK: The summary will include BRRES error counters now.
 
  A summary line is also printed, if a standalone BRRES file is checked.
 
  
  - New command: wlect DL: Short cut for: wlect DUMP --long
+
  - Bug fix for wlect LPAR: Message functions are not longer printed twice.
  
- New command: wlect DLL: Short cut for: wlect DUMP --long --long
 
  
- Tool wlect: Option --perf-mon=FORCE enables performance counter for Dolphin.
+
szs v2.19a r8237 - 2020-08-01
  
  - Command wlect DUMP --verbose: Slot usage map is colored now.
+
  - Bug fix: Tool wlect didn't read the second chat message functions from
 +
  binary LE-CODE files.
  
  - Command wszst ANALYZE prints more details now.
+
  - Support of an old GameCube BMG variant (internally named "legacy").
  
  - CT-CODE definition files: Added additional and optional field IDENTIFIER to
+
  - Check minimap: Bones 'posRU' and 'posLD' are detected even if the root bone
   optimize track-to-cup references.
+
   is renamed. This suppresses wrong warnings.
  
- Support for outdated LE-CODE phase 1 removed.
 
  
- Bug fix for option --ktpt2: KMP is marked as modified now, so that the
+
szs v2.18a r8217 - 2020-06-28
  KMP of the source file is updated..
 
  
  - Support of files ObjFlow.bin and GeoHitTable*.bin (binary and text).
+
  - wszst/wkmpt CHECK: Hints about self linked item routes and item routes with
 +
  exact 1 point. A warning is printed when both events apply for same route.
  
  - New commands: wszst BINARY and wszst TEXT: Both commands work like the
+
  - Bug fix: The number of tables is set to 6 if writing a short binary
  ENCODE and DECODE commands of the other tools. The main idea is to support
+
   item-slot file (without tables for battles).
   simple text-to-binary and binary-to-text conversions of new file formats by
 
  tool wszst instead of creating own tools for every new file format.
 
  
    - Command wszst BINARY: Read each source file (binary or text, but not an
+
- wszst TEXT/BINARY: New options to patch KMG files: --kmg-limit=seconds to
      archive) and write it as binary file.
+
  limit the run time of battles and --kmg-copy=id to copy one slot definition
 +
  to the 9 other slots.
  
    - Command wszst TEXT: Read each source file (binary or text, but not an
+
- Leseratte and I analysed the MKW internal VR calculations and adapted the
      archive) and write it as text file.
+
  results into the tools. So the calculations are 100% identical now.
  
    - Currently supported file formats are BMG, GEOHIT, KCL, KMP, LEX,
+
- Command wszst VR-RACE supports now up to 30 players for the VR calculation.
      OBJFLOW, PAT and the related text formats.
 
  
  - New option: wszst --delta: Print only modified records on text output.
+
  - KMP/CAME type 6 and the related route is excluded from any transformation.
  Supported file formats until now: GEOHIT, OBJFLOW
 
 
</pre>
 
</pre>
  

Revision as of 14:23, 3 August 2020

Wiimms SZS Tools
File:Wiimms-SZS-Tools.png
Author: Wiimm
Operating Systems: Linux (i386,x86_64),
Windows (Cygwin),
Mac (x86_64).
Software Type: File manager, decoding and encoding toolset.
Compression Formats: Yaz0, Yaz1, WBZ.
Archive Formats: SZS, U8, WU8, PACK, RARC, BRRES, BREFF, BREFT.
File Formats: BMG, BTI, KCL, KMG, KMP, MDL0, PAT0, TPL, TEX0, PNG, OBJ, StaticR.rel, main.dol, CT-CODE, LE-CODE, LEX, LPAR, ObjFlow, GeoHit, ItemSlot, minigame.
Image formats: I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2, CMPR.
Current Version: v2.19b, 2020-08-03
Website: szs.wiimm.de

Wiimms SZS Tools has a spelling error, you should see but as a brand name.

Introduction

Wiimms SZS Tools is a set of different tools to manipulate SZS, U8, RARC, BRRES, BREFF and BREFT archives and BMG, BTI, KCL, KMP, MDL0, TPL, TEX0 and StaticR.rel files. All tools are command line tools and run without any interaction. The tools are available for Linux, Mac and Windows. The main goal is to run them in batch files and scripts to automate recurring jobs. At the moment there are 9 tools:

  • wszst : Wiimms SZS Tool (handles SZS, U8, RARC, BRRES, BREFF and BREFT archives)
  • wbmgt : Wiimms BMG Tool (convert and patch BMG files in binary and text format).
  • wimgt : Wiimms Image Tool (convert and patch image files of Mario Kart Wii).
  • wkclt : Wiimms KCL Tool (convert raw KCL files from/into obj format).
  • wkmpt : Wiimms KMP Tool (handles raw and text KMP files, read text files like a compiler).
  • wpatt : Wiimms PAT Tool (handles raw and text PAT0 files, read text files like a compiler).
  • wstrt : Wiimms StaticR Tool (handles StaticR.rel and main.dol files of Mario Kart Wii).
  • wctct : Wiimms CT-CODE Tool (handles CT-CODE and LE-CODE files).
  • wlect : Wiimms LE-CODE Tool (handles LE-CODE and LEX files)

One main goal is the fully automated track name replacement. The tools together can do this. Another goal is to extract all sub files recursively and transforming they into user friendly file formats (like text of png files) and support recreation of the original source files.

There is also a little How To.

Main Features

  • The tools are command line tools. This means, that there is no GUI support. The main advantage is, that you can place commands into scripts (batch files) for fully automated execution → More about command line.
  • wszst is the main SZS tool. It has a fast Yaz0 compressor with the best compression rates.
  • The wszst command CHECK can help you to find bugs in your track.
  • The new wszst command SLOTS makes a track proposal for working and non working slots.
  • The KCL tool wkclt can create KCL files from scratch (they become as small as possible) by reading an OBJ file. It can also export an existing KCL to an OBJ file with colors to make a KCL visible.
  • The KMP tool wkmpt can decode and compile (yes, it's a real compiler with loops and other control structures) KMP files.
    • While compiling, it can overide some parameters for debugging or optimization.
    • The KMP compiler can use the KCL to find optimal vertical positions of objects and route points. This is good for visual debugging.
  • The wkmpt command DRAW creates an OBJ file with KCL and add route positions and other objects of the KMP.
  • The wszst command PATCH can transform whole tracks inkl. KCL, KMP, MODEL, MINIMAP and VRCORN. Transforming means any combinations of scaling, rotating and shifting with different factors for each axis.
  • The wszst command MINIMAP can center the minimap automatically. You can use this command with SZS, U8, BRRES and MDL0 files.
  • The image tool wimgt can convert images of all formats:
    • It can convert the file formats TPL, TEX0, BTI, BREFT and PNG to any other.
    • It can convert the Image Formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR to any other.
    • It supports the palette formats IA8, RGB565 and RGB5A3.
    • It can automatically create mipmaps, or it can use user defined mipmaps and create only missed mipmaps automatically.
    • It can patch images with other images.

Last Features

BMG

As of v2.08a all 4 known BMG encodigs (CP1252, UTF-16, Shift-JIS and UTF-8) are supported. The attribute size has been increased from 16 to 36 bytes to support some more games.

LE-CODE

LE-CODE is a new MKW extension and works like CT-CODE. To support it, the new tool wlect was created.

History and Download

Wiimm started the development of his SZS Tools in March 2011. The first goal was to automate the insertions of the track names for Wiimms Mario Kart Fun distributions. Therefore 2 tools have been needed: A SZS extractor and creator and a BMG manipulator. The 2 tools wszst and wbmgt were ready in April 2011. After this, Wiimm implemented an Image-Tool (wimgt), an StaticR.rel tool (wstrt), a KMP tool (wkmpt) and a KCL tool (wkclt). Other tools were added later. The last added tool is wlect to manage LE-CODE and LEX files. All tools are command line tools to support scripts and fully automated operations.

Latest Change Log

szs v2.19b r8243 - 2020-08-03

 - Bug fix for wlect LPAR: Message functions are not longer printed twice.


szs v2.19a r8237 - 2020-08-01

 - Bug fix: Tool wlect didn't read the second chat message functions from
   binary LE-CODE files.

 - Support of an old GameCube BMG variant (internally named "legacy").

 - Check minimap: Bones 'posRU' and 'posLD' are detected even if the root bone
   is renamed. This suppresses wrong warnings.


szs v2.18a r8217 - 2020-06-28

 - wszst/wkmpt CHECK: Hints about self linked item routes and item routes with
   exact 1 point. A warning is printed when both events apply for same route.

 - Bug fix: The number of tables is set to 6 if writing a short binary
   item-slot file (without tables for battles).

 - wszst TEXT/BINARY: New options to patch KMG files: --kmg-limit=seconds to
   limit the run time of battles and --kmg-copy=id to copy one slot definition
   to the 9 other slots.

 - Leseratte and I analysed the MKW internal VR calculations and adapted the
   results into the tools. So the calculations are 100% identical now.

 - Command wszst VR-RACE supports now up to 30 players for the VR calculation.

 - KMP/CAME type 6 and the related route is excluded from any transformation.

Links

Tools Overview

wszst (Wiimms SZS Tool)

wszst is a command driven tool to manipulate archives:

  • Supported archive formats: SZS, U8, RARC, BRRES, BREFF and BREFT.
  • It can extract all subfiles of any archive.
  • While extracting some file formats can be decoded (converted to text or PNG files).
  • It can create all (but not RARC archives) while readind and scanning a directory structure. Decoded files are encoded automatically.

Tool wszst: Features, commands and options

wbmgt (Wiimms BMG Tool)

wbmgt is a command driven tool to manipulate BMG (message) files.
Tool wbmgt: Features, commands and options

wkclt (Wiimms KCL Tool)

wkclt is a command driven tool to convert KCL files into/from binary KCL from/into Wavefront OBJ files.
Tool wkclt: Features, commands and options
General parser syntax and semantics
KCL export and import guide

wkmpt (Wiimms KMP Tool)

wkmpt is a command driven tool to convert KMP files into/from binary from/into text files. A special compiler is used to allow variables, expressions, if..then..else, loops, macros and user defined functions while reading a KMP text file.
Tool wkmpt: Features, commands and options
General parser syntax and semantics
KMP text syntax and semantics
KMP parser functions
How to edit KMP files

wimgt (Wiimms Image Tool)

wimgt is a command driven tool to convert and aptch graphic images:

  • wimgt supports the file formats BREFT, BTI, TEX0, TPL and PNG as export and import type.
  • wimgt supports the internal image formats I4, I8, IA4, IA8, RGB565, RGB5A3, RGBA32, C4, C8, C14X2 and CMPR (and also different PNG formats).

Tool wimgt: Features, commands and options

wstrt (Wiimms StaticR Tool)

wstrt is a command driven tool to manipulate StaticR files of Mario Kart Wii.
Tool wstrt: Features, commands and options

Links