Project:Help wanted: Difference between revisions

Jump to navigation Jump to search
→‎Game logic: One-hit kill protection
imported>Leoetlino
No edit summary
imported>Leoetlino
(→‎Game logic: One-hit kill protection)
 
(32 intermediate revisions by the same user not shown)
Line 1: Line 1:
Many secrets still remain to be uncovered. If you have experience with reverse engineering or if you are looking for a fun project to start with RE (or both!), please help us investigate the following mysteries.
Many secrets still remain to be uncovered. If you have experience with reverse engineering or if you are looking for a fun project to start with RE (or both!), please investigate the following mysteries or help with the following tasks.
 
== Reverse engineering tips ==
{{expand section}}
=== GameData flags ===
GameData flags can be read and set from many different systems:
* '''Event flows'''. A very convenient way to determine if a flag is being set in an event flow (or queried, passed to the executable, ...) is to grep [https://github.com/MrCheeze/botw-tools/tree/master/event MrCheeze/botw-tools:event] for the flag name.
* '''Map units'''. LinkTags can be used to conditionally spawn map objects based on GameData flags (which are called SaveFlags in map units) and also to set them. It is extremely common for Area tags to be used for triggering LinkTags (which in turn write to GameData flags).
* '''Executable'''. The executable obviously also reads and writes to game data flags. Do note that the name of the flag is not always hardcoded, and may instead come from a configuration file (example: the Defeated counters for the [[difficulty scaling]] system).
 
The GameData system is configured by bgdata files in [[Content/GameData]]. These files determine flags' initial values and their minimum/maximum values.
 
=== Resource locations ===
The following lists of game resources can be used to find where a resource is stored in the [[content]] files:
* https://github.com/leoetlino/botw-re-notes/blob/master/game_files/wiiu_rstb_150.csv
* https://github.com/leoetlino/botw-re-notes/blob/master/game_files/switch_rstb_150.csv
 
=== Actor names ===
Actors have an accompanying descriptor ([[ActorLink]]) that contains the name of the actor in Japanese. This name is usually more descriptive and easier to understand than the actor name.
 
=== Cutscenes ===
A cutscene can be identified via several methods:
* If the cutscene has text dialogue, looking at [https://github.com/MrCheeze/botw-tools/blob/master/text localisation strings] is often the best way to find out what a cutscene is used for.
* Look at the [[Demo]] list.
* Look at the associated event flow with the [https://eventviewer.zeldamods.org/ Event Viewer], [[help:Tools/EventEditor|EventEditor]] or [https://github.com/MrCheeze/botw-tools/tree/master/event MrCheeze's text dump of events].
* Listen to the demo's soundtrack (in Sound).


== Formats ==
== Formats ==
''The following tasks require reversing [[:Category:file formats|file formats]]. It is strongly recommended to also examine the executable to gain more reliable knowledge about formats and figure out how they are used by Nintendo ''exactly''.''
''The following tasks require reversing [[:Category:file formats|file formats]]. It is strongly recommended to also examine the executable to gain more reliable knowledge about formats and figure out how they are used by Nintendo ''exactly''.''


=== XLink database ===
=== XLink databases ===
To make the development process more efficient, Nintendo introduced a system called SoundLink (aka SLink)<ref>[https://game.watch.impress.co.jp/docs/news/1078827.html BotW CEDEC 2017 talk]</ref><ref>0x7101E271AE in Switch 1.5.0</ref> (and its counterpart for effects: EffectLink<ref>0x7101E3790B in Switch 1.5.0</ref>) during development. Both systems were at some point unified and are now handled by a single xlink2 library which handles both the SLink and ELink systems.
To make the development process more efficient, Nintendo introduced a system called SoundLink (aka SLink)<ref>[https://game.watch.impress.co.jp/docs/news/1078827.html BotW CEDEC 2017 talk]</ref><ref>0x7101E271AE in Switch 1.5.0</ref> (and its counterpart for effects: EffectLink<ref>0x7101E3790B in Switch 1.5.0</ref>) during development. Both systems were at some point unified and are now handled by a single xlink2 library which handles both the SLink and ELink systems.


Line 11: Line 36:
The format has not seen a lot of research as of September 2018, despite the executable being full of debug strings that include field names and the fact that other recent Nintendo games such as ''Splatoon 2'' ship the library with debugging symbols.
The format has not seen a lot of research as of September 2018, despite the executable being full of debug strings that include field names and the fact that other recent Nintendo games such as ''Splatoon 2'' ship the library with debugging symbols.


=== Event timelines ===
=== Havok packfiles and structures ===
Nintendo uses Havok binary packfiles for all Havok resources. Thus, it is difficult to manipulate physics files.
 
Fortunately the Havok library relies on reflection data to load resources. This makes it possible to parse the binaries and reconstruct a human readable representation with ''every single field name and even enum definitions''. Reflection information has been [https://github.com/leoetlino/botw-re-notes/blob/master/tools/havok_reflection_info.json dumped for the Switch version].
 
The following tasks remain to be done:
 
* Dump reflection data for the Wii U version. Data offsets are different since the Switch uses a different compiler, is a 64 bit little-endian platform unlike the Wii U (32-bit big endian machine).
* Write a library to manipulate binary packfiles: getting, modifying, adding and removing Havok objects from a packfile (and perhaps converting them to XML too?)
* Document how the compression for <code>hkpBvCompressedMeshShape</code>s works. Nintendo uses compressed mesh shapes for all [[Content/Physics/StaticCompound|static compound]] collision files.
 
=== <s>Event timelines</s> ===
[[bfevtm]] files (binary event timelines) are extremely similar to [[bfevfl]] files (binary event flowcharts), but have a few significant differences that make them incompatible with the [https://github.com/leoetlino/evfl evfl] library as of September 2018.
[[bfevtm]] files (binary event timelines) are extremely similar to [[bfevfl]] files (binary event flowcharts), but have a few significant differences that make them incompatible with the [https://github.com/leoetlino/evfl evfl] library as of September 2018.


Line 18: Line 54:
If you are willing to take up this task, please ping [[User:leoetlino|leoetlino]] for the Switch 1.5.0 IDC.
If you are willing to take up this task, please ping [[User:leoetlino|leoetlino]] for the Switch 1.5.0 IDC.


=== Havok packfiles and structures ===
'''Update''' (16/12/2018): All timeline-related structures are now known thanks to Nintendo shipping the EventFlow library with full symbols in another game. Some fields are still unknown at the moment, though (see [https://github.com/leoetlino/bfevfl-template/blob/master/timeline.bt leoetlino/bfevfl-template:timeline.bt] and [https://github.com/leoetlino/bfevfl-template/blob/master/actor.bt leoetlino/bfevfl-template:actor.bt] for more details).
Nintendo uses Havok binary packfiles for all Havok resources. Thus, it is difficult to manipulate physics files.
 
'''Update''' (19/12/2018): [https://github.com/leoetlino/evfl evfl v0.13.0] now supports event timelines.
 
== Game logic ==
''The following tasks require reversing the executable or some serious experiments to have reliable information on how the mechanics work.''
 
=== EnvPalettes and areas ===
The [[WorldMgr]] configuration file, [[normal.bwinfo]], has a set of 207 environment-related settings called "env palettes". The link between palette numbers and maps/areas/shrines is currently unknown.
 
=== The Master Cycle Zero's speed ===
How is the motorcycle's speed configured? It's not in GeneralParamList, so it might be physics-based or even hardcoded.
 
=== AutoPlacement ===
How often does AutoPlacement code run? RailDistance? Does it check the camera field of view to decide whether to spawn dragons or not?
 
Which positions are being considered for spawning actors?


[[User:leoetlino|leoetlino]] discovered that fortunately the Havok library relies on reflection data to load resources. This makes it possible to parse the binaries and reconstruct a human readable representation with ''every single field name and even enum definitions''. Reflection information has been [https://github.com/leoetlino/botw-re-notes/blob/master/tools/havok_reflection_info.json dumped for the Switch version].
=== Glitches ===
==== Horse sliding ====
How does this glitch work? How is the sliding direction determined?


The following tasks remain to be done:
==== Apparatus Storage ====
How does this glitch work? Is there anything else that could trigger a similar state?


* Dump reflection data for the Wii U version. Data offsets are different since the Switch uses a different compiler, is a 64 bit little-endian platform unlike the Wii U (32-bit big endian machine).
==== Lizalfos physics glitch ====
* Write a library to manipulate binary packfiles: getting, modifying, adding and removing Havok objects from a packfile (and perhaps converting them to XML too?)
How does this glitch work? Why does the game crash?
* Figure out how the compression for <code>hkpBvCompressedMeshShape</code>s works. Nintendo uses compressed mesh shapes for all [[Content/Physics/StaticCompound|static compound]] collision files.


== Game logic ==
=== <s>amiibo drops</s> ===
''The following tasks require reversing the executable to have reliable information on how the mechanics work.''
{{lta|link=amiibo drops}}


=== amiibo drops ===
* How scaling (weapon upgrades) works for amiibo weapons.
* How scaling (weapon upgrades) works for amiibo weapons.
*: amiibo weapons don't entirely follow the regular weapon scaling and bonus rules.
*: amiibo weapons don't entirely follow the regular weapon scaling and bonus rules.
Line 38: Line 90:
*: amiibo [[ActorParam/DropTable|DropTable]]s generally contain 8 tables: Normal, SmallHit, BigHit({Normal,Parasail,Remain}), and GreatHit({Normal,Parasail,Remain}). Parasail tables are presumably selected after the player receives the paraglider, and Remain after Link completes a divine beast; however this is pretty much only speculation. It is also currently unknown what determines which xxxxxHit table gets used.
*: amiibo [[ActorParam/DropTable|DropTable]]s generally contain 8 tables: Normal, SmallHit, BigHit({Normal,Parasail,Remain}), and GreatHit({Normal,Parasail,Remain}). Parasail tables are presumably selected after the player receives the paraglider, and Remain after Link completes a divine beast; however this is pretty much only speculation. It is also currently unknown what determines which xxxxxHit table gets used.


=== One-Hit kill protection ===
=== <s>The Blood Moon</s> ===
{{lta|link=Blood moon}}
 
How do Blood Moons work? It is now well known that scheduled Blood Moons are based on a timer, and that (surprise!) [[WorldMgr]] is the thing that is responsible for keeping track of the schedule. However, what are the exact conditions that stop this timer?
 
(Panic Blood Moons are well understood now.)
 
=== <s>Respawning logic</s> ===
{{lta|link=Object respawning}}
 
While the respawn logic for most objects is very simple, some entities do not ''appear'' to be affected by Blood Moons: fruits on trees, shop items. Investigate GameDataMgr as this is likely where the logic is.
 
=== <s>One-hit kill protection</s> ===
It is well known that Link cannot die in one-hit under specific cases. What are the exact conditions for this protection to apply? Interestingly, it appears this mechanic is gone in Master Mode.
It is well known that Link cannot die in one-hit under specific cases. What are the exact conditions for this protection to apply? Interestingly, it appears this mechanic is gone in Master Mode.


Line 44: Line 108:


== Resource sizes ==
== Resource sizes ==
''Investigating this requires reversing the [[resource system]] (in the executable) and possibly patching it.''
The [[resource size table]] (RSTB) determines how much memory should be allocated to a given resource (i.e. the size of the resource heap). Unfortunately, the sizes that are listed in there don't quite match the actual file size.
The [[resource size table]] (RSTB) determines how much memory should be allocated to a given resource (i.e. the size of the resource heap). Unfortunately, the sizes that are listed in there don't quite match the actual file size.


Line 53: Line 119:


A possible way to check whether the listed size is exact or approximate is to dump the memory of the game process and investigate resource heap usage.
A possible way to check whether the listed size is exact or approximate is to dump the memory of the game process and investigate resource heap usage.
In any case, figuring out how to calculate sizes correctly for complex resources or rewriting parts of the resource system to remove the fixed heap size limitation would be extremely useful.


== Executable analysis ==
== Executable analysis ==
Everything you see in ''Breath of the Wild'' is implemented in the executable. Some aspects can be modified by editing assets; other things are hardcoded, meaning it's impossible to change how the game works by merely editing content files.
Everything in ''Breath of the Wild'' is implemented in the executable. Some aspects can be modified by editing assets; other things are hardcoded, meaning it's impossible to change how the game works by merely editing content files.


Analysing the executable is the only way to understand how things are implemented internally and how the game actually works. Eventually, after enough information has been collected, it becomes possible to directly edit the game core. With a more complete understanding, more in-depth modifications can be done by hooking into functions and injecting custom code.
Analysing the executable is the only way to understand how things are implemented internally and how the game actually works. Eventually, after enough information has been collected, it becomes possible to predict how something will behave exactly and also to directly edit the game core. With a more complete understanding, more in-depth modifications can be done by hooking into functions and injecting custom code.


This is similar to the process of creating cheat codes, but different in that this relies on static analysis more and requires understanding how all the different subsystems interact.
This is similar to the process of creating cheat codes, but different in that this relies on static analysis more and requires understanding how all the different subsystems interact.
Line 68: Line 136:
=== Demo mode ===
=== Demo mode ===
Setting the ROM type to demo ROM types (found in the [[executable]]) make the game crash. What is locked behind them?
Setting the ROM type to demo ROM types (found in the [[executable]]) make the game crash. What is locked behind them?
=== Stage select screen ===
The release version has a stage select screen left (see [[Executable#ErrorViewer_and_Stage_Select]] for more details). It should be possible to get it to work.


=== Actor debug utilities ===
=== Actor debug utilities ===
In a similar fashion, Nintendo has also left an entire [[ActorDebug]] subsystem in all release versions, which can print information to the screen and interact with many different actor system components and things like map units.
In a similar fashion, Nintendo has also left an entire [[ActorDebug]] subsystem in all release versions, which can print information to the screen and interact with many different actor system components and things like map units.
=== <s>Stage select screen</s> ===
{{lta|link=StageSelect}}
The release version has a stage select screen left (see [[Executable#ErrorViewer_and_Stage_Select]] for more details). <s>It should be possible to get it to work.</s>
Anonymous user

Navigation menu