BFEVFL: Difference between revisions
imported>Leoetlino No edit summary |
imported>Leoetlino No edit summary |
||
Line 1: | Line 1: | ||
<onlyinclude>'''bfevfl''' is a binary file format for [[Event flow|'''ev'''ent '''fl'''ows]].</onlyinclude> | <onlyinclude>'''bfevfl''' is a binary file format for [[Event flow|'''ev'''ent '''fl'''ows]].</onlyinclude> In ''Breath of the Wild'' and other Nintendo games such as Splatoon 2, binary event flows are parsed by Nintendo's EventFlow/evfl library. | ||
== Structures == | == Structures == | ||
Line 52: | Line 52: | ||
| 0x40 || Dictionary* || Timeline name dictionary | | 0x40 || Dictionary* || Timeline name dictionary | ||
|} | |} | ||
Note: 0x0-0x20 are just a standard ore::BinaryFileHeader (which is identical to nn::util::BinaryFileHeader). | |||
=== Relocation table === | === Relocation table === | ||
(The official name for this structure in the EventFlow library is ore::RelocationTable.) | |||
{|class="wikitable" | {|class="wikitable" | ||
! Offset !! Type !! Description | ! Offset !! Type !! Description | ||
Line 97: | Line 101: | ||
=== String pool === | === String pool === | ||
(The official name for this structure in the EventFlow library is ore::StringPool.) | |||
The string pool starts with the <code>STR </code> magic and contains 2-byte aligned strings. The magic is not checked at all since strings are directly referred to using pointers. | The string pool starts with the <code>STR </code> magic and contains 2-byte aligned strings. The magic is not checked at all since strings are directly referred to using pointers. | ||
All strings in the pool are Pascal | All strings in the pool are Pascal strings, i.e. length-prefixed strings. The length is an unsigned 16 bit integer. Strings are stored in reverse order of their binary representation. | ||
=== Dictionary === | === Dictionary === | ||
(The official name for this structure in the EventFlow library is ore::ResDic.) | |||
A dictionary is a data structure that is used to quickly look up the index of an element based on its name. Thus, they are always used in conjunction with an array of elements. However, the way the dictionary and the array are associated depends on the structure. | A dictionary is a data structure that is used to quickly look up the index of an element based on its name. Thus, they are always used in conjunction with an array of elements. However, the way the dictionary and the array are associated depends on the structure. | ||
Line 145: | Line 153: | ||
=== Container === | === Container === | ||
(The official name for this structure in the EventFlow library is ore::ResMetadata.) | |||
Containers are key-value mappings with keys being strings. A [[#Dictionary]] is used to store keys. | Containers are key-value mappings with keys being strings. A [[#Dictionary]] is used to store keys. | ||
Line 234: | Line 244: | ||
=== Actor === | === Actor === | ||
(The official name for this structure in the EventFlow library is evfl::ResActor.) | |||
{|class="wikitable" | {|class="wikitable" | ||
! Offset !! Type !! Description | ! Offset !! Type !! Description | ||
Line 255: | Line 267: | ||
| 0x34 || u16 || Entry point index for associated entry point (0xffff if none) | | 0x34 || u16 || Entry point index for associated entry point (0xffff if none) | ||
|- | |- | ||
| 0x36 || | | 0x36 || u8 || Cut number? This is set to 1 for flowcharts. Timeline actors sometimes use a different value here. {{check}} | ||
|- | |||
| 0x37 || u8 || Padding | |||
|} | |} | ||
=== Event === | === Event === | ||
==== EventType enum ==== | ==== EventType enum ==== | ||
(The official name for this enum in the EventFlow library is evfl::ResEvent::EventType::Type.) | |||
{|class="wikitable" | {|class="wikitable" | ||
! Value !! Name !! Description | ! Value !! Name !! Description | ||
Line 275: | Line 290: | ||
==== Main event structure ==== | ==== Main event structure ==== | ||
(The official name for this structure in the EventFlow library is evfl::ResEvent.) | |||
{|class="wikitable" | {|class="wikitable" | ||
!rowspan=2|Offset | !rowspan=2|Offset | ||
Line 302: | Line 318: | ||
=== Entry point === | === Entry point === | ||
(The official name for this structure in the EventFlow library is evfl::ResEntryPoint.) | |||
{|class="wikitable" | {|class="wikitable" | ||
! Offset !! Type !! Description | ! Offset !! Type !! Description | ||
Line 307: | Line 324: | ||
| 0x0 || u16* || Sub flow event indices | | 0x0 || u16* || Sub flow event indices | ||
|- | |- | ||
| 0x8 || | | 0x8 || Dictionary* || VariableDef names (parsed by the evfl lib, but unused by BotW) | ||
|- | |- | ||
| 0x10 || | | 0x10 || VariableDef* || VariableDefs (parsed by the evfl lib, but unused by BotW) | ||
|- | |- | ||
| 0x18 || u16 || Number of sub flow event indices | | 0x18 || u16 || Number of sub flow event indices | ||
|- | |- | ||
| 0x1a || u16 || | | 0x1a || u16 || Number of variable definitions | ||
|- | |- | ||
| 0x1c || u16 || Main event index | | 0x1c || u16 || Main event index | ||
|- | |- | ||
| 0x1e || u16 || Padding | | 0x1e || u16 || Padding | ||
|} | |} | ||
Revision as of 22:47, 14 December 2018
bfevfl is a binary file format for event flows. In Breath of the Wild and other Nintendo games such as Splatoon 2, binary event flows are parsed by Nintendo's EventFlow/evfl library.
Structures
bfevfl is a little endian format, so values are stored in little endian even on Wii U.
bfevfl uses pointers very heavily to refer to strings, to other sections, etc. All pointers are always 64 bit long -- since the same format is used on the Switch which is a 64 bit platform. They must be present in the #Relocation table if the file is to be loaded correctly by the official bfevfl code.
As a direct consequence, most sections don't have any fixed order. Therefore, this article will only document the data structures and mention the order Nintendo places sections in. For more details, it is recommended to look at the evfl
library directly.
Another consequence is that sections must be aligned to 8-byte boundaries in most cases to avoid unaligned memory accesses (this is not as important for strings).
Header
Offset | Type | Description |
---|---|---|
0x0 | char[8] | Magic ("BFEVFL\x00\x00") |
0x8 | u16 | Version (0x0300) |
0xa | u8 | Unknown (must be zero) |
0xb | u8 | Unknown |
0xc | u16 | Byte order mark |
0xe | u8 | Alignment (to get the actual value: 1 << raw_value) |
0xf | u8 | Unknown |
0x10 | u32 | File name offset |
0x14 | u16 | Is relocated flag (set in memory) |
0x16 | u16 | First block offset |
0x18 | u32 | Relocation table offset |
0x1c | u32 | File size |
0x20 | u16 | Number of flowcharts |
0x22 | u16 | Number of timelines |
0x24 | u32 | Padding |
0x28 | Flowchart* | Flowchart (nullptr if no flowchart) |
0x30 | Dictionary* | Flowchart name dictionary |
0x38 | Timeline* | Timeline (nullptr if no timeline) |
0x40 | Dictionary* | Timeline name dictionary |
Note: 0x0-0x20 are just a standard ore::BinaryFileHeader (which is identical to nn::util::BinaryFileHeader).
Relocation table
(The official name for this structure in the EventFlow library is ore::RelocationTable.)
Offset | Type | Description |
---|---|---|
0x0 | char[4] | Magic ("RELT") |
0x4 | u32 | Offset to relocation table start |
0x8 | u32 | Number of sections |
0xc | u32 | Padding |
0x10 | Section[num_sections] | Sections |
Note: the number of sections is almost always 1 because a single section can already fit 2^32 - 1 entries. If you need more than 4 billion entries, you are probably doing something very wrong.
Relocation table section
Offset | Type | Description |
---|---|---|
0x0 | void* | Alternative base offset (unused by Nintendo) |
0x8 | u32 | Used to calculate the base pointer if an alternative base offset is used |
0xc | u32 | Data end offset (before alignment) |
0x10 | u32 | Number of entries to skip |
0x14 | u32 | Number of entries (includes skipped entries) |
0x18 | Entry[num_entries] | Entries |
Relocation table entry
Offset | Type | Description |
---|---|---|
0x0 | u32 | Offset to pointers to relocate |
0x4 | u32 | Bit field that determines which pointers need to be relocated (up to 32 contiguous pointers starting from the listed offset) |
String pool
(The official name for this structure in the EventFlow library is ore::StringPool.)
The string pool starts with the STR
magic and contains 2-byte aligned strings. The magic is not checked at all since strings are directly referred to using pointers.
All strings in the pool are Pascal strings, i.e. length-prefixed strings. The length is an unsigned 16 bit integer. Strings are stored in reverse order of their binary representation.
Dictionary
(The official name for this structure in the EventFlow library is ore::ResDic.)
A dictionary is a data structure that is used to quickly look up the index of an element based on its name. Thus, they are always used in conjunction with an array of elements. However, the way the dictionary and the array are associated depends on the structure.
BFEVFL dictionaries are essentially binary radix trees (also called PATRICIA trees or tries). The structure contains a binary search tree and bit-by-bit comparisons of strings are done to navigate through it. It is extremely similar to the Wii U BFRES "index group" structure, but with significant changes to the algorithm. The Switch BFRES format shares the same algorithm.
Offset | Type | Description |
---|---|---|
0x0 | char[4] | Magic ("DIC ") |
0x4 | u32 | Number of entries (ignoring root entry) |
0x8 | Entry | Root entry (bit index is 0xffffffff )
|
0x18 | Entry[num_entries] | Entries |
Dictionary entry
Offset | Type | Description |
---|---|---|
0x0 | u32 | Compact representation of bit index |
0x4 | u16 | Next index if bit is 0 |
0x6 | u16 | Next index if bit is 1 |
0x8 | PascalString* | Name |
The compact representation of the bit index has two parts:
- Bits 3-7: index of the byte that should be checked
- Bits 0-2: index of the bit in that byte
A bit index can be translated to its compact representation using:
def get_compact_representation(bit_idx: int) -> int:
byte_idx = bit_idx // 8
return (byte_idx << 3) | (bit_idx - 8*byte_idx)
Example: Hello
corresponds to 100100001100101011011000110110001101111. Bits 0-3 are 1, bit 4 is 0, etc.
Container
(The official name for this structure in the EventFlow library is ore::ResMetadata.)
Containers are key-value mappings with keys being strings. A #Dictionary is used to store keys.
ContainerDataType enum
The following enum definition is complete and all names are official[1].
Value | Name |
---|---|
0 | Argument |
1 | Container |
2 | Int |
3 | Bool |
4 | Float |
5 | String |
6 | Wide string ("wstring") |
7 | Int array |
8 | Bool array |
9 | Float array |
10 | String array |
11 | Wstring array |
12 | Actor identifier |
ContainerItem
Offset | Type | Description |
---|---|---|
0x0 | ContainerDataType (u8) | Data type |
0x1 | u8 | Padding |
0x2 | u16 | Number of items |
0x4 | u32 | Padding |
0x8 | Dictionary* | Dictionary (for container types) |
0x10 | any | Data |
Container structure
The root container structure is a ContainerItem
with the data type set to Container
, a non-null dictionary (for item names), followed by pointers to children ContainerItem
s.
Child item structure
For all other data types, the dictionary pointer is null.
Data type | Data | Number of items |
---|---|---|
Argument | String (not in string pool, follows item structure immediately) | 1 |
Container | ? | ? |
Int | Signed 32-bit integer | 1 |
Bool | 0x80000001 if true, 0x00000000 otherwise | 1 |
Float | binary32 floating point number | 1 |
String | String (not in string pool, follows item structure immediately) | 1 |
Wide string ("wstring") | (not implemented) | ? |
Int array | Int[n] | n |
Bool array | Bool[n] | n |
Float array | Float[n] | n |
String array | String[n] (aligned to 8-byte boundaries this time) | n |
Wstring array | (not implemented) | ? |
Actor identifier | Two strings: actor name + secondary name | 2 |
Actor
(The official name for this structure in the EventFlow library is evfl::ResActor.)
Offset | Type | Description |
---|---|---|
0x0 | PascalString* | Name |
0x8 | PascalString* | Secondary name |
0x10 | PascalString* | Argument name |
0x18 | PascalString** | Pointer to array of actions (strings) |
0x20 | PascalString** | Pointer to array of queries (strings) |
0x28 | Container* | Parameters |
0x30 | u16 | Number of actions |
0x32 | u16 | Number of queries |
0x34 | u16 | Entry point index for associated entry point (0xffff if none) |
0x36 | u8 | Cut number? This is set to 1 for flowcharts. Timeline actors sometimes use a different value here. [check] |
0x37 | u8 | Padding |
Event
EventType enum
(The official name for this enum in the EventFlow library is evfl::ResEvent::EventType::Type.)
Value | Name | Description |
---|---|---|
0 | Action | Invokes an actor function ("action") with no return value. |
1 | Switch | Invokes an actor function ("query") with an int return value and branches execution flow depending on it. |
2 | Fork | Branches execution flow unconditionally. |
3 | Join | Used to reunify execution flow after a fork finishes executing. |
4 | Sub flow | Invokes an entry point in the same or in a different event flow. Similar to a function call. |
Main event structure
(The official name for this structure in the EventFlow library is evfl::ResEvent.)
Offset | Type | Description | |||||
---|---|---|---|---|---|---|---|
Action | Switch | Fork | Join | Sub flow | |||
0x0 | PascalString* | Name | |||||
0x8 | EventType (u8) | Type | |||||
0x9 | u8 | Padding | |||||
0xa | u16 | Next event index | Number of cases (>=0) | Number of forks (>0) | Next event index | ||
0xc | u16 | Actor index | Join event index (required) | Unused | |||
0xe | u16 | Actor action index | Actor query index | Unused | |||
0x10 | void* | Container* (optional parameters) | u16* (fork event indexes) | Unused | Container* (optional parameters) | ||
0x18 | void* | Unused | SwitchCases* (0x0: u32 value, 0x4: u16 event index, 0x6: u16 padding) | Unused | PascalString* (flowchart name) | ||
0x20 | void* | Unused | PascalString* (entry point name) |
Entry point
(The official name for this structure in the EventFlow library is evfl::ResEntryPoint.)
Offset | Type | Description |
---|---|---|
0x0 | u16* | Sub flow event indices |
0x8 | Dictionary* | VariableDef names (parsed by the evfl lib, but unused by BotW) |
0x10 | VariableDef* | VariableDefs (parsed by the evfl lib, but unused by BotW) |
0x18 | u16 | Number of sub flow event indices |
0x1a | u16 | Number of variable definitions |
0x1c | u16 | Main event index |
0x1e | u16 | Padding |
Flowchart
Offset | Type | Description |
---|---|---|
0x0 | char[4] | Magic ("EVFL") |
0x4 | u32 | String pool offset (relative to this structure) |
0x8 | u32 | Padding |
0xc | u32 | Padding |
0x10 | u16 | Number of actors |
0x12 | u16 | Total number of actions |
0x14 | u16 | Total number of queries |
0x16 | u16 | Number of events |
0x18 | u16 | Number of entry points |
0x1a | u16 | Padding |
0x1c | u16 | Padding |
0x1e | u16 | Padding |
0x20 | PascalString* | Name |
0x28 | Actor* | Actors |
0x30 | Event* | Events |
0x38 | Dictionary* | Entry point dictionary |
0x40 | EntryPoint* | Entry points |
Timeline
This section is empty. You can help by adding to it. |
Section order
File
- Header (0x48 bytes)
- Flowchart* array if it exists
- Flowchart dictionary (always)
- Timeline* array if it exists
- Timeline dictionary (always)
- Timeline
- Flowchart
- String pool (
STR
) - Relocation table (
RELT
)
Timeline
This section is empty. You can help by adding to it. |
Flowchart
- Flowchart header
- Actors
- Argument name is put in the string pool.
- Events
- Entry point dictionary
- Entry points
- Event param containers, fork structs, etc. (in order)
- Actor param containers, string pointer arrays (in order)
- Entry point extra data
- Sub flow event index arrays are written here
- ptr_x10 data may be written here? (ptr_x10 has always been a nullptr in files that have been checked by leoetlino.)
- The size for each entry point is sizeof(event_idx_array) rounded up to the nearest multiple of 8 + 0x18 bytes.
Container
- Container header (variable size)
- Container dictionary
- Container items (+ values)
Usage in Breath of the Wild
BFEVFL is used as the underlying format for event flows in the release versions. They are always stored under EventFlow and have "bfevfl" (for flowcharts) and "bfevtm" (for timelines) as their file extensions.
For development versions, it appears that a different, non-binary format was used ("evfl").
Tools
evfl
: Python library for parsing and writing event flows- EventEditor: graphical editor for event flows
- ↑ 0x7101DA3EC8 in Switch 1.5.0