LLVM Bytecode File Format
  1. Abstract
  2. Concepts
    1. Blocks
    2. Lists
    3. Fields
    4. Alignment
    5. Encoding Primitives
    6. Slots
  3. General Layout
    1. Structure
  4. Detailed Layout
    1. Notation
    2. Blocks Types
    3. Signature Block
    4. Module Block
    5. Global Type Pool
    6. Module Info Block
    7. Global Constant Pool
    8. Function Definition
    9. Compaction Table
    10. Instruction List
    11. Symbol Table
  5. Version Differences
    1. Version 1.2 Differences From 1.3
    2. Version 1.1 Differences From 1.2
    3. Version 1.0 Differences From 1.1

Written by Reid Spencer

Warning: This is a work in progress.

Abstract

This document describes the LLVM bytecode file format as of version 1.3. It specifies the binary encoding rules of the bytecode file format so that equivalent systems can encode bytecode files correctly. The LLVM bytecode representation is used to store the intermediate representation on disk in compacted form.

Concepts

This section describes the general concepts of the bytecode file format without getting into bit and byte level specifics. Note that the LLVM bytecode format may change in the future, but will always be backwards compatible with older formats. This document only describes the most current version of the bytecode format.

Blocks

LLVM bytecode files consist simply of a sequence of blocks of bytes. Each block begins with an header of two unsigned integers. The first value identifies the type of block and the second value provides the size of the block in bytes. The block identifier is used because it is possible for entire blocks to be omitted from the file if they are empty. The block identifier helps the reader determine which kind of block is next in the file. Note that blocks can be nested within other blocks.

All blocks are variable length, and the block header specifies the size of the block. All blocks begin on a byte index that is aligned to an even 32-bit boundary. That is, the first block is 32-bit aligned because it starts at offset 0. Each block is padded with zero fill bytes to ensure that the next block also starts on a 32-bit boundary.

Lists

LLVM Bytecode blocks often contain lists of things of a similar type. For example, a function contains a list of instructions and a function type contains a list of argument types. There are two basic types of lists: length lists, and null terminated lists, as described here:

Fields

Fields are units of information that LLVM knows how to write atomically. Most fields have a uniform length or some kind of length indication built into their encoding. For example, a constant string (array of bytes) is written simply as the length followed by the characters. Although this is similar to a list, constant strings are treated atomically and are thus fields.

Fields use a condensed bit format specific to the type of information they must contain. As few bits as possible are written for each field. The sections that follow will provide the details on how these fields are written and how the bits are to be interpreted.

Alignment

To support cross-platform differences, the bytecode file is aligned on certain boundaries. This means that a small amount of padding (at most 3 bytes) will be added to ensure that the next entry is aligned to a 32-bit boundary.

Encoding Primitives

Each field that can be put out is encoded into the file using a small set of primitives. The rules for these primitives are described below.

Variable Bit Rate Encoding

Most of the values written to LLVM bytecode files are small integers. To minimize the number of bytes written for these quantities, an encoding scheme similar to UTF-8 is used to write integer data. The scheme is known as variable bit rate (vbr) encoding. In this encoding, the high bit of each byte is used to indicate if more bytes follow. If (byte & 0x80) is non-zero in any given byte, it means there is another byte immediately following that also contributes to the value. For the final byte (byte & 0x80) is false (the high bit is not set). In each byte only the low seven bits contribute to the value. Consequently 32-bit quantities can take from one to five bytes to encode. In general, smaller quantities will encode in fewer bytes, as follows:

Byte # Significant Bits Maximum Value
10-6127
27-1316,383
314-202,097,151
421-27268,435,455
528-3434,359,738,367
635-414,398,046,511,103
742-48562,949,953,421,311
849-5572,057,594,037,927,935
956-629,223,372,036,854,775,807
1063-691,180,591,620,717,411,303,423

Note that in practice, the tenth byte could only encode bit 63 since the maximum quantity to use this encoding is a 64-bit integer.

Signed VBR values are encoded with the standard vbr encoding, but with the sign bit as the low order bit instead of the high order bit. This allows small negative quantities to be encoded efficiently. For example, -3 is encoded as "((3 << 1) | 1)" and 3 is encoded as "(3 << 1) | 0)", emitted with the standard vbr encoding above.

The table below defines the encoding rules for type names used in the descriptions of blocks and fields in the next section. Any type name with the suffix _vbr indicate a quantity that is encoded using variable bit rate encoding as described above.

Type Rule
unsigned A 32-bit unsigned integer that always occupies four consecutive bytes. The unsigned integer is encoded using LSB first ordering. That is bits 20 through 27 are in the byte with the lowest file offset (little endian).
uint_vbr A 32-bit unsigned integer that occupies from one to five bytes using variable bit rate encoding.
uint64_vbr A 64-bit unsigned integer that occupies from one to ten bytes using variable bit rate encoding.
int64_vbr A 64-bit signed integer that occupies from one to ten bytes using the signed variable bit rate encoding.
char A single unsigned character encoded into one byte
bit A single bit within some larger integer field.
string A uint_vbr indicating the length of the character string immediately followed by the characters of the string. There is no terminating null byte in the string.
data An arbitrarily long segment of data to which no interpretation is implied. This is used for float, double, and constant initializers.
block A block of data that is logically related. A block begins with an unsigned that provides the block identifier (constant value) and an unsigned that provides the length of the block. Blocks may compose other blocks.
Slots

The bytecode format uses the notion of a "slot" to reference Types and Values. Since the bytecode file is a direct representation of LLVM's intermediate representation, there is a need to represent pointers in the file. Slots are used for this purpose. For example, if one has the following assembly:

%MyType = type { int, sbyte }
%MyVar = external global %MyType

there are two definitions. The definition of %MyVar uses %MyType. In the C++ IR this linkage between %MyVar and %MyType is explicit through the use of C++ pointers. In bytecode, however, there's no ability to store memory addresses. Instead, we compute and write out slot numbers for every Type and Value written to the file.

A slot number is simply an unsigned 32-bit integer encoded in the variable bit rate scheme (see encoding). This ensures that low slot numbers are encoded in one byte. Through various bits of magic LLVM attempts to always keep the slot numbers low. The first attempt is to associate slot numbers with their "type plane". That is, Values of the same type are written to the bytecode file in a list (sequentially). Their order in that list determines their slot number. This means that slot #1 doesn't mean anything unless you also specify for which type you want slot #1. Types are handled specially and are always written to the file first (in the Global Type Pool) and in such a way that both forward and backward references of the types can often be resolved with a single pass through the type pool.

Slot numbers are also kept small by rearranging their order. Because of the structure of LLVM, certain values are much more likely to be used frequently in the body of a function. For this reason, a compaction table is provided in the body of a function if its use would make the function body smaller. Suppose you have a function body that uses just the types "int*" and "{double}" but uses them thousands of time. Its worthwhile to ensure that the slot number for these types are low so they can be encoded in a single byte (via vbr). This is exactly what the compaction table does.

General Layout

This section provides the general layout of the LLVM bytecode file format. The detailed layout can be found in the next section.

Structure

The bytecode file format requires blocks to be in a certain order and nested in a particular way so that an LLVM module can be constructed efficiently from the contents of the file. This ordering defines a general structure for bytecode files as shown below. The table below shows the order in which all block types may appear. Please note that some of the blocks are optional and some may be repeated. The structure is fairly loose because optional blocks, if empty, are completely omitted from the file.

ID Parent Optional? Repeated? Level Block Type
N/AFileNoNo0 Signature
0x01FileNoNo0 Module
0x15ModuleNoNo1     Global Type Pool
0x14ModuleNoNo1     Module Globals Info
0x12ModuleYesNo1     Module Constant Pool
0x11ModuleYesYes1     Function Definitions
0x12FunctionYesNo2        Function Constant Pool
0x33FunctionYesNo2        Compaction Table
0x32FunctionNoNo2        Instruction List
0x13FunctionYesNo2        Function Symbol Table
0x13ModuleYesNo1     Module Symbol Table

Use the links in the table or see Block Types for details about the contents of each of the block types.

Detailed Layout

This section provides the detailed layout of the LLVM bytecode file format.

Notation

The descriptions of the bytecode format that follow describe the order, type and bit fields in detail. These descriptions are provided in tabular form. Each table has four columns that specify:

  1. Byte(s): The offset in bytes of the field from the start of its container (block, list, other field).
  2. Bit(s): The offset in bits of the field from the start of the byte field. Bits are always little endian. That is, bit addresses with smaller values have smaller address (i.e. 20 is at bit 0, 21 at 1, etc.)
  3. Align?: Indicates if this field is aligned to 32 bits or not. This indicates where the next field starts, always on a 32 bit boundary.
  4. Type: The basic type of information contained in the field.
  5. Description: Describes the contents of the field.
Block Types

The bytecode format encodes the intermediate representation into groups of bytes known as blocks. The blocks are written sequentially to the file in the following order:

  1. Signature: This contains the file signature (magic number) that identifies the file as LLVM bytecode and the bytecode version number.
  2. Module Block: This is the top level block in a bytecode file. It contains all the other blocks.
  3. Global Type Pool: This block contains all the global (module) level types.
  4. Module Info: This block contains the types of the global variables and functions in the module as well as the constant initializers for the global variables
  5. Constants: This block contains all the global constants except function arguments, global values and constant strings.
  6. Functions: One function block is written for each function in the module.
  7. Symbol Table: The module level symbol table that provides names for the various other entries in the file is the final block written.
Signature Block

The signature occurs in every LLVM bytecode file and is always first. It simply provides a few bytes of data to identify the file as being an LLVM bytecode file. This block is always four bytes in length and differs from the other blocks because there is no identifier and no block length at the start of the block. Essentially, this block is just the "magic number" for the file.

Type Field Description
char Constant "l" (0x6C)
char Constant "l" (0x6C)
char Constant "v" (0x76)
char Constant "m" (0x6D)
Module Block

The module block contains a small pre-amble and all the other blocks in the file. The table below shows the structure of the module block. Note that it only provides the module identifier, size of the module block, and the format information. Everything else is contained in other blocks, described in other sections.

Type Field Description
unsigned Module Identifier (0x01)
unsigned Size of the module block in bytes
uint32_vbr Format Information
block Global Type Pool
block Module Globals Info
block Module Constant Pool
block Function Definitions
block Module Symbol Table
Format Information

The format information field is encoded into a 32-bit vbr-encoded unsigned integer as shown in the following table.

Bit(s) Type Description
0bit Big Endian?
1bit Pointers Are 64-bit?
2bit Has No Endianess?
3bit Has No Pointer Size?
4-31bit Bytecode Format Version

Of particular note, the bytecode format number is simply a 28-bit monotonically increase integer that identifies the version of the bytecode format (which is not directly related to the LLVM release number). The bytecode versions defined so far are (note that this document only describes the latest version, 1.3):

Note that we plan to eventually expand the target description capabilities of bytecode files to target triples.

Global Type Pool

The global type pool consists of type definitions. Their order of appearance in the file determines their slot number (0 based). Slot numbers are used to replace pointers in the intermediate representation. Each slot number uniquely identifies one entry in a type plane (a collection of values of the same type). Since all values have types and are associated with the order in which the type pool is written, the global type pool must be written as the first block of a module. If it is not, attempts to read the file will fail because both forward and backward type resolution will not be possible.

The type pool is simply a list of type definitions, as shown in the table below.

Type Field Description
unsigned Type Pool Identifier (0x13)
unsigned Size in bytes of the symbol table block.
uint32_vbr Number of entries in type plane
type Each of the type definitions (see below)1
1Repeated field.
Type Definitions

Types in the type pool are defined using a different format for each basic type of type as given in the following sections.

Primitive Types

The primitive types encompass the basic integer and floating point types

Type Description
uint32_vbr Type ID For The Primitive (1-11)1
1See the definition of Type::TypeID in Type.h for the numeric equivalents of the primitive type ids.

Function Types

Type Description
uint32_vbr Type ID for function types (13)
uint32_vbr Slot number of function's return type.
uint32_vbr The number of arguments in the function.
uint32_vbr Slot number of each argument's type.1
uint32_vbr Value 0 if this is a varargs function.2
1Repeated field.
2Optional field.

Structure Types

Type Description
uint32_vbr Type ID for structure types (14)
uint32_vbr Slot number of each of the element's fields.1
uint32_vbr Null Terminator (VoidTy type id)
1Repeated field.

Array Types

Type Description
uint32_vbr Type ID for Array Types (15)
uint32_vbr Slot number of array's element type.
uint32_vbr The number of elements in the array.

Pointer Types

Type Description
uint32_vbr Type ID For Pointer Types (16)
uint32_vbr Slot number of pointer's element type.

Opaque Types

Type Description
uint32_vbr Type ID For Opaque Types (17)
Module Global Info

To be determined.

Constant Pool

To be determined.

Function Definition

To be determined.

Compaction Table

To be determined.

Instruction List

To be determined.

Symbol Table

A symbol table can be put out in conjunction with a module or a function. A symbol table is a list of type planes. Each type plane starts with the number of entries in the plane and the type plane's slot number (so the type can be looked up in the global type pool). For each entry in a type plane, the slot number of the value and the name associated with that value are written. The format is given in the table below.

Byte(s) Bit(s) Align? Type Field Description
00-03-Nounsigned Symbol Table Identifier (0x13)
04-07-Nounsigned Size in bytes of the symbol table block.
08-111-Nouint32_vbr Number of entries in type plane
12-151-Nouint32_vbr Type plane index for following entries
16-191,2-Nouint32_vbr Slot number of a value.
variable1,2-Nostring Name of the value in the symbol table.
1Maximum length shown, may be smaller
2Repeated field.
Version Differences

This section describes the differences in the Bytecode Format across LLVM versions. The versions are listed in reverse order because it assumes the current version is as documented in the previous sections. Each section here describes the differences between that version and the one that follows

Version 1.2 Differences From 1.3
Type Derives From Value

In version 1.2, the Type class in the LLVM IR derives from the Value class. This is not the case in version 1.3. Consequently, in version 1.2 the notion of a "Type Type" was used to write out values that were Types. The types always occuped plane 12 (corresponding to the TypeTyID) of any type planed set of values. In 1.3 this representation is not convenient because the TypeTyID (12) is not present and its value is now used for LabelTyID. Consequently, the data structures written that involve types do so by writing all the types first and then each of the value planes according to those types. In version 1.2, the types would have been written intermingled with the values.

Restricted getelementptr Types

In version 1.2, the getelementptr instruction required a ubyte type index for accessing a structure field and a long type index for accessing an array element. Consequently, it was only possible to access structures of 255 or fewer elements. Starting in version 1.3, this restriction was lifted. Structures must now be indexed with int or uint types. Arrays must now be indexed with long or ulong types. This requirement was needed so that LLVM could compile several test cases that used large numbers of fields in their structures. The consequence of this was that the bytecode format had to change in order to accommodate the larger range of structure indices.

Version 1.1 Differences From 1.2
Explicit Primitive Zeros

In version 1.1, the zero value for primitives was explicitly encoded into the bytecode format. Since these zero values are constant values in the LLVM IR and never change, there is no reason to explicitly encode them. This explicit encoding was removed in version 1.2.

Inconsistent Module Global Info

In version 1.1, the Module Global Info block was not aligned causing the next block to be read in on an unaligned boundary. This problem was corrected in version 1.2.

Version 1.0 Differences From 1.1

None. Version 1.0 and 1.1 bytecode formats are identical.


Valid CSS! Valid HTML 4.01! Reid Spencer and Chris Lattner
The LLVM Compiler Infrastructure
Last modified: $Date$