aboutsummaryrefslogtreecommitdiff
path: root/docs/BranchWeightMetadata.html
blob: 3a0af290436a09c19b3d659ba4d3cf83dabc472b (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN"
                      "http://www.w3.org/TR/html4/strict.dtd">
<html>
<head>
  <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  <title>LLVM Branch Weight Metadata</title>
  <link rel="stylesheet" href="_static/llvm.css" type="text/css">
</head>
<body>

<h1>
  LLVM Branch Weight Metadata
</h1>

<ol>
  <li><a href="#introduction">Introduction</a></li>
  <li><a href="#supported_instructions">Supported Instructions</a></li>
  <li><a href="#builtin_expect">Built-in "expect" Instruction </a></li>
  <li><a href="#cfg_modifications">CFG Modifications</a></li>
</ol>

<div class="doc_author">
  <p>Written by <a href="mailto:jstaszak@apple.com">Jakub Staszak</a></p>
</div>

<h2>
  <a name="introduction">Introduction</a>
</h2>
<div>
<p>Branch Weight Metadata represents branch weights as its likeliness to
be taken. Metadata is assigned to the <tt>TerminatorInst</tt> as a
<tt>MDNode</tt> of the <tt>MD_prof</tt> kind. The first operator is always a
<tt>MDString</tt> node with the string "branch_weights". Number of operators
depends on the terminator type.</p>

<p>Branch weights might be fetch from the profiling file, or generated based on
<a href="#builtin_expect"><tt>__builtin_expect</tt></a> instruction.
</p>

<p>All weights are represented as an unsigned 32-bit values, where higher value
indicates greater chance to be taken.</p>
</div>

<h2>
  <a name="supported_instructions">Supported Instructions</a>
</h2>

<div>
  <h4>BranchInst</h4>
  <div>
    <p>Metadata is only assign to the conditional branches. There are two extra
    operarands, for the true and the false branch.</p>
  </div>
  <div class="doc_code">
  <pre>
!0 = metadata !{
  metadata !"branch_weights",
  i32 &lt;TRUE_BRANCH_WEIGHT&gt;,
  i32 &lt;FALSE_BRANCH_WEIGHT&gt;
}
  </pre>
  </div>

  <h4>SwitchInst</h4>
  <div>
  <p>Branch weights are assign to every case (including <tt>default</tt> case
  which is always case #0).</p>
  </div>
  <div class="doc_code">
  <pre>
!0 = metadata !{
  metadata !"branch_weights",
  i32 &lt;DEFAULT_BRANCH_WEIGHT&gt;
  [ , i32 &lt;CASE_BRANCH_WEIGHT&gt; ... ]
}
  </pre>
  </div>

  <h4>IndirectBrInst</h4>
  <div>
  <p>Branch weights are assign to every destination.</p>
  </div>
  <div class="doc_code">
  <pre>
!0 = metadata !{
  metadata !"branch_weights",
  i32 &lt;LABEL_BRANCH_WEIGHT&gt;
  [ , i32 &lt;LABEL_BRANCH_WEIGHT&gt; ... ]
}
  </pre>
  </div>

  <h4>Other</h4>
  <div>
  <p>Other terminator instructions are not allowed to contain Branch Weight
  Metadata.</p>
  </div>
</div>

<h2>
  <a name="builtin_expect">Built-in "expect" Instructions</a>
</h2>
<div>
  <p><tt>__builtin_expect(long exp, long c)</tt> instruction provides branch
  prediction information. The return value is the value of <tt>exp</tt>.</p>

  <p>It is especially useful in conditional statements. Currently Clang supports
  two conditional statements:
  </p>
  <h4><tt>if</tt> statement</h4>
  <div>
  <p>The <tt>exp</tt> parameter is the condition. The <tt>c</tt> parameter is
  the expected comparison value. If it is equal to 1 (true), the condition is
  likely to be true, in other case condition is likely to be false. For example:
  </p>
  </div>
  <div class="doc_code">
  <pre>
  if (__builtin_expect(x &gt; 0, 1)) {
    // This block is likely to be taken.
  }
  </pre>
  </div>

  <h4><tt>switch</tt> statement</h4>
  <div>
  <p>The <tt>exp</tt> parameter is the value. The <tt>c</tt> parameter is the
  expected value. If the expected value doesn't show on the cases list, the
  <tt>default</tt> case is assumed to be likely taken.</p>
  </div>
  <div class="doc_code">
  <pre>
  switch (__builtin_expect(x, 5)) {
  default: break;
  case 0:  // ...
  case 3:  // ...
  case 5:  // This case is likely to be taken.
  }
  </pre>
  </div>
</div>

<h2>
  <a name="cfg_modifications">CFG Modifications</a>
</h2>
<div>
<p>Branch Weight Metatada is not proof against CFG changes. If terminator
operands' are changed some action should be taken. In other case some
misoptimizations may occur due to incorrent branch prediction information.</p>
</div>

<hr>
<address>
  <a href="http://jigsaw.w3.org/css-validator/check/referer"><img
  src="http://jigsaw.w3.org/css-validator/images/vcss-blue" alt="Valid CSS"></a>
  <a href="http://validator.w3.org/check/referer"><img
  src="http://www.w3.org/Icons/valid-html401-blue" alt="Valid HTML 4.01"></a>

  <a href="mailto:jstaszak@apple.com">Jakub Staszak</a><br>
  <a href="http://llvm.org/">LLVM Compiler Infrastructure</a><br>
</address>

</body>
</html>