Repeated layers

How to describe 32 identical blocks without drawing 32 of them.

Real models repeat. A transformer is one decoder block, thirty-two times. You describe that once.

The layer stack#

1. 1Place a layer_stack block on the trunk of the design.
2. 2Set its num_layers to how many times the body repeats.
3. 3Build the body of one layer — the norms, attention, feed-forward — off to the side.
4. 4Connect the positional or embedding block into the stack.
5. 5Connect the end of each branch of the body back to the stack.

Groups#

Select two or more blocks and press Ctrl+G to group them. A group can be collapsed to tidy the canvas and carries its own repeat count. Groups are for organising your view; the layer stack is what the analysis counts.

Page 15 of 33. This guide is in English for now. It is the same guide that is built into the NEURAX desktop app (the ? button, or F1). Found a mistake? Tell us.