Back to index

Welcome to the OthelloScope!

Previous neuron - Next

Investigate neurons in the MLP layers of the Othello-GPT model by visualizing the examples where neurons Based on the original idea of the Neuroscope by Neel Nanda. See the original model here.

Layer 4, neuron 1958

Heatmap: My pieces

A0A1A2A3A4A5A6A7
B0B1B2B3B4B5B6B7
C0C1C2C3C4C5C6C7
D0D1D2D3D4D5D6D7
E0E1E2E3E4E5E6E7
F0F1F2F3F4F5F6F7
G0G1G2G3G4G5G6G7
H0H1H2H3H4H5H6H7

Heatmap: Blank

A0A1A2A3A4A5A6A7
B0B1B2B3B4B5B6B7
C0C1C2C3C4C5C6C7
D0D1D2D3D4D5D6D7
E0E1E2E3E4E5E6E7
F0F1F2F3F4F5F6F7
G0G1G2G3G4G5G6G7
H0H1H2H3H4H5H6H7

Logit attribution

A0A1A2A3A4A5A6A7
B0B1B2B3B4B5B6B7
C0C1C2C3C4C5C6C7
D0D1D2D3D4D5D6D7
E0E1E2E3E4E5E6E7
F0F1F2F3F4F5F6F7
G0G1G2G3G4G5G6G7
H0H1H2H3H4H5H6H7

This neuron has rank 0 variance within its own layer.

Activation in games

Y = games, X = moves

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859
1C3C4D5C6B4A4E5C2B7F6B5D7C5F3G2G3E2H1G7F5F4G4G5F2D6H5F1E7C1B3H4H3H2C7F7B1H6D1B2F0D0D2E0A1C0E1B0E6G0H7A2G1A5A3H0A0B6A6G6
2F4F3D2F5G2F2G3C4E5F6D6E2B4C5G7C1G6F7G5C3B3H6G4B2C2B5A6B6C6H4A4C7B0C0D5E1B1E6B7H2H3H7D7A5A3H5D1A7H1A1F0E7D0E0A2G0F1G1H0
3E5F3D2D5F5G5G2C1E6H1H5C3C2C5C6E7D1B7C0G6B3D0H7B4D6C7F7F6C4B1A4B2E0H6E1A2G3F1F2E2H3B5G7F0A3H2A1B0H0H4A5F4G1A0B6G0G4D7A7
4D2E2F2C2F4F5F6C4B5G6H7G1F3G4B1E6H5B2C5D5F1H4B3E1E5B6E0A5D6G7F0D1G0A2H1C0F7C3B0H0A6A1H2H6A7E7D7C7C1D0A4G3C6B4A3B7G2H3A0
5C3C4C5E2F2C2D2E1F5B6C6B5C1B0B4E5F6B2F4B3E0G2A2D6F1G3F3D0A6G1A1D5D1F7H0A4E6C0G6H7A5F0G0B1H3E7A3G4A0H4H5D7G5A7H2G7C7B7H6
6C3E2F2C4E5C2B3G2F1D2D1E6H3F0D5C1G1F4B1H2E1A1C0D6G0H0D0B0A0A2A3H4F3E0F5F6G7F7D7C7C5C6G5G3E7H5B7G6B4A5H7G4A4B5B2B6A6A7H6
7E5F5F4D5F6G3G5E2C4B5D6G6B4A4C3H6F2C7H5E6G7H4C6C5F3E7A5C2D2C1F7B3B7F1A2A7D7H7D1B6G0C0G4F0G1B1H3E1B2H1H0A3D0H2A0A6A1G2E0
8F4F3G2D5C4G3F2F5E5B3C5E6D2F1B4C1C6A4G1B7C7E1H3B6G5H6B5G4A2G0F0D6H0H1F6F7G6D7A7C2B2H4D1B1A0H2A6E7B0D0E2A1G7C3H5A3A5H7C0
9D2C2F4F3B1D5D6C6F5D1C1G6C3F2F6G4H6A0A1F7E6H7G5D7H4C0C4G3B6H5B0H3D0E5B2A6G1B4A5A4G7F1E7H0H2E0C7A3B5C5A2H1F0E2E1G0G2B7B3
10C3E2F2C2E1F1F4E0F0E5D0D5C4D2B2G3F3G2F6B4A5A4F5D1C1C0H1G5G6H2A3G0E6E7G7F7B3H5G4H3H4H0D6C6D7G1C5H7B5B6B1A2A1A6B7H6A7A0B0
11D2C4D5C6D6E2B6D7E6C1B3F5F1E1F7G0F3B5G6F4B7G3G2H7F6A6G4A2C2G5E5H2E7H1G7B1D1H3A0D0C7A1C3A7B4H5H4C5G1H6F0A3A4F2C0A5H0B0B2
12F4D5C6F3F2G3H2H3C2C3C4F5H4B1E2G1G4G5E1E0A0B5E6F1G6C1B3H6A4H5G0H1D0A1G2D2D1C0B0F7E5B4H7F6D6C5A2D7E7A3C7A6H0A5B2B6B7A7G7
13E5F5G5G6C3G4H5E2H3C4H7E6D5C2B2D6C7A1C5F6F7D7B3A3D2E7F2B4F4D1B6C6D0H6C1B1A2B0G7G1B5A6G3B7A0F1F3G2F0E1A4H4A5H2G0H0A7E0C0
14E5F3E2F1D2C2B1F4G4E6F2C4D1D0B4B3C3D5B2E1C0A1G0G1H1A3G2F0F5C5E0H3A2C1F7G3B6B5H4E7G6H0A6H5A5A4H2G7D7B0C6H7A0C7B7G5D6A7F6
15F4F5F6C4C5D5C3B4A5G6H7C6B7E6B6D2E5H6B3D6D7A2G7A3H5A6C1G4C7B0G3B5E1C2B1D1H4E7F3A0C0A7A4G2F2D0A1G5H1E2H3G1F1B2F7E0F0H2G0
16F4F3G2E5F2D5C6F5E6F6F7E2C3H1H2H3D2B7C4G6G4C2F1E0C1B2A3C0D1E7G1F0H7G3H0H4D0B0B3D6G5A4B1E1A2H6A5A1H5C5B4G7B6A7G0B5C7D7A0
17F4D5C2F2F3G4C5C4G5C6B4G2G3F5E2A4H1D2C3C1G1H2E6H0E1D0E5F7B2H3B7A3G6C7D7E7D1H6A5B3B0F6B6E0F0B5G7B1A1D6C0A2G0H5F1A7H4A0A6
18F4D5C6F5C3F2G6D2C1H7F3G3C4G5E2B0D1E5H5F6G4B2E7F7D6E6G2C2G7H3H4E1A1B6C7C5E0H6B5F1B1A5B4D7G0A0B7B3H1A3D0A2C0A7A4G1A6F0H2
19C3C2D2C4F5F3F4E2B4F6C1B5B6D1D0E5G3A4A5G4H4D5A3H2D6G5G7B3G6B0G2B2A1A2F2C7E6E7D7F7C5H5H3C0H6H7F1G1H0E1B7A0E0A6H1A7C6B1G0
20F4F3C2F5G3C4B5B4G6E2F1B6D5F6G5G0F7D6C3E5D2E1A4G7B7G4B2A6H5E7F0G2H2H4F2C6H0D1C7A2H3E0C1B0C5D7H7B3A5A3C0A7B1G1H1D0A1A0E6
21D2E2F4E5F3C3F2G4G5G2E6D1C5E7H4F5C2C4C0H5G6F1B4B2F0G1H6E1H0G0B1B0H3D0D6H7F6D5C1A3A1F7B5H2G3B6A7B3C6A6A0E0G7A2D7C7B7A4A5
22E5F5D2D5D6C4B3E2F4B5F2C5C6F1C2G3G4G5B4D7A5E6C7C1G6A4B6G2F3D1C0E0H5A6G0A3H2H3F6H6A2B2H7G1B0E1H1D0F7A0E7H4B7H0C3G7B1A7F0
23C3C4E5C2B1F4B2A0B4E6C1A4F5E2D5B3D2E1D7D1D0E0F3E7B5G5A2G3A5C5G4F6F1C7B0F7A3H4C0F2B6G2G6H5H3A6G7H6C6H2G1F0H0H7A7H1G0A1B7
24E5D5C4B5C2F3F5D2C1G5D6C3H5D1B3C5B4B6C6B0A7F4E1H6G4A4C0B1A0E2G6B2G2A1A3E0D0G3F1C7A2G0E7H1F2F6A5H4E6F7G7D7H3A6B7H2H7H0F0
25F4D5C6F5D2F3G5C3F2D1C1C4F6G2C5E2F1C7B2G1H3E6E1G3D6G4H0G6B6C0D0F0H5H4H1A5E0G0B4A3H2C2D7A2B5A6H7E7A7F7B0H6B3B7A1E5G7A0A4
26C3C2D2C4D5E5F3E1B4A5E6D6C5C6D7G2B3E2H1A3B6F7B1C7D1C1F6E7A4F2A6A1F5G3C0B7G1G0E0B2H3F0F4B5H0G4G6H5D0F1H2G7A0B0A7H4H7H6G5
27D2C2C3C4F5D1C1C0B3F2B4A4B0B1E2F3A2A0E0D0B2F0G3D5C5B5F1H3E6G2E1F4H4H5A5A6E5F6G1C6A1H2D6F7G6A3C7B6B7H6G5G0A7G4H0H1E7D7H7
28D2E2F3G2F2C3G4D5C5E5B3G1C6B5C4E1H1G3A5C2C1B4F4B6E0D0A6G5H6A7D6A3B7F6A4B2B1A2E7B0A0F0F1C7F5A1D1G0H0G6H3H2H7G7C0E6F7H4H5
29F4D5C3D2C5F3E1B5D6G5G3C4A5C2H6D1E5F2B4C1D0E6F6E2F5D7B2G7C7A4G6E0G1H7C0B6A3B7A6B3F0B1A2H2E7G2H4H0C6A1G0A0G4B0F1F7H5H3H1
30D2C4C5E2F2F1F0C2D1C0E1F3C1E0B4G3C3A5A3C6F5B1A0A1B5D5E5B2D0F6B3G5B7D6E7C7B0A6B6A4H3A2A7G1H1G4G2F4H5G0H0H6D7E6G7H2H7F7H4
31D2C4E5F2F3F6E6E2E1D0F0F4G1D1C5G3H3C3B3G4G7D5C1F7D6B6E7B2B4A5A3H4E0F1B1H2F5C7C0B0D7G0G5H5H6G6C2A1A2B5H1C6G2H7A6A7A4H0B7
32E5D5C3D2C6B2D1E1C1F3F2F5G2F6C4G3C2C5H3C0E6E2F1H1B3B5G5D6G7B6A2B4H2G4E0G0C7D0G6B7F4A1D7F0A6F7A7G1H4H6A4H5H0A5E7A3H7B0B1
33C3C4E5C2B1F3D2E6F6A0E2F5G3G6B2F1F4C1E1G5E7H2G4D5G0F0C6F7D6B3D1C7H4C5H3G1D7G7G2H6B6F2A1A2B7B5H1H5A3H0A5A7B4A6A4B0C0D0H7
34E5F5C3C4B5E2E1F6E6D7G5D2F7G7C5F3H7A6D5D6G2B6C7B3A5A4D1F0G6F4E7C6B4D0A3B2A1G4H3C2B7F2A7A2B1A0C1H1F1G1H0H6C0G3H2H4B0G0E0
35C3E2F2C4E1B3C5E5B5D5A3C2C1B4E6D6C7B6A4F1D2F3G4D1G0D7B7B0F0A2G1B1A1A6A5C0A7G2B2F6E7F4H3H4G7F7F5H0H5H7H2C6G3E0D0H1A0H6G6
36C3C4F5B2C5E2B4D5C2E5F4B5E1G6F6C1B6G7C0A6E6G5B3F2A5C6D6G4A1A3A7B1D2F7G1G2A2A0D7F0H7A4E0B7E7D0H5F3H3D1G0H0C7H6B0H4H2H1F1
37E5F3D2C5F4G4F5D5B6B5B4C2H3E6G3G5G6A5B2B3D6H7E7D1A3C3D0B7A4H5H6H4F6A1C4B1A7H2C1F2C6G2E2C7F1F7A0C0D7G7E1A2B0A6G1F0H1E0G0
38C3C2F4D5E5C4B4B5D6F6B1A4F5C1B3A1F7D2E2G5D1C5G3G4B6A3H6G6A5B2C0B0E1G7H7E7C6C7H5E6D7A7F2G1F3H3H2H1G2A6H0F0G0B7D0E0A0F1H4
39F4F5F6G4C3C4C5E2F1B4F3F2B5C2H5D2C1G3D5B0H3B1A4H4A0B3E1H6H7D6G1F7G2B6A5B2C0D0B7H1H0A6F0A7A2A1E0C7E7C6G7E5D7A3E6G0G6D1G5
40C3E2F4C5E5G5G3C4F3F2F1G0B6G4D2C6G6B2B3C1F5E1B1A6D5H5B0G1H6F7E0A3B5B4A7H7B7A1H3H4H1D6D7E7A2D0F6G2D1G7C0C7C2A0H0F0H2A4A5
41D2C2E5D5B2F2C4C1E2C5C3A2C0F5C6B6B5F4G1B4F3G3G5D7B7H0A7D1E0E6G4H4H3B1E1C7A0D0B3H6E7F0G2A5D6A3A4H2G6F6F1A6G0B0H7H1A1G7F7
42D2E2F3C2F4G3G2G5H3F5F2F1H6H5E1C4B5H1B2G1G6F7H2D1G0H0C0C1H7H4E0A3G4D5B1B3A4F6B4C3A2A1E6E5A0G7E7D7D0C6D6C5F0A5A6B6C7B0A7
43F4F3C2C3C4B1G2E5F2G3H4B2C1B3G4D0D6D5F5E2A1H3D1H1H2A0B0E1B4E6F7A2D2A3E0H5A4G5G6C6C0F1G1C5A5F6B6F0H6A7A6B7G0B5D7C7H0G7E7
44F4F5E5D5G6G4C3B2C5F3F2H7B3F1G5C4G3D6C6B4E1E6G1G2A4D2E2C7D1C2H3H0D7A3H5G0H1C1B1F0A1H4A5F7E7B0C0H6H2F6G7D0A2B5B6A6E0A0B7
45D2C4B5C2C5D1C1B1F4F5B2G5F2A6C0A2G4G3A5B0B4F3G2D0E2D5E6D6C3F6H3B6A0H2A7E5E0H4C6A3G6C7B7A1F1G1D7H7E1G0H5A4H6F0H0H1B3E7F7
46C3C4B5B4E5C2B3F5E2A4C1C6D5D2F4D1C5G5E0B1A1A0C7E6F2B2H6B6A2C0F6B7A5A3E7G7D6E1B0G1G2F7H7G4D0H2H4H5G6D7F3A6H0G0H1F1A7G3H3
47C3C4C5C2C1D5E6B6C6B7F4F5A7B3G4G6H7F3B4H4E5A4A3D7A2B5D2B0F6A5D1G7D6A1A6E0C0D0H3B2G2H2G3H1F2F7B1F1C7H6H5E2G1A0F0E7E1H0G0
48C3C4F5C2B5F4B1C5C6E2G4E5D6G6G5G3D2A0C1F3E1F6H7H6H2F1H5B4A3G2G1H1A1A2G7H3D5H4H0A6A4B0B3G0F2B2E0D1C0E6F0D0E7A5B6C7B7D7A7
49C3E2F1E1F3G0F5G4G3E5D5H3G2C5E0E6G5F6C4B2B3F2D7B4G7E7F7F0B6F4G1D0A2C6C2D2D1H2A4C0C7A7B5G6H4B7H7A5A6A3H0C1B1A1D6H6H1B0A0
50E5F3D2C1E2C3B2F2G1B4B3B1G2G4E1F0E0F6B0D5A3D0C6F4E6D1C2C4F5D6C5C7A0H2B7G5D7A4H6G6B6F1H4G3G7A2H5F7A1C0G0B5A5H1E7A7H3A6H0