Back to index

Welcome to the OthelloScope!

Previous neuron - Next

Investigate neurons in the MLP layers of the Othello-GPT model by visualizing the examples where neurons Based on the original idea of the Neuroscope by Neel Nanda. See the original model here.

Layer 1, neuron 1501

Heatmap: My pieces

A0A1A2A3A4A5A6A7
B0B1B2B3B4B5B6B7
C0C1C2C3C4C5C6C7
D0D1D2D3D4D5D6D7
E0E1E2E3E4E5E6E7
F0F1F2F3F4F5F6F7
G0G1G2G3G4G5G6G7
H0H1H2H3H4H5H6H7

Heatmap: Blank

A0A1A2A3A4A5A6A7
B0B1B2B3B4B5B6B7
C0C1C2C3C4C5C6C7
D0D1D2D3D4D5D6D7
E0E1E2E3E4E5E6E7
F0F1F2F3F4F5F6F7
G0G1G2G3G4G5G6G7
H0H1H2H3H4H5H6H7

Logit attribution

A0A1A2A3A4A5A6A7
B0B1B2B3B4B5B6B7
C0C1C2C3C4C5C6C7
D0D1D2D3D4D5D6D7
E0E1E2E3E4E5E6E7
F0F1F2F3F4F5F6F7
G0G1G2G3G4G5G6G7
H0H1H2H3H4H5H6H7

This neuron has rank 342 variance within its own layer.

Activation in games

Y = games, X = moves

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859
1C3C4D5C6B4A4E5C2B7F6B5D7C5F3G2G3E2H1G7F5F4G4G5F2D6H5F1E7C1B3H4H3H2C7F7B1H6D1B2F0D0D2E0A1C0E1B0E6G0H7A2G1A5A3H0A0B6A6G6
2F4F3D2F5G2F2G3C4E5F6D6E2B4C5G7C1G6F7G5C3B3H6G4B2C2B5A6B6C6H4A4C7B0C0D5E1B1E6B7H2H3H7D7A5A3H5D1A7H1A1F0E7D0E0A2G0F1G1H0
3E5F3D2D5F5G5G2C1E6H1H5C3C2C5C6E7D1B7C0G6B3D0H7B4D6C7F7F6C4B1A4B2E0H6E1A2G3F1F2E2H3B5G7F0A3H2A1B0H0H4A5F4G1A0B6G0G4D7A7
4D2E2F2C2F4F5F6C4B5G6H7G1F3G4B1E6H5B2C5D5F1H4B3E1E5B6E0A5D6G7F0D1G0A2H1C0F7C3B0H0A6A1H2H6A7E7D7C7C1D0A4G3C6B4A3B7G2H3A0
5C3C4C5E2F2C2D2E1F5B6C6B5C1B0B4E5F6B2F4B3E0G2A2D6F1G3F3D0A6G1A1D5D1F7H0A4E6C0G6H7A5F0G0B1H3E7A3G4A0H4H5D7G5A7H2G7C7B7H6
6C3E2F2C4E5C2B3G2F1D2D1E6H3F0D5C1G1F4B1H2E1A1C0D6G0H0D0B0A0A2A3H4F3E0F5F6G7F7D7C7C5C6G5G3E7H5B7G6B4A5H7G4A4B5B2B6A6A7H6
7E5F5F4D5F6G3G5E2C4B5D6G6B4A4C3H6F2C7H5E6G7H4C6C5F3E7A5C2D2C1F7B3B7F1A2A7D7H7D1B6G0C0G4F0G1B1H3E1B2H1H0A3D0H2A0A6A1G2E0
8F4F3G2D5C4G3F2F5E5B3C5E6D2F1B4C1C6A4G1B7C7E1H3B6G5H6B5G4A2G0F0D6H0H1F6F7G6D7A7C2B2H4D1B1A0H2A6E7B0D0E2A1G7C3H5A3A5H7C0
9D2C2F4F3B1D5D6C6F5D1C1G6C3F2F6G4H6A0A1F7E6H7G5D7H4C0C4G3B6H5B0H3D0E5B2A6G1B4A5A4G7F1E7H0H2E0C7A3B5C5A2H1F0E2E1G0G2B7B3
10C3E2F2C2E1F1F4E0F0E5D0D5C4D2B2G3F3G2F6B4A5A4F5D1C1C0H1G5G6H2A3G0E6E7G7F7B3H5G4H3H4H0D6C6D7G1C5H7B5B6B1A2A1A6B7H6A7A0B0
11D2C4D5C6D6E2B6D7E6C1B3F5F1E1F7G0F3B5G6F4B7G3G2H7F6A6G4A2C2G5E5H2E7H1G7B1D1H3A0D0C7A1C3A7B4H5H4C5G1H6F0A3A4F2C0A5H0B0B2
12F4D5C6F3F2G3H2H3C2C3C4F5H4B1E2G1G4G5E1E0A0B5E6F1G6C1B3H6A4H5G0H1D0A1G2D2D1C0B0F7E5B4H7F6D6C5A2D7E7A3C7A6H0A5B2B6B7A7G7
13E5F5G5G6C3G4H5E2H3C4H7E6D5C2B2D6C7A1C5F6F7D7B3A3D2E7F2B4F4D1B6C6D0H6C1B1A2B0G7G1B5A6G3B7A0F1F3G2F0E1A4H4A5H2G0H0A7E0C0
14E5F3E2F1D2C2B1F4G4E6F2C4D1D0B4B3C3D5B2E1C0A1G0G1H1A3G2F0F5C5E0H3A2C1F7G3B6B5H4E7G6H0A6H5A5A4H2G7D7B0C6H7A0C7B7G5D6A7F6
15F4F5F6C4C5D5C3B4A5G6H7C6B7E6B6D2E5H6B3D6D7A2G7A3H5A6C1G4C7B0G3B5E1C2B1D1H4E7F3A0C0A7A4G2F2D0A1G5H1E2H3G1F1B2F7E0F0H2G0
16F4F3G2E5F2D5C6F5E6F6F7E2C3H1H2H3D2B7C4G6G4C2F1E0C1B2A3C0D1E7G1F0H7G3H0H4D0B0B3D6G5A4B1E1A2H6A5A1H5C5B4G7B6A7G0B5C7D7A0
17F4D5C2F2F3G4C5C4G5C6B4G2G3F5E2A4H1D2C3C1G1H2E6H0E1D0E5F7B2H3B7A3G6C7D7E7D1H6A5B3B0F6B6E0F0B5G7B1A1D6C0A2G0H5F1A7H4A0A6
18F4D5C6F5C3F2G6D2C1H7F3G3C4G5E2B0D1E5H5F6G4B2E7F7D6E6G2C2G7H3H4E1A1B6C7C5E0H6B5F1B1A5B4D7G0A0B7B3H1A3D0A2C0A7A4G1A6F0H2
19C3C2D2C4F5F3F4E2B4F6C1B5B6D1D0E5G3A4A5G4H4D5A3H2D6G5G7B3G6B0G2B2A1A2F2C7E6E7D7F7C5H5H3C0H6H7F1G1H0E1B7A0E0A6H1A7C6B1G0
20F4F3C2F5G3C4B5B4G6E2F1B6D5F6G5G0F7D6C3E5D2E1A4G7B7G4B2A6H5E7F0G2H2H4F2C6H0D1C7A2H3E0C1B0C5D7H7B3A5A3C0A7B1G1H1D0A1A0E6
21D2E2F4E5F3C3F2G4G5G2E6D1C5E7H4F5C2C4C0H5G6F1B4B2F0G1H6E1H0G0B1B0H3D0D6H7F6D5C1A3A1F7B5H2G3B6A7B3C6A6A0E0G7A2D7C7B7A4A5
22E5F5D2D5D6C4B3E2F4B5F2C5C6F1C2G3G4G5B4D7A5E6C7C1G6A4B6G2F3D1C0E0H5A6G0A3H2H3F6H6A2B2H7G1B0E1H1D0F7A0E7H4B7H0C3G7B1A7F0
23C3C4E5C2B1F4B2A0B4E6C1A4F5E2D5B3D2E1D7D1D0E0F3E7B5G5A2G3A5C5G4F6F1C7B0F7A3H4C0F2B6G2G6H5H3A6G7H6C6H2G1F0H0H7A7H1G0A1B7
24E5D5C4B5C2F3F5D2C1G5D6C3H5D1B3C5B4B6C6B0A7F4E1H6G4A4C0B1A0E2G6B2G2A1A3E0D0G3F1C7A2G0E7H1F2F6A5H4E6F7G7D7H3A6B7H2H7H0F0
25F4D5C6F5D2F3G5C3F2D1C1C4F6G2C5E2F1C7B2G1H3E6E1G3D6G4H0G6B6C0D0F0H5H4H1A5E0G0B4A3H2C2D7A2B5A6H7E7A7F7B0H6B3B7A1E5G7A0A4
26C3C2D2C4D5E5F3E1B4A5E6D6C5C6D7G2B3E2H1A3B6F7B1C7D1C1F6E7A4F2A6A1F5G3C0B7G1G0E0B2H3F0F4B5H0G4G6H5D0F1H2G7A0B0A7H4H7H6G5
27D2C2C3C4F5D1C1C0B3F2B4A4B0B1E2F3A2A0E0D0B2F0G3D5C5B5F1H3E6G2E1F4H4H5A5A6E5F6G1C6A1H2D6F7G6A3C7B6B7H6G5G0A7G4H0H1E7D7H7
28D2E2F3G2F2C3G4D5C5E5B3G1C6B5C4E1H1G3A5C2C1B4F4B6E0D0A6G5H6A7D6A3B7F6A4B2B1A2E7B0A0F0F1C7F5A1D1G0H0G6H3H2H7G7C0E6F7H4H5
29F4D5C3D2C5F3E1B5D6G5G3C4A5C2H6D1E5F2B4C1D0E6F6E2F5D7B2G7C7A4G6E0G1H7C0B6A3B7A6B3F0B1A2H2E7G2H4H0C6A1G0A0G4B0F1F7H5H3H1
30D2C4C5E2F2F1F0C2D1C0E1F3C1E0B4G3C3A5A3C6F5B1A0A1B5D5E5B2D0F6B3G5B7D6E7C7B0A6B6A4H3A2A7G1H1G4G2F4H5G0H0H6D7E6G7H2H7F7H4
31D2C4E5F2F3F6E6E2E1D0F0F4G1D1C5G3H3C3B3G4G7D5C1F7D6B6E7B2B4A5A3H4E0F1B1H2F5C7C0B0D7G0G5H5H6G6C2A1A2B5H1C6G2H7A6A7A4H0B7
32E5D5C3D2C6B2D1E1C1F3F2F5G2F6C4G3C2C5H3C0E6E2F1H1B3B5G5D6G7B6A2B4H2G4E0G0C7D0G6B7F4A1D7F0A6F7A7G1H4H6A4H5H0A5E7A3H7B0B1
33C3C4E5C2B1F3D2E6F6A0E2F5G3G6B2F1F4C1E1G5E7H2G4D5G0F0C6F7D6B3D1C7H4C5H3G1D7G7G2H6B6F2A1A2B7B5H1H5A3H0A5A7B4A6A4B0C0D0H7
34E5F5C3C4B5E2E1F6E6D7G5D2F7G7C5F3H7A6D5D6G2B6C7B3A5A4D1F0G6F4E7C6B4D0A3B2A1G4H3C2B7F2A7A2B1A0C1H1F1G1H0H6C0G3H2H4B0G0E0
35C3E2F2C4E1B3C5E5B5D5A3C2C1B4E6D6C7B6A4F1D2F3G4D1G0D7B7B0F0A2G1B1A1A6A5C0A7G2B2F6E7F4H3H4G7F7F5H0H5H7H2C6G3E0D0H1A0H6G6
36C3C4F5B2C5E2B4D5C2E5F4B5E1G6F6C1B6G7C0A6E6G5B3F2A5C6D6G4A1A3A7B1D2F7G1G2A2A0D7F0H7A4E0B7E7D0H5F3H3D1G0H0C7H6B0H4H2H1F1
37E5F3D2C5F4G4F5D5B6B5B4C2H3E6G3G5G6A5B2B3D6H7E7D1A3C3D0B7A4H5H6H4F6A1C4B1A7H2C1F2C6G2E2C7F1F7A0C0D7G7E1A2B0A6G1F0H1E0G0
38C3C2F4D5E5C4B4B5D6F6B1A4F5C1B3A1F7D2E2G5D1C5G3G4B6A3H6G6A5B2C0B0E1G7H7E7C6C7H5E6D7A7F2G1F3H3H2H1G2A6H0F0G0B7D0E0A0F1H4
39F4F5F6G4C3C4C5E2F1B4F3F2B5C2H5D2C1G3D5B0H3B1A4H4A0B3E1H6H7D6G1F7G2B6A5B2C0D0B7H1H0A6F0A7A2A1E0C7E7C6G7E5D7A3E6G0G6D1G5
40C3E2F4C5E5G5G3C4F3F2F1G0B6G4D2C6G6B2B3C1F5E1B1A6D5H5B0G1H6F7E0A3B5B4A7H7B7A1H3H4H1D6D7E7A2D0F6G2D1G7C0C7C2A0H0F0H2A4A5
41D2C2E5D5B2F2C4C1E2C5C3A2C0F5C6B6B5F4G1B4F3G3G5D7B7H0A7D1E0E6G4H4H3B1E1C7A0D0B3H6E7F0G2A5D6A3A4H2G6F6F1A6G0B0H7H1A1G7F7
42D2E2F3C2F4G3G2G5H3F5F2F1H6H5E1C4B5H1B2G1G6F7H2D1G0H0C0C1H7H4E0A3G4D5B1B3A4F6B4C3A2A1E6E5A0G7E7D7D0C6D6C5F0A5A6B6C7B0A7
43F4F3C2C3C4B1G2E5F2G3H4B2C1B3G4D0D6D5F5E2A1H3D1H1H2A0B0E1B4E6F7A2D2A3E0H5A4G5G6C6C0F1G1C5A5F6B6F0H6A7A6B7G0B5D7C7H0G7E7
44F4F5E5D5G6G4C3B2C5F3F2H7B3F1G5C4G3D6C6B4E1E6G1G2A4D2E2C7D1C2H3H0D7A3H5G0H1C1B1F0A1H4A5F7E7B0C0H6H2F6G7D0A2B5B6A6E0A0B7
45D2C4B5C2C5D1C1B1F4F5B2G5F2A6C0A2G4G3A5B0B4F3G2D0E2D5E6D6C3F6H3B6A0H2A7E5E0H4C6A3G6C7B7A1F1G1D7H7E1G0H5A4H6F0H0H1B3E7F7
46C3C4B5B4E5C2B3F5E2A4C1C6D5D2F4D1C5G5E0B1A1A0C7E6F2B2H6B6A2C0F6B7A5A3E7G7D6E1B0G1G2F7H7G4D0H2H4H5G6D7F3A6H0G0H1F1A7G3H3
47C3C4C5C2C1D5E6B6C6B7F4F5A7B3G4G6H7F3B4H4E5A4A3D7A2B5D2B0F6A5D1G7D6A1A6E0C0D0H3B2G2H2G3H1F2F7B1F1C7H6H5E2G1A0F0E7E1H0G0
48C3C4F5C2B5F4B1C5C6E2G4E5D6G6G5G3D2A0C1F3E1F6H7H6H2F1H5B4A3G2G1H1A1A2G7H3D5H4H0A6A4B0B3G0F2B2E0D1C0E6F0D0E7A5B6C7B7D7A7
49C3E2F1E1F3G0F5G4G3E5D5H3G2C5E0E6G5F6C4B2B3F2D7B4G7E7F7F0B6F4G1D0A2C6C2D2D1H2A4C0C7A7B5G6H4B7H7A5A6A3H0C1B1A1D6H6H1B0A0
50E5F3D2C1E2C3B2F2G1B4B3B1G2G4E1F0E0F6B0D5A3D0C6F4E6D1C2C4F5D6C5C7A0H2B7G5D7A4H6G6B6F1H4G3G7A2H5F7A1C0G0B5A5H1E7A7H3A6H0