Pretrained SAEs

This is a list of SAEs importable from the SAELens package. Click on each link for more details.

This file contains the contents of sae_lens/pretrained_saes.yaml in Markdown

gpt2-small-res-jb

Huggingface Repo: jbloom/GPT2-Small-SAEs-Reformatted
model: gpt2-small
Additional Links:

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_resid_pre Load this SAE	standard	gpt2-small/0-res-jb	blocks.0.hook_resid_pre	0	24576	128	Skylion007/openwebtext	none
blocks.1.hook_resid_pre Load this SAE	standard	gpt2-small/1-res-jb	blocks.1.hook_resid_pre	1	24576	128	Skylion007/openwebtext	none
blocks.2.hook_resid_pre Load this SAE	standard	gpt2-small/2-res-jb	blocks.2.hook_resid_pre	2	24576	128	Skylion007/openwebtext	none
blocks.3.hook_resid_pre Load this SAE	standard	gpt2-small/3-res-jb	blocks.3.hook_resid_pre	3	24576	128	Skylion007/openwebtext	none
blocks.4.hook_resid_pre Load this SAE	standard	gpt2-small/4-res-jb	blocks.4.hook_resid_pre	4	24576	128	Skylion007/openwebtext	none
blocks.5.hook_resid_pre Load this SAE	standard	gpt2-small/5-res-jb	blocks.5.hook_resid_pre	5	24576	128	Skylion007/openwebtext	none
blocks.6.hook_resid_pre Load this SAE	standard	gpt2-small/6-res-jb	blocks.6.hook_resid_pre	6	24576	128	Skylion007/openwebtext	none
blocks.7.hook_resid_pre Load this SAE	standard	gpt2-small/7-res-jb	blocks.7.hook_resid_pre	7	24576	128	Skylion007/openwebtext	none
blocks.8.hook_resid_pre Load this SAE	standard	gpt2-small/8-res-jb	blocks.8.hook_resid_pre	8	24576	128	Skylion007/openwebtext	none
blocks.9.hook_resid_pre Load this SAE	standard	gpt2-small/9-res-jb	blocks.9.hook_resid_pre	9	24576	128	Skylion007/openwebtext	none
blocks.10.hook_resid_pre Load this SAE	standard	gpt2-small/10-res-jb	blocks.10.hook_resid_pre	10	24576	128	Skylion007/openwebtext	none
blocks.11.hook_resid_pre Load this SAE	standard	gpt2-small/11-res-jb	blocks.11.hook_resid_pre	11	24576	128	Skylion007/openwebtext	none
blocks.11.hook_resid_post Load this SAE	standard	gpt2-small/12-res-jb	blocks.11.hook_resid_post	11	24576	128	Skylion007/openwebtext	none

gpt2-small-hook-z-kk

Huggingface Repo: ckkissane/attn-saes-gpt2-small-all-layers
model: gpt2-small
Additional Links:

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_z Load this SAE	standard	gpt2-small/0-att-kk	blocks.0.attn.hook_z	0	24576	128	Skylion007/openwebtext	none
blocks.1.hook_z Load this SAE	standard	gpt2-small/1-att-kk	blocks.1.attn.hook_z	1	24576	128	Skylion007/openwebtext	none
blocks.2.hook_z Load this SAE	standard	gpt2-small/2-att-kk	blocks.2.attn.hook_z	2	24576	128	Skylion007/openwebtext	none
blocks.3.hook_z Load this SAE	standard	gpt2-small/3-att-kk	blocks.3.attn.hook_z	3	24576	128	Skylion007/openwebtext	none
blocks.4.hook_z Load this SAE	standard	gpt2-small/4-att-kk	blocks.4.attn.hook_z	4	24576	128	Skylion007/openwebtext	none
blocks.5.hook_z Load this SAE	standard	gpt2-small/5-att-kk	blocks.5.attn.hook_z	5	49152	128	Skylion007/openwebtext	none
blocks.6.hook_z Load this SAE	standard	gpt2-small/6-att-kk	blocks.6.attn.hook_z	6	24576	128	Skylion007/openwebtext	none
blocks.7.hook_z Load this SAE	standard	gpt2-small/7-att-kk	blocks.7.attn.hook_z	7	49152	128	Skylion007/openwebtext	none
blocks.8.hook_z Load this SAE	standard	gpt2-small/8-att-kk	blocks.8.attn.hook_z	8	24576	128	Skylion007/openwebtext	none
blocks.9.hook_z Load this SAE	standard	gpt2-small/9-att-kk	blocks.9.attn.hook_z	9	24576	128	Skylion007/openwebtext	none
blocks.10.hook_z Load this SAE	standard	gpt2-small/10-att-kk	blocks.10.attn.hook_z	10	24576	128	Skylion007/openwebtext	none
blocks.11.hook_z Load this SAE	standard	gpt2-small/11-att-kk	blocks.11.attn.hook_z	11	24576	128	Skylion007/openwebtext	none

gpt2-small-mlp-tm

Huggingface Repo: tommmcgrath/gpt2-small-mlp-out-saes
model: gpt2-small
Additional Links:
- Model

id	architecture	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_mlp_out Load this SAE	standard	blocks.0.hook_mlp_out	0	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.1.hook_mlp_out Load this SAE	standard	blocks.1.hook_mlp_out	1	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.2.hook_mlp_out Load this SAE	standard	blocks.2.hook_mlp_out	2	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.3.hook_mlp_out Load this SAE	standard	blocks.3.hook_mlp_out	3	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.4.hook_mlp_out Load this SAE	standard	blocks.4.hook_mlp_out	4	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.5.hook_mlp_out Load this SAE	standard	blocks.5.hook_mlp_out	5	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.6.hook_mlp_out Load this SAE	standard	blocks.6.hook_mlp_out	6	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.7.hook_mlp_out Load this SAE	standard	blocks.7.hook_mlp_out	7	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.8.hook_mlp_out Load this SAE	standard	blocks.8.hook_mlp_out	8	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.9.hook_mlp_out Load this SAE	standard	blocks.9.hook_mlp_out	9	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.10.hook_mlp_out Load this SAE	standard	blocks.10.hook_mlp_out	10	24576	512	Skylion007/openwebtext	expected_average_only_in
blocks.11.hook_mlp_out Load this SAE	standard	blocks.11.hook_mlp_out	11	24576	512	Skylion007/openwebtext	expected_average_only_in

gpt2-small-res-jb-feature-splitting

Huggingface Repo: jbloom/GPT2-Small-Feature-Splitting-Experiment-Layer-8
model: gpt2-small
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.8.hook_resid_pre_768 Load this SAE	standard	gpt2-small/8-res_fs768-jb	blocks.8.hook_resid_pre	8	768	128	Skylion007/openwebtext	none
blocks.8.hook_resid_pre_1536 Load this SAE	standard	gpt2-small/8-res_fs1536-jb	blocks.8.hook_resid_pre	8	1536	128	Skylion007/openwebtext	none
blocks.8.hook_resid_pre_3072 Load this SAE	standard	gpt2-small/8-res_fs3072-jb	blocks.8.hook_resid_pre	8	3072	128	Skylion007/openwebtext	none
blocks.8.hook_resid_pre_6144 Load this SAE	standard	gpt2-small/8-res_fs6144-jb	blocks.8.hook_resid_pre	8	6144	128	Skylion007/openwebtext	none
blocks.8.hook_resid_pre_12288 Load this SAE	standard	gpt2-small/8-res_fs12288-jb	blocks.8.hook_resid_pre	8	12288	128	Skylion007/openwebtext	none
blocks.8.hook_resid_pre_24576 Load this SAE	standard	gpt2-small/8-res_fs24576-jb	blocks.8.hook_resid_pre	8	24576	128	Skylion007/openwebtext	none
blocks.8.hook_resid_pre_49152 Load this SAE	standard	gpt2-small/8-res_fs49152-jb	blocks.8.hook_resid_pre	8	49152	128	Skylion007/openwebtext	none
blocks.8.hook_resid_pre_98304 Load this SAE	standard	gpt2-small/8-res_fs98304-jb	blocks.8.hook_resid_pre	8	98304	128	Skylion007/openwebtext	none

gpt2-small-resid-post-v5-32k

Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-resid-post-SAEs
model: gpt2-small

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_resid_post Load this SAE	standard	gpt2-small/0-res_post_32k-oai	blocks.0.hook_resid_post	0	32768	64	Skylion007/openwebtext	layer_norm
blocks.1.hook_resid_post Load this SAE	standard	gpt2-small/1-res_post_32k-oai	blocks.1.hook_resid_post	1	32768	64	Skylion007/openwebtext	layer_norm
blocks.2.hook_resid_post Load this SAE	standard	gpt2-small/2-res_post_32k-oai	blocks.2.hook_resid_post	2	32768	64	Skylion007/openwebtext	layer_norm
blocks.3.hook_resid_post Load this SAE	standard	gpt2-small/3-res_post_32k-oai	blocks.3.hook_resid_post	3	32768	64	Skylion007/openwebtext	layer_norm
blocks.4.hook_resid_post Load this SAE	standard	gpt2-small/4-res_post_32k-oai	blocks.4.hook_resid_post	4	32768	64	Skylion007/openwebtext	layer_norm
blocks.5.hook_resid_post Load this SAE	standard	gpt2-small/5-res_post_32k-oai	blocks.5.hook_resid_post	5	32768	64	Skylion007/openwebtext	layer_norm
blocks.6.hook_resid_post Load this SAE	standard	gpt2-small/6-res_post_32k-oai	blocks.6.hook_resid_post	6	32768	64	Skylion007/openwebtext	layer_norm
blocks.7.hook_resid_post Load this SAE	standard	gpt2-small/7-res_post_32k-oai	blocks.7.hook_resid_post	7	32768	64	Skylion007/openwebtext	layer_norm
blocks.8.hook_resid_post Load this SAE	standard	gpt2-small/8-res_post_32k-oai	blocks.8.hook_resid_post	8	32768	64	Skylion007/openwebtext	layer_norm
blocks.9.hook_resid_post Load this SAE	standard	gpt2-small/9-res_post_32k-oai	blocks.9.hook_resid_post	9	32768	64	Skylion007/openwebtext	layer_norm
blocks.10.hook_resid_post Load this SAE	standard	gpt2-small/10-res_post_32k-oai	blocks.10.hook_resid_post	10	32768	64	Skylion007/openwebtext	layer_norm
blocks.11.hook_resid_post Load this SAE	standard	gpt2-small/11-res_post_32k-oai	blocks.11.hook_resid_post	11	32768	64	Skylion007/openwebtext	layer_norm

gpt2-small-resid-post-v5-128k

Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-resid-post-SAEs
model: gpt2-small

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_resid_post Load this SAE	standard	gpt2-small/0-res_post_128k-oai	blocks.0.hook_resid_post	0	131072	64	Skylion007/openwebtext	layer_norm
blocks.1.hook_resid_post Load this SAE	standard	gpt2-small/1-res_post_128k-oai	blocks.1.hook_resid_post	1	131072	64	Skylion007/openwebtext	layer_norm
blocks.2.hook_resid_post Load this SAE	standard	gpt2-small/2-res_post_128k-oai	blocks.2.hook_resid_post	2	131072	64	Skylion007/openwebtext	layer_norm
blocks.3.hook_resid_post Load this SAE	standard	gpt2-small/3-res_post_128k-oai	blocks.3.hook_resid_post	3	131072	64	Skylion007/openwebtext	layer_norm
blocks.4.hook_resid_post Load this SAE	standard	gpt2-small/4-res_post_128k-oai	blocks.4.hook_resid_post	4	131072	64	Skylion007/openwebtext	layer_norm
blocks.5.hook_resid_post Load this SAE	standard	gpt2-small/5-res_post_128k-oai	blocks.5.hook_resid_post	5	131072	64	Skylion007/openwebtext	layer_norm
blocks.6.hook_resid_post Load this SAE	standard	gpt2-small/6-res_post_128k-oai	blocks.6.hook_resid_post	6	131072	64	Skylion007/openwebtext	layer_norm
blocks.7.hook_resid_post Load this SAE	standard	gpt2-small/7-res_post_128k-oai	blocks.7.hook_resid_post	7	131072	64	Skylion007/openwebtext	layer_norm
blocks.8.hook_resid_post Load this SAE	standard	gpt2-small/8-res_post_128k-oai	blocks.8.hook_resid_post	8	131072	64	Skylion007/openwebtext	layer_norm
blocks.9.hook_resid_post Load this SAE	standard	gpt2-small/9-res_post_128k-oai	blocks.9.hook_resid_post	9	131072	64	Skylion007/openwebtext	layer_norm
blocks.10.hook_resid_post Load this SAE	standard	gpt2-small/10-res_post_128k-oai	blocks.10.hook_resid_post	10	131072	64	Skylion007/openwebtext	layer_norm
blocks.11.hook_resid_post Load this SAE	standard	gpt2-small/11-res_post_128k-oai	blocks.11.hook_resid_post	11	131072	64	Skylion007/openwebtext	layer_norm

gemma-2b-res-jb

Huggingface Repo: jbloom/Gemma-2b-Residual-Stream-SAEs
model: gemma-2b
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_resid_post Load this SAE	standard	gemma-2b/0-res-jb	blocks.0.hook_resid_post	0	16384	1024	HuggingFaceFW/fineweb	none
blocks.6.hook_resid_post Load this SAE	standard	gemma-2b/6-res-jb	blocks.6.hook_resid_post	6	16384	1024	HuggingFaceFW/fineweb	none
blocks.10.hook_resid_post Load this SAE	standard	gemma-2b/10-res-jb	blocks.10.hook_resid_post	10	16384	1024	ctigges/openwebtext-gemma-1024-cl	none
blocks.12.hook_resid_post Load this SAE	standard	gemma-2b/12-res-jb	blocks.12.hook_resid_post	12	16384	1024	HuggingFaceFW/fineweb	expected_average_only_in
blocks.17.hook_resid_post Load this SAE	standard		blocks.17.hook_resid_post	17	16384	1024	ctigges/openwebtext-gemma-1024-cl	none

gemma-2b-it-res-jb

Huggingface Repo: jbloom/Gemma-2b-IT-Residual-Stream-SAEs
model: gemma-2b-it
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.12.hook_resid_post Load this SAE	standard	gemma-2b-it/12-res-jb	blocks.12.hook_resid_post	12	16384	1024	Skylion007/openwebtext	none

mistral-7b-res-wg

Huggingface Repo: JoshEngels/Mistral-7B-Residual-Stream-SAEs
model: mistral-7b

id	architecture	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.8.hook_resid_pre Load this SAE	standard	blocks.8.hook_resid_pre	8	65536	256	monology/pile-uncopyrighted	constant_norm_rescale
blocks.16.hook_resid_pre Load this SAE	standard	blocks.16.hook_resid_pre	16	65536	256	monology/pile-uncopyrighted	constant_norm_rescale
blocks.24.hook_resid_pre Load this SAE	standard	blocks.24.hook_resid_pre	24	65536	256	monology/pile-uncopyrighted	constant_norm_rescale

gpt2-small-resid-mid-v5-32k

Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-resid-mid-SAEs
model: gpt2-small

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_resid_mid Load this SAE	standard	gpt2-small/0-res_mid_32k-oai	blocks.0.hook_resid_mid	0	32768	64	Skylion007/openwebtext	layer_norm
blocks.1.hook_resid_mid Load this SAE	standard	gpt2-small/1-res_mid_32k-oai	blocks.1.hook_resid_mid	1	32768	64	Skylion007/openwebtext	layer_norm
blocks.2.hook_resid_mid Load this SAE	standard	gpt2-small/2-res_mid_32k-oai	blocks.2.hook_resid_mid	2	32768	64	Skylion007/openwebtext	layer_norm
blocks.3.hook_resid_mid Load this SAE	standard	gpt2-small/3-res_mid_32k-oai	blocks.3.hook_resid_mid	3	32768	64	Skylion007/openwebtext	layer_norm
blocks.4.hook_resid_mid Load this SAE	standard	gpt2-small/4-res_mid_32k-oai	blocks.4.hook_resid_mid	4	32768	64	Skylion007/openwebtext	layer_norm
blocks.5.hook_resid_mid Load this SAE	standard	gpt2-small/5-res_mid_32k-oai	blocks.5.hook_resid_mid	5	32768	64	Skylion007/openwebtext	layer_norm
blocks.6.hook_resid_mid Load this SAE	standard	gpt2-small/6-res_mid_32k-oai	blocks.6.hook_resid_mid	6	32768	64	Skylion007/openwebtext	layer_norm
blocks.7.hook_resid_mid Load this SAE	standard	gpt2-small/7-res_mid_32k-oai	blocks.7.hook_resid_mid	7	32768	64	Skylion007/openwebtext	layer_norm
blocks.8.hook_resid_mid Load this SAE	standard	gpt2-small/8-res_mid_32k-oai	blocks.8.hook_resid_mid	8	32768	64	Skylion007/openwebtext	layer_norm
blocks.9.hook_resid_mid Load this SAE	standard	gpt2-small/9-res_mid_32k-oai	blocks.9.hook_resid_mid	9	32768	64	Skylion007/openwebtext	layer_norm
blocks.10.hook_resid_mid Load this SAE	standard	gpt2-small/10-res_mid_32k-oai	blocks.10.hook_resid_mid	10	32768	64	Skylion007/openwebtext	layer_norm
blocks.11.hook_resid_mid Load this SAE	standard	gpt2-small/11-res_mid_32k-oai	blocks.11.hook_resid_mid	11	32768	64	Skylion007/openwebtext	layer_norm

gpt2-small-resid-mid-v5-128k

Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-resid-mid-SAEs
model: gpt2-small

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_resid_mid Load this SAE	standard	gpt2-small/0-res_mid_128k-oai	blocks.0.hook_resid_mid	0	131072	64	Skylion007/openwebtext	layer_norm
blocks.1.hook_resid_mid Load this SAE	standard	gpt2-small/1-res_mid_128k-oai	blocks.1.hook_resid_mid	1	131072	64	Skylion007/openwebtext	layer_norm
blocks.2.hook_resid_mid Load this SAE	standard	gpt2-small/2-res_mid_128k-oai	blocks.2.hook_resid_mid	2	131072	64	Skylion007/openwebtext	layer_norm
blocks.3.hook_resid_mid Load this SAE	standard	gpt2-small/3-res_mid_128k-oai	blocks.3.hook_resid_mid	3	131072	64	Skylion007/openwebtext	layer_norm
blocks.4.hook_resid_mid Load this SAE	standard	gpt2-small/4-res_mid_128k-oai	blocks.4.hook_resid_mid	4	131072	64	Skylion007/openwebtext	layer_norm
blocks.5.hook_resid_mid Load this SAE	standard	gpt2-small/5-res_mid_128k-oai	blocks.5.hook_resid_mid	5	131072	64	Skylion007/openwebtext	layer_norm
blocks.6.hook_resid_mid Load this SAE	standard	gpt2-small/6-res_mid_128k-oai	blocks.6.hook_resid_mid	6	131072	64	Skylion007/openwebtext	layer_norm
blocks.7.hook_resid_mid Load this SAE	standard	gpt2-small/7-res_mid_128k-oai	blocks.7.hook_resid_mid	7	131072	64	Skylion007/openwebtext	layer_norm
blocks.8.hook_resid_mid Load this SAE	standard	gpt2-small/8-res_mid_128k-oai	blocks.8.hook_resid_mid	8	131072	64	Skylion007/openwebtext	layer_norm
blocks.9.hook_resid_mid Load this SAE	standard	gpt2-small/9-res_mid_128k-oai	blocks.9.hook_resid_mid	9	131072	64	Skylion007/openwebtext	layer_norm
blocks.10.hook_resid_mid Load this SAE	standard	gpt2-small/10-res_mid_128k-oai	blocks.10.hook_resid_mid	10	131072	64	Skylion007/openwebtext	layer_norm
blocks.11.hook_resid_mid Load this SAE	standard	gpt2-small/11-res_mid_128k-oai	blocks.11.hook_resid_mid	11	131072	64	Skylion007/openwebtext	layer_norm

gpt2-small-mlp-out-v5-32k

Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-mlp-out-SAEs
model: gpt2-small

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_mlp_out Load this SAE	standard	gpt2-small/0-mlp_32k-oai	blocks.0.hook_mlp_out	0	32768	64	Skylion007/openwebtext	layer_norm
blocks.1.hook_mlp_out Load this SAE	standard	gpt2-small/1-mlp_32k-oai	blocks.1.hook_mlp_out	1	32768	64	Skylion007/openwebtext	layer_norm
blocks.2.hook_mlp_out Load this SAE	standard	gpt2-small/2-mlp_32k-oai	blocks.2.hook_mlp_out	2	32768	64	Skylion007/openwebtext	layer_norm
blocks.3.hook_mlp_out Load this SAE	standard	gpt2-small/3-mlp_32k-oai	blocks.3.hook_mlp_out	3	32768	64	Skylion007/openwebtext	layer_norm
blocks.4.hook_mlp_out Load this SAE	standard	gpt2-small/4-mlp_32k-oai	blocks.4.hook_mlp_out	4	32768	64	Skylion007/openwebtext	layer_norm
blocks.5.hook_mlp_out Load this SAE	standard	gpt2-small/5-mlp_32k-oai	blocks.5.hook_mlp_out	5	32768	64	Skylion007/openwebtext	layer_norm
blocks.6.hook_mlp_out Load this SAE	standard	gpt2-small/6-mlp_32k-oai	blocks.6.hook_mlp_out	6	32768	64	Skylion007/openwebtext	layer_norm
blocks.7.hook_mlp_out Load this SAE	standard	gpt2-small/7-mlp_32k-oai	blocks.7.hook_mlp_out	7	32768	64	Skylion007/openwebtext	layer_norm
blocks.8.hook_mlp_out Load this SAE	standard	gpt2-small/8-mlp_32k-oai	blocks.8.hook_mlp_out	8	32768	64	Skylion007/openwebtext	layer_norm
blocks.9.hook_mlp_out Load this SAE	standard	gpt2-small/9-mlp_32k-oai	blocks.9.hook_mlp_out	9	32768	64	Skylion007/openwebtext	layer_norm
blocks.10.hook_mlp_out Load this SAE	standard	gpt2-small/10-mlp_32k-oai	blocks.10.hook_mlp_out	10	32768	64	Skylion007/openwebtext	layer_norm
blocks.11.hook_mlp_out Load this SAE	standard	gpt2-small/11-mlp_32k-oai	blocks.11.hook_mlp_out	11	32768	64	Skylion007/openwebtext	layer_norm

gpt2-small-mlp-out-v5-128k

Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-mlp-out-SAEs
model: gpt2-small

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_mlp_out Load this SAE	standard	gpt2-small/0-mlp_128k-oai	blocks.0.hook_mlp_out	0	131072	64	Skylion007/openwebtext	layer_norm
blocks.1.hook_mlp_out Load this SAE	standard	gpt2-small/1-mlp_128k-oai	blocks.1.hook_mlp_out	1	131072	64	Skylion007/openwebtext	layer_norm
blocks.2.hook_mlp_out Load this SAE	standard	gpt2-small/2-mlp_128k-oai	blocks.2.hook_mlp_out	2	131072	64	Skylion007/openwebtext	layer_norm
blocks.3.hook_mlp_out Load this SAE	standard	gpt2-small/3-mlp_128k-oai	blocks.3.hook_mlp_out	3	131072	64	Skylion007/openwebtext	layer_norm
blocks.4.hook_mlp_out Load this SAE	standard	gpt2-small/4-mlp_128k-oai	blocks.4.hook_mlp_out	4	131072	64	Skylion007/openwebtext	layer_norm
blocks.5.hook_mlp_out Load this SAE	standard	gpt2-small/5-mlp_128k-oai	blocks.5.hook_mlp_out	5	131072	64	Skylion007/openwebtext	layer_norm
blocks.6.hook_mlp_out Load this SAE	standard	gpt2-small/6-mlp_128k-oai	blocks.6.hook_mlp_out	6	131072	64	Skylion007/openwebtext	layer_norm
blocks.7.hook_mlp_out Load this SAE	standard	gpt2-small/7-mlp_128k-oai	blocks.7.hook_mlp_out	7	131072	64	Skylion007/openwebtext	layer_norm
blocks.8.hook_mlp_out Load this SAE	standard	gpt2-small/8-mlp_128k-oai	blocks.8.hook_mlp_out	8	131072	64	Skylion007/openwebtext	layer_norm
blocks.9.hook_mlp_out Load this SAE	standard	gpt2-small/9-mlp_128k-oai	blocks.9.hook_mlp_out	9	131072	64	Skylion007/openwebtext	layer_norm
blocks.10.hook_mlp_out Load this SAE	standard	gpt2-small/10-mlp_128k-oai	blocks.10.hook_mlp_out	10	131072	64	Skylion007/openwebtext	layer_norm
blocks.11.hook_mlp_out Load this SAE	standard	gpt2-small/11-mlp_128k-oai	blocks.11.hook_mlp_out	11	131072	64	Skylion007/openwebtext	layer_norm

gpt2-small-attn-out-v5-32k

Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-attn-out-SAEs
model: gpt2-small

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_attn_out Load this SAE	standard	gpt2-small/0-att_32k-oai	blocks.0.hook_attn_out	0	32768	64	Skylion007/openwebtext	layer_norm
blocks.1.hook_attn_out Load this SAE	standard	gpt2-small/1-att_32k-oai	blocks.1.hook_attn_out	1	32768	64	Skylion007/openwebtext	layer_norm
blocks.2.hook_attn_out Load this SAE	standard	gpt2-small/2-att_32k-oai	blocks.2.hook_attn_out	2	32768	64	Skylion007/openwebtext	layer_norm
blocks.3.hook_attn_out Load this SAE	standard	gpt2-small/3-att_32k-oai	blocks.3.hook_attn_out	3	32768	64	Skylion007/openwebtext	layer_norm
blocks.4.hook_attn_out Load this SAE	standard	gpt2-small/4-att_32k-oai	blocks.4.hook_attn_out	4	32768	64	Skylion007/openwebtext	layer_norm
blocks.5.hook_attn_out Load this SAE	standard	gpt2-small/5-att_32k-oai	blocks.5.hook_attn_out	5	32768	64	Skylion007/openwebtext	layer_norm
blocks.6.hook_attn_out Load this SAE	standard	gpt2-small/6-att_32k-oai	blocks.6.hook_attn_out	6	32768	64	Skylion007/openwebtext	layer_norm
blocks.7.hook_attn_out Load this SAE	standard	gpt2-small/7-att_32k-oai	blocks.7.hook_attn_out	7	32768	64	Skylion007/openwebtext	layer_norm
blocks.8.hook_attn_out Load this SAE	standard	gpt2-small/8-att_32k-oai	blocks.8.hook_attn_out	8	32768	64	Skylion007/openwebtext	layer_norm
blocks.9.hook_attn_out Load this SAE	standard	gpt2-small/9-att_32k-oai	blocks.9.hook_attn_out	9	32768	64	Skylion007/openwebtext	layer_norm
blocks.10.hook_attn_out Load this SAE	standard	gpt2-small/10-att_32k-oai	blocks.10.hook_attn_out	10	32768	64	Skylion007/openwebtext	layer_norm
blocks.11.hook_attn_out Load this SAE	standard	gpt2-small/11-att_32k-oai	blocks.11.hook_attn_out	11	32768	64	Skylion007/openwebtext	layer_norm

gpt2-small-attn-out-v5-128k

Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-attn-out-SAEs
model: gpt2-small

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_attn_out Load this SAE	standard	gpt2-small/0-att_128k-oai	blocks.0.hook_attn_out	0	131072	64	Skylion007/openwebtext	layer_norm
blocks.1.hook_attn_out Load this SAE	standard	gpt2-small/1-att_128k-oai	blocks.1.hook_attn_out	1	131072	64	Skylion007/openwebtext	layer_norm
blocks.2.hook_attn_out Load this SAE	standard	gpt2-small/2-att_128k-oai	blocks.2.hook_attn_out	2	131072	64	Skylion007/openwebtext	layer_norm
blocks.3.hook_attn_out Load this SAE	standard	gpt2-small/3-att_128k-oai	blocks.3.hook_attn_out	3	131072	64	Skylion007/openwebtext	layer_norm
blocks.4.hook_attn_out Load this SAE	standard	gpt2-small/4-att_128k-oai	blocks.4.hook_attn_out	4	131072	64	Skylion007/openwebtext	layer_norm
blocks.5.hook_attn_out Load this SAE	standard	gpt2-small/5-att_128k-oai	blocks.5.hook_attn_out	5	131072	64	Skylion007/openwebtext	layer_norm
blocks.6.hook_attn_out Load this SAE	standard	gpt2-small/6-att_128k-oai	blocks.6.hook_attn_out	6	131072	64	Skylion007/openwebtext	layer_norm
blocks.7.hook_attn_out Load this SAE	standard	gpt2-small/7-att_128k-oai	blocks.7.hook_attn_out	7	131072	64	Skylion007/openwebtext	layer_norm
blocks.8.hook_attn_out Load this SAE	standard	gpt2-small/8-att_128k-oai	blocks.8.hook_attn_out	8	131072	64	Skylion007/openwebtext	layer_norm
blocks.9.hook_attn_out Load this SAE	standard	gpt2-small/9-att_128k-oai	blocks.9.hook_attn_out	9	131072	64	Skylion007/openwebtext	layer_norm
blocks.10.hook_attn_out Load this SAE	standard	gpt2-small/10-att_128k-oai	blocks.10.hook_attn_out	10	131072	64	Skylion007/openwebtext	layer_norm
blocks.11.hook_attn_out Load this SAE	standard	gpt2-small/11-att_128k-oai	blocks.11.hook_attn_out	11	131072	64	Skylion007/openwebtext	layer_norm

gemma-scope-2b-pt-res

Huggingface Repo: google/gemma-scope-2b-pt-res
model: gemma-2-2b

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
embedding/width_4k/average_l0_6 Load this SAE	jumprelu		hook_embed	0	4096	1024	monology/pile-uncopyrighted
embedding/width_4k/average_l0_44 Load this SAE	jumprelu		hook_embed	0	4096	1024	monology/pile-uncopyrighted
embedding/width_4k/average_l0_21 Load this SAE	jumprelu		hook_embed	0	4096	1024	monology/pile-uncopyrighted
embedding/width_4k/average_l0_111 Load this SAE	jumprelu		hook_embed	0	4096	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_105 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_13 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_226 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_25 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_46 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_102 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_250 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_40 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_13 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_141 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_142 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_24 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_304 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_53 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_14 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_142 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_28 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_315 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_59 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_124 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_125 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_17 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_281 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_31 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_60 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_143 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-16k__l0-143	blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_18 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-16k__l0-18	blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_309 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-16k__l0-309	blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-16k__l0-34	blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_68 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_144 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_301 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_36 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_70 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_137 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_285 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_36 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_69 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_142 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_301 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_37 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_71 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_151 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_340 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_37 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_73 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_166 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_39 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_395 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_77 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_168 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_22 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_393 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_41 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_80 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_176 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-16k__l0-176	blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_22 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-16k__l0-22	blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_41 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-16k__l0-41	blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_445 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-16k__l0-445	blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_82 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_173 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_23 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_403 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_43 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_83 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_84 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_173 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_23 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_388 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_43 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_83 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_84 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_150 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_23 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_308 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_41 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_78 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_154 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_23 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_335 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_42 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_78 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_150 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_23 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_304 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_42 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_77 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_138 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_23 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_280 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_40 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_74 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_137 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-16k__l0-137	blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_23 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-16k__l0-23	blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_279 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-16k__l0-279	blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_40 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-16k__l0-40	blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_73 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_139 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_22 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_294 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_38 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_71 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_139 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_22 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_301 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_38 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_70 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_147 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_349 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_38 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_72 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_157 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_38 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_404 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_74 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_75 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_158 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_38 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_457 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_73 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_116 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_16 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_28 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_285 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_55 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_5/width_1m/average_l0_114 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-1m__l0-114	blocks.5.hook_resid_post	5	1048576	1024	monology/pile-uncopyrighted
layer_5/width_1m/average_l0_13 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-1m__l0-13	blocks.5.hook_resid_post	5	1048576	1024	monology/pile-uncopyrighted
layer_5/width_1m/average_l0_21 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-1m__l0-21	blocks.5.hook_resid_post	5	1048576	1024	monology/pile-uncopyrighted
layer_5/width_1m/average_l0_36 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-1m__l0-36	blocks.5.hook_resid_post	5	1048576	1024	monology/pile-uncopyrighted
layer_5/width_1m/average_l0_63 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-1m__l0-63	blocks.5.hook_resid_post	5	1048576	1024	monology/pile-uncopyrighted
layer_5/width_1m/average_l0_9 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-1m__l0-9	blocks.5.hook_resid_post	5	1048576	1024	monology/pile-uncopyrighted
layer_12/width_1m/average_l0_107 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	1048576	1024	monology/pile-uncopyrighted
layer_12/width_1m/average_l0_19 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-1m__l0-19	blocks.12.hook_resid_post	12	1048576	1024	monology/pile-uncopyrighted
layer_12/width_1m/average_l0_207 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-1m__l0-207	blocks.12.hook_resid_post	12	1048576	1024	monology/pile-uncopyrighted
layer_12/width_1m/average_l0_26 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-1m__l0-26	blocks.12.hook_resid_post	12	1048576	1024	monology/pile-uncopyrighted
layer_12/width_1m/average_l0_58 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-1m__l0-58	blocks.12.hook_resid_post	12	1048576	1024	monology/pile-uncopyrighted
layer_12/width_1m/average_l0_73 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-1m__l0-73	blocks.12.hook_resid_post	12	1048576	1024	monology/pile-uncopyrighted
layer_19/width_1m/average_l0_157 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-1m__l0-157	blocks.19.hook_resid_post	19	1048576	1024	monology/pile-uncopyrighted
layer_19/width_1m/average_l0_16 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-1m__l0-16	blocks.19.hook_resid_post	19	1048576	1024	monology/pile-uncopyrighted
layer_19/width_1m/average_l0_18 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-1m__l0-18	blocks.19.hook_resid_post	19	1048576	1024	monology/pile-uncopyrighted
layer_19/width_1m/average_l0_29 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-1m__l0-29	blocks.19.hook_resid_post	19	1048576	1024	monology/pile-uncopyrighted
layer_19/width_1m/average_l0_50 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-1m__l0-50	blocks.19.hook_resid_post	19	1048576	1024	monology/pile-uncopyrighted
layer_19/width_1m/average_l0_88 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	1048576	1024	monology/pile-uncopyrighted
layer_12/width_262k/average_l0_11 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	262144	1024	monology/pile-uncopyrighted
layer_12/width_262k/average_l0_121 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	262144	1024	monology/pile-uncopyrighted
layer_12/width_262k/average_l0_21 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	262144	1024	monology/pile-uncopyrighted
layer_12/width_262k/average_l0_243 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	262144	1024	monology/pile-uncopyrighted
layer_12/width_262k/average_l0_36 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	262144	1024	monology/pile-uncopyrighted
layer_12/width_262k/average_l0_67 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	262144	1024	monology/pile-uncopyrighted
layer_12/width_32k/average_l0_12 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	32768	1024	monology/pile-uncopyrighted
layer_12/width_32k/average_l0_155 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	32768	1024	monology/pile-uncopyrighted
layer_12/width_32k/average_l0_22 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	32768	1024	monology/pile-uncopyrighted
layer_12/width_32k/average_l0_360 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	32768	1024	monology/pile-uncopyrighted
layer_12/width_32k/average_l0_40 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	32768	1024	monology/pile-uncopyrighted
layer_12/width_32k/average_l0_76 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	32768	1024	monology/pile-uncopyrighted
layer_12/width_524k/average_l0_115 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	524288	1024	monology/pile-uncopyrighted
layer_12/width_524k/average_l0_22 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	524288	1024	monology/pile-uncopyrighted
layer_12/width_524k/average_l0_227 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	524288	1024	monology/pile-uncopyrighted
layer_12/width_524k/average_l0_29 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	524288	1024	monology/pile-uncopyrighted
layer_12/width_524k/average_l0_46 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	524288	1024	monology/pile-uncopyrighted
layer_12/width_524k/average_l0_65 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	524288	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_11 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_17 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_27 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_43 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_73 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_121 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_16 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_30 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_54 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_9 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_11 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_169 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_20 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_37 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_77 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_13 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_193 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_23 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_42 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_89 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_14 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_177 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_25 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_46 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_89 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_105 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_17 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-65k__l0-17	blocks.5.hook_resid_post	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_211 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-65k__l0-211	blocks.5.hook_resid_post	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_29 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-65k__l0-29	blocks.5.hook_resid_post	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_53 Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-65k__l0-53	blocks.5.hook_resid_post	5	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_107 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_17 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_208 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_30 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_56 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_107 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_18 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_203 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_31 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_57 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_111 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_19 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_213 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_33 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_59 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_118 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_19 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_240 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_34 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_61 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_128 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_20 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_265 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_36 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_66 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_134 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_21 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_273 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_37 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_70 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_141 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-65k__l0-141	blocks.12.hook_resid_post	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_21 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-65k__l0-21	blocks.12.hook_resid_post	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_297 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-65k__l0-297	blocks.12.hook_resid_post	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_38 Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-65k__l0-38	blocks.12.hook_resid_post	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_72 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_142 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_22 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_288 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_40 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_74 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_75 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_144 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_21 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_284 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_40 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_73 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_127 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_21 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_240 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_38 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_68 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_128 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_21 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_244 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_38 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_69 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_125 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_21 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_233 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_38 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_68 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_116 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_117 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_21 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_216 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_36 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_64 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_115 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_21 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-65k__l0-21	blocks.19.hook_resid_post	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_216 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-65k__l0-216	blocks.19.hook_resid_post	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_35 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-65k__l0-35	blocks.19.hook_resid_post	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_63 Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-65k__l0-63	blocks.19.hook_resid_post	19	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_114 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_20 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_221 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_34 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_61 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_111 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_112 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_20 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_225 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_33 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_61 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_116 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_117 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_20 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_248 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_33 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_62 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_123 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_124 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_20 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_272 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_35 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_64 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_124 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_19 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_273 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_34 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_63 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_15 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_197 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_26 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_48 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_93 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	65536	1024	monology/pile-uncopyrighted

gemma-scope-2b-pt-res-canonical

Huggingface Repo: google/gemma-scope-2b-pt-res
model: gemma-2-2b
Additional Links:

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_0/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/0-gemmascope-res-16k	blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/1-gemmascope-res-16k	blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/2-gemmascope-res-16k	blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/3-gemmascope-res-16k	blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/4-gemmascope-res-16k	blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-16k	blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/6-gemmascope-res-16k	blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/7-gemmascope-res-16k	blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/8-gemmascope-res-16k	blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/9-gemmascope-res-16k	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/10-gemmascope-res-16k	blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/11-gemmascope-res-16k	blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-16k	blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/13-gemmascope-res-16k	blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/14-gemmascope-res-16k	blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/15-gemmascope-res-16k	blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/16-gemmascope-res-16k	blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/17-gemmascope-res-16k	blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/18-gemmascope-res-16k	blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-16k	blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/20-gemmascope-res-16k	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/21-gemmascope-res-16k	blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/22-gemmascope-res-16k	blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/23-gemmascope-res-16k	blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/24-gemmascope-res-16k	blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/25-gemmascope-res-16k	blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_5/width_1m/canonical Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-1m	blocks.5.hook_resid_post	5	1048576	1024	monology/pile-uncopyrighted
layer_12/width_1m/canonical Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-1m	blocks.12.hook_resid_post	12	1048576	1024	monology/pile-uncopyrighted
layer_19/width_1m/canonical Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-1m	blocks.19.hook_resid_post	19	1048576	1024	monology/pile-uncopyrighted
layer_12/width_262k/canonical Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-262k	blocks.12.hook_resid_post	12	262144	1024	monology/pile-uncopyrighted
layer_12/width_32k/canonical Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-32k	blocks.12.hook_resid_post	12	32768	1024	monology/pile-uncopyrighted
layer_12/width_524k/canonical Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-524k	blocks.12.hook_resid_post	12	524288	1024	monology/pile-uncopyrighted
layer_0/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/0-gemmascope-res-65k	blocks.0.hook_resid_post	0	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/1-gemmascope-res-65k	blocks.1.hook_resid_post	1	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/2-gemmascope-res-65k	blocks.2.hook_resid_post	2	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/3-gemmascope-res-65k	blocks.3.hook_resid_post	3	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/4-gemmascope-res-65k	blocks.4.hook_resid_post	4	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-res-65k	blocks.5.hook_resid_post	5	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/6-gemmascope-res-65k	blocks.6.hook_resid_post	6	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/7-gemmascope-res-65k	blocks.7.hook_resid_post	7	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/8-gemmascope-res-65k	blocks.8.hook_resid_post	8	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/9-gemmascope-res-65k	blocks.9.hook_resid_post	9	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/10-gemmascope-res-65k	blocks.10.hook_resid_post	10	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/11-gemmascope-res-65k	blocks.11.hook_resid_post	11	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-res-65k	blocks.12.hook_resid_post	12	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/13-gemmascope-res-65k	blocks.13.hook_resid_post	13	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/14-gemmascope-res-65k	blocks.14.hook_resid_post	14	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/15-gemmascope-res-65k	blocks.15.hook_resid_post	15	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/16-gemmascope-res-65k	blocks.16.hook_resid_post	16	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/17-gemmascope-res-65k	blocks.17.hook_resid_post	17	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/18-gemmascope-res-65k	blocks.18.hook_resid_post	18	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-res-65k	blocks.19.hook_resid_post	19	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/20-gemmascope-res-65k	blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/21-gemmascope-res-65k	blocks.21.hook_resid_post	21	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/22-gemmascope-res-65k	blocks.22.hook_resid_post	22	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/23-gemmascope-res-65k	blocks.23.hook_resid_post	23	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/24-gemmascope-res-65k	blocks.24.hook_resid_post	24	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/25-gemmascope-res-65k	blocks.25.hook_resid_post	25	65536	1024	monology/pile-uncopyrighted

gemma-scope-2b-pt-mlp

Huggingface Repo: google/gemma-scope-2b-pt-mlp
model: gemma-2-2b

id	architecture	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_0/width_16k/average_l0_119 Load this SAE	jumprelu	blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_16 Load this SAE	jumprelu	blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_30 Load this SAE	jumprelu	blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_60 Load this SAE	jumprelu	blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_9 Load this SAE	jumprelu	blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_105 Load this SAE	jumprelu	blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_12 Load this SAE	jumprelu	blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_239 Load this SAE	jumprelu	blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_24 Load this SAE	jumprelu	blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_50 Load this SAE	jumprelu	blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_19 Load this SAE	jumprelu	blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_213 Load this SAE	jumprelu	blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_41 Load this SAE	jumprelu	blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_434 Load this SAE	jumprelu	blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_95 Load this SAE	jumprelu	blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_195 Load this SAE	jumprelu	blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_21 Load this SAE	jumprelu	blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_377 Load this SAE	jumprelu	blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_44 Load this SAE	jumprelu	blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_95 Load this SAE	jumprelu	blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_198 Load this SAE	jumprelu	blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_38 Load this SAE	jumprelu	blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_433 Load this SAE	jumprelu	blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_85 Load this SAE	jumprelu	blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_114 Load this SAE	jumprelu	blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_23 Load this SAE	jumprelu	blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_269 Load this SAE	jumprelu	blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_48 Load this SAE	jumprelu	blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_575 Load this SAE	jumprelu	blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_133 Load this SAE	jumprelu	blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_25 Load this SAE	jumprelu	blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_328 Load this SAE	jumprelu	blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_55 Load this SAE	jumprelu	blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_699 Load this SAE	jumprelu	blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_146 Load this SAE	jumprelu	blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_28 Load this SAE	jumprelu	blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_355 Load this SAE	jumprelu	blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_60 Load this SAE	jumprelu	blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_731 Load this SAE	jumprelu	blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_136 Load this SAE	jumprelu	blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_27 Load this SAE	jumprelu	blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_351 Load this SAE	jumprelu	blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_56 Load this SAE	jumprelu	blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_739 Load this SAE	jumprelu	blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_216 Load this SAE	jumprelu	blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_38 Load this SAE	jumprelu	blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_482 Load this SAE	jumprelu	blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_861 Load this SAE	jumprelu	blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_88 Load this SAE	jumprelu	blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_110 Load this SAE	jumprelu	blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_266 Load this SAE	jumprelu	blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_45 Load this SAE	jumprelu	blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_568 Load this SAE	jumprelu	blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_908 Load this SAE	jumprelu	blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_234 Load this SAE	jumprelu	blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_42 Load this SAE	jumprelu	blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_499 Load this SAE	jumprelu	blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_847 Load this SAE	jumprelu	blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_98 Load this SAE	jumprelu	blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_108 Load this SAE	jumprelu	blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_262 Load this SAE	jumprelu	blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_44 Load this SAE	jumprelu	blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_548 Load this SAE	jumprelu	blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_879 Load this SAE	jumprelu	blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_112 Load this SAE	jumprelu	blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_267 Load this SAE	jumprelu	blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_47 Load this SAE	jumprelu	blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_553 Load this SAE	jumprelu	blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_892 Load this SAE	jumprelu	blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_246 Load this SAE	jumprelu	blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_41 Load this SAE	jumprelu	blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_536 Load this SAE	jumprelu	blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_894 Load this SAE	jumprelu	blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_97 Load this SAE	jumprelu	blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_207 Load this SAE	jumprelu	blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_35 Load this SAE	jumprelu	blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_492 Load this SAE	jumprelu	blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_80 Load this SAE	jumprelu	blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_879 Load this SAE	jumprelu	blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_185 Load this SAE	jumprelu	blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_33 Load this SAE	jumprelu	blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_452 Load this SAE	jumprelu	blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_72 Load this SAE	jumprelu	blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_847 Load this SAE	jumprelu	blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_179 Load this SAE	jumprelu	blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_31 Load this SAE	jumprelu	blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_453 Load this SAE	jumprelu	blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_68 Load this SAE	jumprelu	blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_853 Load this SAE	jumprelu	blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_106 Load this SAE	jumprelu	blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_24 Load this SAE	jumprelu	blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_292 Load this SAE	jumprelu	blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_47 Load this SAE	jumprelu	blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_672 Load this SAE	jumprelu	blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_109 Load this SAE	jumprelu	blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_25 Load this SAE	jumprelu	blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_295 Load this SAE	jumprelu	blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_50 Load this SAE	jumprelu	blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_673 Load this SAE	jumprelu	blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_109 Load this SAE	jumprelu	blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_24 Load this SAE	jumprelu	blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_289 Load this SAE	jumprelu	blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_49 Load this SAE	jumprelu	blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_658 Load this SAE	jumprelu	blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_113 Load this SAE	jumprelu	blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_23 Load this SAE	jumprelu	blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_279 Load this SAE	jumprelu	blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_48 Load this SAE	jumprelu	blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_633 Load this SAE	jumprelu	blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_121 Load this SAE	jumprelu	blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_24 Load this SAE	jumprelu	blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_290 Load this SAE	jumprelu	blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_51 Load this SAE	jumprelu	blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_624 Load this SAE	jumprelu	blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_128 Load this SAE	jumprelu	blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_27 Load this SAE	jumprelu	blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_287 Load this SAE	jumprelu	blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_57 Load this SAE	jumprelu	blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_627 Load this SAE	jumprelu	blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_158 Load this SAE	jumprelu	blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_19 Load this SAE	jumprelu	blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_35 Load this SAE	jumprelu	blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_357 Load this SAE	jumprelu	blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_73 Load this SAE	jumprelu	blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_126 Load this SAE	jumprelu	blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_15 Load this SAE	jumprelu	blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_277 Load this SAE	jumprelu	blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_29 Load this SAE	jumprelu	blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_59 Load this SAE	jumprelu	blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_12 Load this SAE	jumprelu	blocks.0.hook_mlp_out	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_21 Load this SAE	jumprelu	blocks.0.hook_mlp_out	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_39 Load this SAE	jumprelu	blocks.0.hook_mlp_out	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_7 Load this SAE	jumprelu	blocks.0.hook_mlp_out	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_72 Load this SAE	jumprelu	blocks.0.hook_mlp_out	0	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_11 Load this SAE	jumprelu	blocks.1.hook_mlp_out	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_127 Load this SAE	jumprelu	blocks.1.hook_mlp_out	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_20 Load this SAE	jumprelu	blocks.1.hook_mlp_out	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_37 Load this SAE	jumprelu	blocks.1.hook_mlp_out	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_67 Load this SAE	jumprelu	blocks.1.hook_mlp_out	1	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_134 Load this SAE	jumprelu	blocks.2.hook_mlp_out	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_16 Load this SAE	jumprelu	blocks.2.hook_mlp_out	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_265 Load this SAE	jumprelu	blocks.2.hook_mlp_out	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_31 Load this SAE	jumprelu	blocks.2.hook_mlp_out	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_60 Load this SAE	jumprelu	blocks.2.hook_mlp_out	2	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_144 Load this SAE	jumprelu	blocks.3.hook_mlp_out	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_18 Load this SAE	jumprelu	blocks.3.hook_mlp_out	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_279 Load this SAE	jumprelu	blocks.3.hook_mlp_out	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_33 Load this SAE	jumprelu	blocks.3.hook_mlp_out	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_68 Load this SAE	jumprelu	blocks.3.hook_mlp_out	3	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_138 Load this SAE	jumprelu	blocks.4.hook_mlp_out	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_17 Load this SAE	jumprelu	blocks.4.hook_mlp_out	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_299 Load this SAE	jumprelu	blocks.4.hook_mlp_out	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_32 Load this SAE	jumprelu	blocks.4.hook_mlp_out	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_66 Load this SAE	jumprelu	blocks.4.hook_mlp_out	4	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_186 Load this SAE	jumprelu	blocks.5.hook_mlp_out	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_22 Load this SAE	jumprelu	blocks.5.hook_mlp_out	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_407 Load this SAE	jumprelu	blocks.5.hook_mlp_out	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_43 Load this SAE	jumprelu	blocks.5.hook_mlp_out	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_86 Load this SAE	jumprelu	blocks.5.hook_mlp_out	5	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_101 Load this SAE	jumprelu	blocks.6.hook_mlp_out	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_224 Load this SAE	jumprelu	blocks.6.hook_mlp_out	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_24 Load this SAE	jumprelu	blocks.6.hook_mlp_out	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_47 Load this SAE	jumprelu	blocks.6.hook_mlp_out	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_515 Load this SAE	jumprelu	blocks.6.hook_mlp_out	6	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_115 Load this SAE	jumprelu	blocks.7.hook_mlp_out	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_266 Load this SAE	jumprelu	blocks.7.hook_mlp_out	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_28 Load this SAE	jumprelu	blocks.7.hook_mlp_out	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_56 Load this SAE	jumprelu	blocks.7.hook_mlp_out	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_571 Load this SAE	jumprelu	blocks.7.hook_mlp_out	7	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_110 Load this SAE	jumprelu	blocks.8.hook_mlp_out	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_256 Load this SAE	jumprelu	blocks.8.hook_mlp_out	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_31 Load this SAE	jumprelu	blocks.8.hook_mlp_out	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_547 Load this SAE	jumprelu	blocks.8.hook_mlp_out	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_55 Load this SAE	jumprelu	blocks.8.hook_mlp_out	8	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_168 Load this SAE	jumprelu	blocks.9.hook_mlp_out	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_38 Load this SAE	jumprelu	blocks.9.hook_mlp_out	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_387 Load this SAE	jumprelu	blocks.9.hook_mlp_out	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_745 Load this SAE	jumprelu	blocks.9.hook_mlp_out	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_77 Load this SAE	jumprelu	blocks.9.hook_mlp_out	9	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_218 Load this SAE	jumprelu	blocks.10.hook_mlp_out	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_43 Load this SAE	jumprelu	blocks.10.hook_mlp_out	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_474 Load this SAE	jumprelu	blocks.10.hook_mlp_out	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_851 Load this SAE	jumprelu	blocks.10.hook_mlp_out	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_95 Load this SAE	jumprelu	blocks.10.hook_mlp_out	10	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_200 Load this SAE	jumprelu	blocks.11.hook_mlp_out	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_41 Load this SAE	jumprelu	blocks.11.hook_mlp_out	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_436 Load this SAE	jumprelu	blocks.11.hook_mlp_out	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_771 Load this SAE	jumprelu	blocks.11.hook_mlp_out	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_88 Load this SAE	jumprelu	blocks.11.hook_mlp_out	11	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_222 Load this SAE	jumprelu	blocks.12.hook_mlp_out	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_44 Load this SAE	jumprelu	blocks.12.hook_mlp_out	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_482 Load this SAE	jumprelu	blocks.12.hook_mlp_out	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_848 Load this SAE	jumprelu	blocks.12.hook_mlp_out	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_96 Load this SAE	jumprelu	blocks.12.hook_mlp_out	12	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_228 Load this SAE	jumprelu	blocks.13.hook_mlp_out	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_44 Load this SAE	jumprelu	blocks.13.hook_mlp_out	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_480 Load this SAE	jumprelu	blocks.13.hook_mlp_out	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_841 Load this SAE	jumprelu	blocks.13.hook_mlp_out	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_98 Load this SAE	jumprelu	blocks.13.hook_mlp_out	13	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_204 Load this SAE	jumprelu	blocks.14.hook_mlp_out	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_39 Load this SAE	jumprelu	blocks.14.hook_mlp_out	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_463 Load this SAE	jumprelu	blocks.14.hook_mlp_out	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_816 Load this SAE	jumprelu	blocks.14.hook_mlp_out	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_89 Load this SAE	jumprelu	blocks.14.hook_mlp_out	14	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_164 Load this SAE	jumprelu	blocks.15.hook_mlp_out	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_35 Load this SAE	jumprelu	blocks.15.hook_mlp_out	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_405 Load this SAE	jumprelu	blocks.15.hook_mlp_out	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_72 Load this SAE	jumprelu	blocks.15.hook_mlp_out	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_754 Load this SAE	jumprelu	blocks.15.hook_mlp_out	15	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_142 Load this SAE	jumprelu	blocks.16.hook_mlp_out	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_32 Load this SAE	jumprelu	blocks.16.hook_mlp_out	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_348 Load this SAE	jumprelu	blocks.16.hook_mlp_out	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_66 Load this SAE	jumprelu	blocks.16.hook_mlp_out	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_695 Load this SAE	jumprelu	blocks.16.hook_mlp_out	16	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_136 Load this SAE	jumprelu	blocks.17.hook_mlp_out	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_30 Load this SAE	jumprelu	blocks.17.hook_mlp_out	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_342 Load this SAE	jumprelu	blocks.17.hook_mlp_out	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_61 Load this SAE	jumprelu	blocks.17.hook_mlp_out	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_666 Load this SAE	jumprelu	blocks.17.hook_mlp_out	17	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_191 Load this SAE	jumprelu	blocks.18.hook_mlp_out	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_24 Load this SAE	jumprelu	blocks.18.hook_mlp_out	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_44 Load this SAE	jumprelu	blocks.18.hook_mlp_out	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_491 Load this SAE	jumprelu	blocks.18.hook_mlp_out	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_88 Load this SAE	jumprelu	blocks.18.hook_mlp_out	18	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_192 Load this SAE	jumprelu	blocks.19.hook_mlp_out	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_25 Load this SAE	jumprelu	blocks.19.hook_mlp_out	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_45 Load this SAE	jumprelu	blocks.19.hook_mlp_out	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_470 Load this SAE	jumprelu	blocks.19.hook_mlp_out	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_88 Load this SAE	jumprelu	blocks.19.hook_mlp_out	19	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_189 Load this SAE	jumprelu	blocks.20.hook_mlp_out	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_23 Load this SAE	jumprelu	blocks.20.hook_mlp_out	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_44 Load this SAE	jumprelu	blocks.20.hook_mlp_out	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_446 Load this SAE	jumprelu	blocks.20.hook_mlp_out	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_88 Load this SAE	jumprelu	blocks.20.hook_mlp_out	20	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_192 Load this SAE	jumprelu	blocks.21.hook_mlp_out	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_23 Load this SAE	jumprelu	blocks.21.hook_mlp_out	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_42 Load this SAE	jumprelu	blocks.21.hook_mlp_out	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_472 Load this SAE	jumprelu	blocks.21.hook_mlp_out	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_86 Load this SAE	jumprelu	blocks.21.hook_mlp_out	21	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_203 Load this SAE	jumprelu	blocks.22.hook_mlp_out	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_23 Load this SAE	jumprelu	blocks.22.hook_mlp_out	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_46 Load this SAE	jumprelu	blocks.22.hook_mlp_out	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_487 Load this SAE	jumprelu	blocks.22.hook_mlp_out	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_92 Load this SAE	jumprelu	blocks.22.hook_mlp_out	22	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_102 Load this SAE	jumprelu	blocks.23.hook_mlp_out	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_218 Load this SAE	jumprelu	blocks.23.hook_mlp_out	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_25 Load this SAE	jumprelu	blocks.23.hook_mlp_out	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_49 Load this SAE	jumprelu	blocks.23.hook_mlp_out	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_497 Load this SAE	jumprelu	blocks.23.hook_mlp_out	23	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_128 Load this SAE	jumprelu	blocks.24.hook_mlp_out	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_18 Load this SAE	jumprelu	blocks.24.hook_mlp_out	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_268 Load this SAE	jumprelu	blocks.24.hook_mlp_out	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_32 Load this SAE	jumprelu	blocks.24.hook_mlp_out	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_62 Load this SAE	jumprelu	blocks.24.hook_mlp_out	24	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_107 Load this SAE	jumprelu	blocks.25.hook_mlp_out	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_14 Load this SAE	jumprelu	blocks.25.hook_mlp_out	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_215 Load this SAE	jumprelu	blocks.25.hook_mlp_out	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_26 Load this SAE	jumprelu	blocks.25.hook_mlp_out	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_52 Load this SAE	jumprelu	blocks.25.hook_mlp_out	25	65536	1024	monology/pile-uncopyrighted

gemma-scope-2b-pt-mlp-canonical

Huggingface Repo: google/gemma-scope-2b-pt-mlp
model: gemma-2-2b

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_0/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/0-gemmascope-mlp-16k	blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/1-gemmascope-mlp-16k	blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/2-gemmascope-mlp-16k	blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/3-gemmascope-mlp-16k	blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/4-gemmascope-mlp-16k	blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-mlp-16k	blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/6-gemmascope-mlp-16k	blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/7-gemmascope-mlp-16k	blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/8-gemmascope-mlp-16k	blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/9-gemmascope-mlp-16k	blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/10-gemmascope-mlp-16k	blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/11-gemmascope-mlp-16k	blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-mlp-16k	blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/13-gemmascope-mlp-16k	blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/14-gemmascope-mlp-16k	blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/15-gemmascope-mlp-16k	blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/16-gemmascope-mlp-16k	blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/17-gemmascope-mlp-16k	blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/18-gemmascope-mlp-16k	blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-mlp-16k	blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/20-gemmascope-mlp-16k	blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/21-gemmascope-mlp-16k	blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/22-gemmascope-mlp-16k	blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/23-gemmascope-mlp-16k	blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/24-gemmascope-mlp-16k	blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/25-gemmascope-mlp-16k	blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_0/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/0-gemmascope-mlp-65k	blocks.0.hook_mlp_out	0	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/1-gemmascope-mlp-65k	blocks.1.hook_mlp_out	1	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/2-gemmascope-mlp-65k	blocks.2.hook_mlp_out	2	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/3-gemmascope-mlp-65k	blocks.3.hook_mlp_out	3	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/4-gemmascope-mlp-65k	blocks.4.hook_mlp_out	4	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-mlp-65k	blocks.5.hook_mlp_out	5	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/6-gemmascope-mlp-65k	blocks.6.hook_mlp_out	6	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/7-gemmascope-mlp-65k	blocks.7.hook_mlp_out	7	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/8-gemmascope-mlp-65k	blocks.8.hook_mlp_out	8	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/9-gemmascope-mlp-65k	blocks.9.hook_mlp_out	9	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/10-gemmascope-mlp-65k	blocks.10.hook_mlp_out	10	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/11-gemmascope-mlp-65k	blocks.11.hook_mlp_out	11	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-mlp-65k	blocks.12.hook_mlp_out	12	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/13-gemmascope-mlp-65k	blocks.13.hook_mlp_out	13	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/14-gemmascope-mlp-65k	blocks.14.hook_mlp_out	14	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/15-gemmascope-mlp-65k	blocks.15.hook_mlp_out	15	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/16-gemmascope-mlp-65k	blocks.16.hook_mlp_out	16	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/17-gemmascope-mlp-65k	blocks.17.hook_mlp_out	17	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/18-gemmascope-mlp-65k	blocks.18.hook_mlp_out	18	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-mlp-65k	blocks.19.hook_mlp_out	19	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/20-gemmascope-mlp-65k	blocks.20.hook_mlp_out	20	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/21-gemmascope-mlp-65k	blocks.21.hook_mlp_out	21	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/22-gemmascope-mlp-65k	blocks.22.hook_mlp_out	22	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/23-gemmascope-mlp-65k	blocks.23.hook_mlp_out	23	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/24-gemmascope-mlp-65k	blocks.24.hook_mlp_out	24	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/25-gemmascope-mlp-65k	blocks.25.hook_mlp_out	25	65536	1024	monology/pile-uncopyrighted

gemma-scope-2b-pt-att

Huggingface Repo: google/gemma-scope-2b-pt-att
model: gemma-2-2b

id	architecture	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_0/width_16k/average_l0_104 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_12 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_30 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_57 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_146 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_20 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_251 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_40 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_79 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_174 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_19 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_297 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_43 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_93 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_117 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_219 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_24 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_386 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_55 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_116 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_249 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_26 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_454 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_53 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_135 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_268 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_30 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_449 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_59 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_143 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_292 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_30 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_479 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_61 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_184 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_331 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_46 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_537 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_99 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_129 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_282 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_32 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_482 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_64 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_127 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_270 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_34 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_499 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_64 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_148 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_307 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_36 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_541 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_70 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_170 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_350 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_41 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_593 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_80 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_184 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_328 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_41 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_514 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_85 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_203 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_372 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_43 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_570 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_92 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_161 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_298 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_37 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_468 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_71 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_195 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_342 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_44 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_535 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_98 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_144 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_293 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_37 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_527 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_71 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_176 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_316 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_38 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_509 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_79 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_144 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_292 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_34 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_491 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_72 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_122 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_249 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_28 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_423 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_56 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_141 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_274 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_31 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_446 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_62 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_142 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_301 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_32 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_505 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_65 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_106 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_215 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_22 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_373 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_47 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_161 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_30 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_300 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_474 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_73 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_212 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_372 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_39 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_558 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_96 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_177 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_313 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_35 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_492 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_77 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_10 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_16 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_24 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_43 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	65536	1024	monology/pile-uncopyrighted
layer_0/width_65k/average_l0_75 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_15 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_181 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_28 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_55 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/average_l0_98 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_125 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_14 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_228 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_28 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/average_l0_59 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_174 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_19 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_320 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_39 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/average_l0_83 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_188 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_22 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_382 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_43 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/average_l0_87 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_227 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_28 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_400 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_51 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/average_l0_99 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_112 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_261 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_30 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_449 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/average_l0_55 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_176 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_311 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_519 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_52 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/average_l0_96 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_112 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_246 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_35 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_454 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/average_l0_56 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_107 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_231 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_31 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_454 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/average_l0_57 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_134 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_292 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_35 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_521 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/average_l0_67 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_154 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_330 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_41 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_576 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/average_l0_75 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_172 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_320 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_39 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_503 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/average_l0_79 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_191 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_363 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_41 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_556 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/average_l0_87 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_138 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_283 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_37 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_453 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/average_l0_66 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_182 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_327 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_42 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_517 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/average_l0_90 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_129 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_260 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_35 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_502 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/average_l0_64 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_157 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_293 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_35 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_489 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/average_l0_70 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_123 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_255 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_29 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_466 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/average_l0_58 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_106 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_220 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_26 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_411 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/average_l0_49 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_102 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_242 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_26 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_419 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_49 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_118 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_266 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_29 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_474 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/average_l0_56 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_112 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_196 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_20 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_361 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/average_l0_37 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_140 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_27 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_276 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_457 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/average_l0_56 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_186 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_32 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_347 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_537 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/average_l0_77 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_153 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_290 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_30 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_465 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/average_l0_63 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	65536	1024	monology/pile-uncopyrighted

gemma-scope-2b-pt-att-canonical

Huggingface Repo: google/gemma-scope-2b-pt-att
model: gemma-2-2b

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_0/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/0-gemmascope-att-16k	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/1-gemmascope-att-16k	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/2-gemmascope-att-16k	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/3-gemmascope-att-16k	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/4-gemmascope-att-16k	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-att-16k	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/6-gemmascope-att-16k	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/7-gemmascope-att-16k	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/8-gemmascope-att-16k	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/9-gemmascope-att-16k	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/10-gemmascope-att-16k	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/11-gemmascope-att-16k	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-att-16k	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/13-gemmascope-att-16k	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/14-gemmascope-att-16k	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/15-gemmascope-att-16k	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/16-gemmascope-att-16k	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/17-gemmascope-att-16k	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/18-gemmascope-att-16k	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-att-16k	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/20-gemmascope-att-16k	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/21-gemmascope-att-16k	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/22-gemmascope-att-16k	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/23-gemmascope-att-16k	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/24-gemmascope-att-16k	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/canonical Load this SAE	jumprelu	gemma-2-2b/25-gemmascope-att-16k	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_0/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/0-gemmascope-att-65k	blocks.0.attn.hook_z	0	65536	1024	monology/pile-uncopyrighted
layer_1/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/1-gemmascope-att-65k	blocks.1.attn.hook_z	1	65536	1024	monology/pile-uncopyrighted
layer_2/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/2-gemmascope-att-65k	blocks.2.attn.hook_z	2	65536	1024	monology/pile-uncopyrighted
layer_3/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/3-gemmascope-att-65k	blocks.3.attn.hook_z	3	65536	1024	monology/pile-uncopyrighted
layer_4/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/4-gemmascope-att-65k	blocks.4.attn.hook_z	4	65536	1024	monology/pile-uncopyrighted
layer_5/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/5-gemmascope-att-65k	blocks.5.attn.hook_z	5	65536	1024	monology/pile-uncopyrighted
layer_6/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/6-gemmascope-att-65k	blocks.6.attn.hook_z	6	65536	1024	monology/pile-uncopyrighted
layer_7/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/7-gemmascope-att-65k	blocks.7.attn.hook_z	7	65536	1024	monology/pile-uncopyrighted
layer_8/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/8-gemmascope-att-65k	blocks.8.attn.hook_z	8	65536	1024	monology/pile-uncopyrighted
layer_9/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/9-gemmascope-att-65k	blocks.9.attn.hook_z	9	65536	1024	monology/pile-uncopyrighted
layer_10/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/10-gemmascope-att-65k	blocks.10.attn.hook_z	10	65536	1024	monology/pile-uncopyrighted
layer_11/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/11-gemmascope-att-65k	blocks.11.attn.hook_z	11	65536	1024	monology/pile-uncopyrighted
layer_12/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/12-gemmascope-att-65k	blocks.12.attn.hook_z	12	65536	1024	monology/pile-uncopyrighted
layer_13/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/13-gemmascope-att-65k	blocks.13.attn.hook_z	13	65536	1024	monology/pile-uncopyrighted
layer_14/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/14-gemmascope-att-65k	blocks.14.attn.hook_z	14	65536	1024	monology/pile-uncopyrighted
layer_15/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/15-gemmascope-att-65k	blocks.15.attn.hook_z	15	65536	1024	monology/pile-uncopyrighted
layer_16/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/16-gemmascope-att-65k	blocks.16.attn.hook_z	16	65536	1024	monology/pile-uncopyrighted
layer_17/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/17-gemmascope-att-65k	blocks.17.attn.hook_z	17	65536	1024	monology/pile-uncopyrighted
layer_18/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/18-gemmascope-att-65k	blocks.18.attn.hook_z	18	65536	1024	monology/pile-uncopyrighted
layer_19/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/19-gemmascope-att-65k	blocks.19.attn.hook_z	19	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/20-gemmascope-att-65k	blocks.20.attn.hook_z	20	65536	1024	monology/pile-uncopyrighted
layer_21/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/21-gemmascope-att-65k	blocks.21.attn.hook_z	21	65536	1024	monology/pile-uncopyrighted
layer_22/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/22-gemmascope-att-65k	blocks.22.attn.hook_z	22	65536	1024	monology/pile-uncopyrighted
layer_23/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/23-gemmascope-att-65k	blocks.23.attn.hook_z	23	65536	1024	monology/pile-uncopyrighted
layer_24/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/24-gemmascope-att-65k	blocks.24.attn.hook_z	24	65536	1024	monology/pile-uncopyrighted
layer_25/width_65k/canonical Load this SAE	jumprelu	gemma-2-2b/25-gemmascope-att-65k	blocks.25.attn.hook_z	25	65536	1024	monology/pile-uncopyrighted

gemma-scope-9b-pt-res

Huggingface Repo: google/gemma-scope-9b-pt-res
model: gemma-2-9b

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
embedding/width_4k/average_l0_14 Load this SAE	jumprelu		hook_embed	0	4096	1024	monology/pile-uncopyrighted
embedding/width_4k/average_l0_22 Load this SAE	jumprelu		hook_embed	0	4096	1024	monology/pile-uncopyrighted
embedding/width_4k/average_l0_7 Load this SAE	jumprelu		hook_embed	0	4096	1024	monology/pile-uncopyrighted
embedding/width_4k/average_l0_80 Load this SAE	jumprelu		hook_embed	0	4096	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_15 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_21 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_30 Load this SAE	jumprelu	gemma-2-9b/0-gemmascope-res-131k__l0-30	blocks.0.hook_resid_post	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_41 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_8 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_129 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_17 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_35 Load this SAE	jumprelu	gemma-2-9b/0-gemmascope-res-16k__l0-35	blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_68 Load this SAE	jumprelu		blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_13 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_20 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_33 Load this SAE	jumprelu	gemma-2-9b/1-gemmascope-res-131k__l0-33	blocks.1.hook_resid_post	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_56 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_6 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_9 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_15 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_175 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_31 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_69 Load this SAE	jumprelu	gemma-2-9b/1-gemmascope-res-16k__l0-69	blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_9 Load this SAE	jumprelu		blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_15 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_151 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_27 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_47 Load this SAE	jumprelu	gemma-2-9b/10-gemmascope-res-131k__l0-47	blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_84 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_9 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_113 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_17 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_243 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_31 Load this SAE	jumprelu		blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_57 Load this SAE	jumprelu	gemma-2-9b/10-gemmascope-res-16k__l0-57	blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_16 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_162 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_27 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_49 Load this SAE	jumprelu	gemma-2-9b/11-gemmascope-res-131k__l0-49	blocks.11.hook_resid_post	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_88 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_9 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_118 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_18 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_255 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_32 Load this SAE	jumprelu	gemma-2-9b/11-gemmascope-res-16k__l0-32	blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_60 Load this SAE	jumprelu		blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_183 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_29 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_52 Load this SAE	jumprelu	gemma-2-9b/12-gemmascope-res-131k__l0-52	blocks.12.hook_resid_post	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_96 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_130 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_287 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_33 Load this SAE	jumprelu	gemma-2-9b/12-gemmascope-res-16k__l0-33	blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_64 Load this SAE	jumprelu		blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_189 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_30 Load this SAE	jumprelu	gemma-2-9b/13-gemmascope-res-131k__l0-30	blocks.13.hook_resid_post	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_54 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_99 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_132 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_285 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/13-gemmascope-res-16k__l0-34	blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_65 Load this SAE	jumprelu		blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_105 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_197 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_31 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_56 Load this SAE	jumprelu	gemma-2-9b/14-gemmascope-res-131k__l0-56	blocks.14.hook_resid_post	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_137 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_294 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_35 Load this SAE	jumprelu	gemma-2-9b/14-gemmascope-res-16k__l0-35	blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_67 Load this SAE	jumprelu		blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_103 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_198 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_55 Load this SAE	jumprelu	gemma-2-9b/15-gemmascope-res-131k__l0-55	blocks.15.hook_resid_post	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_131 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_18 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_290 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/15-gemmascope-res-16k__l0-34	blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_65 Load this SAE	jumprelu		blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_121 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_20 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_232 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_35 Load this SAE	jumprelu	gemma-2-9b/16-gemmascope-res-131k__l0-35	blocks.16.hook_resid_post	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_65 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_152 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_346 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_39 Load this SAE	jumprelu	gemma-2-9b/16-gemmascope-res-16k__l0-39	blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_75 Load this SAE	jumprelu		blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_117 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_221 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_35 Load this SAE	jumprelu	gemma-2-9b/17-gemmascope-res-131k__l0-35	blocks.17.hook_resid_post	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_64 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_144 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_317 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_38 Load this SAE	jumprelu	gemma-2-9b/17-gemmascope-res-16k__l0-38	blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_73 Load this SAE	jumprelu		blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_113 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_221 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/18-gemmascope-res-131k__l0-34	blocks.18.hook_resid_post	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_62 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_140 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_309 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_37 Load this SAE	jumprelu	gemma-2-9b/18-gemmascope-res-16k__l0-37	blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_71 Load this SAE	jumprelu		blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_110 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_210 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_32 Load this SAE	jumprelu	gemma-2-9b/19-gemmascope-res-131k__l0-32	blocks.19.hook_resid_post	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_60 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_132 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_293 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_35 Load this SAE	jumprelu	gemma-2-9b/19-gemmascope-res-16k__l0-35	blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_67 Load this SAE	jumprelu		blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_36 Load this SAE	jumprelu	gemma-2-9b/2-gemmascope-res-131k__l0-36	blocks.2.hook_resid_post	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_5 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_70 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_8 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_14 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_189 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_29 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_67 Load this SAE	jumprelu	gemma-2-9b/2-gemmascope-res-16k__l0-67	blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_8 Load this SAE	jumprelu		blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_10 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-10	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_11 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-11	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_114 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_12 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-12	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_19 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-19	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_221 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-221	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_269 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-269	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_276 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-276	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_288 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-288	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-34	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-51	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_53 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-53	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_54 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-54	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_62 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k__l0-62	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_11 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k__l0-11	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_138 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k__l0-138	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_20 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k__l0-20	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_310 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k__l0-310	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_36 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k__l0-36	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_393 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k__l0-393	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_408 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k__l0-408	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_427 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k__l0-427	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_57 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k__l0-57	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_58 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k__l0-58	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_68 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_1m/average_l0_101 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	1048576	1024	monology/pile-uncopyrighted
layer_20/width_1m/average_l0_11 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-1m__l0-11	blocks.20.hook_resid_post	20	1048576	1024	monology/pile-uncopyrighted
layer_20/width_1m/average_l0_19 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-1m__l0-19	blocks.20.hook_resid_post	20	1048576	1024	monology/pile-uncopyrighted
layer_20/width_1m/average_l0_193 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-1m__l0-193	blocks.20.hook_resid_post	20	1048576	1024	monology/pile-uncopyrighted
layer_20/width_1m/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-1m__l0-34	blocks.20.hook_resid_post	20	1048576	1024	monology/pile-uncopyrighted
layer_20/width_1m/average_l0_57 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-1m__l0-57	blocks.20.hook_resid_post	20	1048576	1024	monology/pile-uncopyrighted
layer_20/width_262k/average_l0_10 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	262144	1024	monology/pile-uncopyrighted
layer_20/width_262k/average_l0_11 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	262144	1024	monology/pile-uncopyrighted
layer_20/width_262k/average_l0_13 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	262144	1024	monology/pile-uncopyrighted
layer_20/width_262k/average_l0_249 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	262144	1024	monology/pile-uncopyrighted
layer_20/width_262k/average_l0_259 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	262144	1024	monology/pile-uncopyrighted
layer_20/width_262k/average_l0_276 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	262144	1024	monology/pile-uncopyrighted
layer_20/width_262k/average_l0_49 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	262144	1024	monology/pile-uncopyrighted
layer_20/width_262k/average_l0_50 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	262144	1024	monology/pile-uncopyrighted
layer_20/width_262k/average_l0_64 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	262144	1024	monology/pile-uncopyrighted
layer_20/width_32k/average_l0_11 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	32768	1024	monology/pile-uncopyrighted
layer_20/width_32k/average_l0_334 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	32768	1024	monology/pile-uncopyrighted
layer_20/width_32k/average_l0_344 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	32768	1024	monology/pile-uncopyrighted
layer_20/width_32k/average_l0_357 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	32768	1024	monology/pile-uncopyrighted
layer_20/width_32k/average_l0_55 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	32768	1024	monology/pile-uncopyrighted
layer_20/width_32k/average_l0_57 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	32768	1024	monology/pile-uncopyrighted
layer_20/width_524k/average_l0_10 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	524288	1024	monology/pile-uncopyrighted
layer_20/width_524k/average_l0_229 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	524288	1024	monology/pile-uncopyrighted
layer_20/width_524k/average_l0_24 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	524288	1024	monology/pile-uncopyrighted
layer_20/width_524k/average_l0_241 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	524288	1024	monology/pile-uncopyrighted
layer_20/width_524k/average_l0_298 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	524288	1024	monology/pile-uncopyrighted
layer_20/width_524k/average_l0_46 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	524288	1024	monology/pile-uncopyrighted
layer_20/width_524k/average_l0_48 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	524288	1024	monology/pile-uncopyrighted
layer_20/width_524k/average_l0_78 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	524288	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_11 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_292 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_298 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_309 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_54 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_20/width_65k/average_l0_55 Load this SAE	jumprelu		blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_109 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_204 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_33 Load this SAE	jumprelu	gemma-2-9b/21-gemmascope-res-131k__l0-33	blocks.21.hook_resid_post	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_58 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_129 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_278 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_36 Load this SAE	jumprelu	gemma-2-9b/21-gemmascope-res-16k__l0-36	blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_66 Load this SAE	jumprelu		blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_105 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_197 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_32 Load this SAE	jumprelu	gemma-2-9b/22-gemmascope-res-131k__l0-32	blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_58 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_123 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_268 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_35 Load this SAE	jumprelu	gemma-2-9b/22-gemmascope-res-16k__l0-35	blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_65 Load this SAE	jumprelu		blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_101 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_187 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_32 Load this SAE	jumprelu	gemma-2-9b/23-gemmascope-res-131k__l0-32	blocks.23.hook_resid_post	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_56 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_120 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_248 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_35 Load this SAE	jumprelu	gemma-2-9b/23-gemmascope-res-16k__l0-35	blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_63 Load this SAE	jumprelu		blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_180 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_55 Load this SAE	jumprelu	gemma-2-9b/24-gemmascope-res-131k__l0-55	blocks.24.hook_resid_post	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_97 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_114 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_234 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/24-gemmascope-res-16k__l0-34	blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_61 Load this SAE	jumprelu		blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_177 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_31 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_54 Load this SAE	jumprelu	gemma-2-9b/25-gemmascope-res-131k__l0-54	blocks.25.hook_resid_post	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_96 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_114 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_231 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/25-gemmascope-res-16k__l0-34	blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_61 Load this SAE	jumprelu		blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.26.hook_resid_post	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_176 Load this SAE	jumprelu		blocks.26.hook_resid_post	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.26.hook_resid_post	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_32 Load this SAE	jumprelu	gemma-2-9b/26-gemmascope-res-131k__l0-32	blocks.26.hook_resid_post	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_55 Load this SAE	jumprelu		blocks.26.hook_resid_post	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_97 Load this SAE	jumprelu		blocks.26.hook_resid_post	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.26.hook_resid_post	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_116 Load this SAE	jumprelu		blocks.26.hook_resid_post	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.26.hook_resid_post	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_233 Load this SAE	jumprelu		blocks.26.hook_resid_post	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_35 Load this SAE	jumprelu	gemma-2-9b/26-gemmascope-res-16k__l0-35	blocks.26.hook_resid_post	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_63 Load this SAE	jumprelu		blocks.26.hook_resid_post	26	16384	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.27.hook_resid_post	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_171 Load this SAE	jumprelu		blocks.27.hook_resid_post	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.27.hook_resid_post	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_33 Load this SAE	jumprelu	gemma-2-9b/27-gemmascope-res-131k__l0-33	blocks.27.hook_resid_post	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_56 Load this SAE	jumprelu		blocks.27.hook_resid_post	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_96 Load this SAE	jumprelu		blocks.27.hook_resid_post	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_118 Load this SAE	jumprelu		blocks.27.hook_resid_post	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.27.hook_resid_post	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.27.hook_resid_post	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_230 Load this SAE	jumprelu		blocks.27.hook_resid_post	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_36 Load this SAE	jumprelu	gemma-2-9b/27-gemmascope-res-16k__l0-36	blocks.27.hook_resid_post	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_65 Load this SAE	jumprelu		blocks.27.hook_resid_post	27	16384	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.28.hook_resid_post	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_171 Load this SAE	jumprelu		blocks.28.hook_resid_post	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.28.hook_resid_post	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_32 Load this SAE	jumprelu	gemma-2-9b/28-gemmascope-res-131k__l0-32	blocks.28.hook_resid_post	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_57 Load this SAE	jumprelu		blocks.28.hook_resid_post	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_98 Load this SAE	jumprelu		blocks.28.hook_resid_post	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_119 Load this SAE	jumprelu		blocks.28.hook_resid_post	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.28.hook_resid_post	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.28.hook_resid_post	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_229 Load this SAE	jumprelu		blocks.28.hook_resid_post	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_37 Load this SAE	jumprelu	gemma-2-9b/28-gemmascope-res-16k__l0-37	blocks.28.hook_resid_post	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_65 Load this SAE	jumprelu		blocks.28.hook_resid_post	28	16384	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.29.hook_resid_post	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_171 Load this SAE	jumprelu		blocks.29.hook_resid_post	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.29.hook_resid_post	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_33 Load this SAE	jumprelu	gemma-2-9b/29-gemmascope-res-131k__l0-33	blocks.29.hook_resid_post	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_56 Load this SAE	jumprelu		blocks.29.hook_resid_post	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_97 Load this SAE	jumprelu		blocks.29.hook_resid_post	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_119 Load this SAE	jumprelu		blocks.29.hook_resid_post	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.29.hook_resid_post	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.29.hook_resid_post	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_224 Load this SAE	jumprelu		blocks.29.hook_resid_post	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_38 Load this SAE	jumprelu	gemma-2-9b/29-gemmascope-res-16k__l0-38	blocks.29.hook_resid_post	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_66 Load this SAE	jumprelu		blocks.29.hook_resid_post	29	16384	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_103 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_14 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_25 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_46 Load this SAE	jumprelu	gemma-2-9b/3-gemmascope-res-131k__l0-46	blocks.3.hook_resid_post	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_6 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_9 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_17 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_229 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_37 Load this SAE	jumprelu	gemma-2-9b/3-gemmascope-res-16k__l0-37	blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_90 Load this SAE	jumprelu		blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.30.hook_resid_post	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_170 Load this SAE	jumprelu		blocks.30.hook_resid_post	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.30.hook_resid_post	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_32 Load this SAE	jumprelu	gemma-2-9b/30-gemmascope-res-131k__l0-32	blocks.30.hook_resid_post	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_56 Load this SAE	jumprelu		blocks.30.hook_resid_post	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_95 Load this SAE	jumprelu		blocks.30.hook_resid_post	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.30.hook_resid_post	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_120 Load this SAE	jumprelu		blocks.30.hook_resid_post	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.30.hook_resid_post	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_226 Load this SAE	jumprelu		blocks.30.hook_resid_post	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_37 Load this SAE	jumprelu	gemma-2-9b/30-gemmascope-res-16k__l0-37	blocks.30.hook_resid_post	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_66 Load this SAE	jumprelu		blocks.30.hook_resid_post	30	16384	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_10 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-131k__l0-10	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_160 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-131k__l0-160	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_18 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-131k__l0-18	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_31 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-131k__l0-31	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_52 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-131k__l0-52	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_92 Load this SAE	jumprelu		blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_11 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-16k__l0-11	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_114 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-16k__l0-114	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_20 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-16k__l0-20	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_218 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-16k__l0-218	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_35 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-16k__l0-35	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_63 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-16k__l0-63	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_1m/average_l0_11 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-1m__l0-11	blocks.31.hook_resid_post	31	1048576	1024	monology/pile-uncopyrighted
layer_31/width_1m/average_l0_132 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-1m__l0-132	blocks.31.hook_resid_post	31	1048576	1024	monology/pile-uncopyrighted
layer_31/width_1m/average_l0_25 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-1m__l0-25	blocks.31.hook_resid_post	31	1048576	1024	monology/pile-uncopyrighted
layer_31/width_1m/average_l0_27 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-1m__l0-27	blocks.31.hook_resid_post	31	1048576	1024	monology/pile-uncopyrighted
layer_31/width_1m/average_l0_45 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-1m__l0-45	blocks.31.hook_resid_post	31	1048576	1024	monology/pile-uncopyrighted
layer_31/width_1m/average_l0_77 Load this SAE	jumprelu		blocks.31.hook_resid_post	31	1048576	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.32.hook_resid_post	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_158 Load this SAE	jumprelu		blocks.32.hook_resid_post	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.32.hook_resid_post	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.32.hook_resid_post	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/32-gemmascope-res-131k__l0-51	blocks.32.hook_resid_post	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_88 Load this SAE	jumprelu		blocks.32.hook_resid_post	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.32.hook_resid_post	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_111 Load this SAE	jumprelu		blocks.32.hook_resid_post	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.32.hook_resid_post	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_219 Load this SAE	jumprelu		blocks.32.hook_resid_post	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/32-gemmascope-res-16k__l0-34	blocks.32.hook_resid_post	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_61 Load this SAE	jumprelu		blocks.32.hook_resid_post	32	16384	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.33.hook_resid_post	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_165 Load this SAE	jumprelu		blocks.33.hook_resid_post	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.33.hook_resid_post	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.33.hook_resid_post	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/33-gemmascope-res-131k__l0-51	blocks.33.hook_resid_post	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_91 Load this SAE	jumprelu		blocks.33.hook_resid_post	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.33.hook_resid_post	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_114 Load this SAE	jumprelu		blocks.33.hook_resid_post	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.33.hook_resid_post	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_228 Load this SAE	jumprelu		blocks.33.hook_resid_post	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/33-gemmascope-res-16k__l0-34	blocks.33.hook_resid_post	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_63 Load this SAE	jumprelu		blocks.33.hook_resid_post	33	16384	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_163 Load this SAE	jumprelu		blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/34-gemmascope-res-131k__l0-51	blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_89 Load this SAE	jumprelu		blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.34.hook_resid_post	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_114 Load this SAE	jumprelu		blocks.34.hook_resid_post	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.34.hook_resid_post	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_229 Load this SAE	jumprelu		blocks.34.hook_resid_post	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/34-gemmascope-res-16k__l0-34	blocks.34.hook_resid_post	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_60 Load this SAE	jumprelu		blocks.34.hook_resid_post	34	16384	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.35.hook_resid_post	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.35.hook_resid_post	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_171 Load this SAE	jumprelu		blocks.35.hook_resid_post	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.35.hook_resid_post	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/35-gemmascope-res-131k__l0-51	blocks.35.hook_resid_post	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_94 Load this SAE	jumprelu		blocks.35.hook_resid_post	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.35.hook_resid_post	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_120 Load this SAE	jumprelu		blocks.35.hook_resid_post	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.35.hook_resid_post	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_246 Load this SAE	jumprelu		blocks.35.hook_resid_post	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/35-gemmascope-res-16k__l0-34	blocks.35.hook_resid_post	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_61 Load this SAE	jumprelu		blocks.35.hook_resid_post	35	16384	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.36.hook_resid_post	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.36.hook_resid_post	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_180 Load this SAE	jumprelu		blocks.36.hook_resid_post	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.36.hook_resid_post	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/36-gemmascope-res-131k__l0-51	blocks.36.hook_resid_post	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_93 Load this SAE	jumprelu		blocks.36.hook_resid_post	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.36.hook_resid_post	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_120 Load this SAE	jumprelu		blocks.36.hook_resid_post	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.36.hook_resid_post	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_252 Load this SAE	jumprelu		blocks.36.hook_resid_post	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/36-gemmascope-res-16k__l0-34	blocks.36.hook_resid_post	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_61 Load this SAE	jumprelu		blocks.36.hook_resid_post	36	16384	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.37.hook_resid_post	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.37.hook_resid_post	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_184 Load this SAE	jumprelu		blocks.37.hook_resid_post	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.37.hook_resid_post	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_53 Load this SAE	jumprelu	gemma-2-9b/37-gemmascope-res-131k__l0-53	blocks.37.hook_resid_post	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_96 Load this SAE	jumprelu		blocks.37.hook_resid_post	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.37.hook_resid_post	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_124 Load this SAE	jumprelu		blocks.37.hook_resid_post	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.37.hook_resid_post	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_266 Load this SAE	jumprelu		blocks.37.hook_resid_post	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/37-gemmascope-res-16k__l0-34	blocks.37.hook_resid_post	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_63 Load this SAE	jumprelu		blocks.37.hook_resid_post	37	16384	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.38.hook_resid_post	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_101 Load this SAE	jumprelu		blocks.38.hook_resid_post	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.38.hook_resid_post	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_194 Load this SAE	jumprelu		blocks.38.hook_resid_post	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.38.hook_resid_post	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_53 Load this SAE	jumprelu	gemma-2-9b/38-gemmascope-res-131k__l0-53	blocks.38.hook_resid_post	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.38.hook_resid_post	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_128 Load this SAE	jumprelu		blocks.38.hook_resid_post	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.38.hook_resid_post	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_286 Load this SAE	jumprelu		blocks.38.hook_resid_post	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/38-gemmascope-res-16k__l0-34	blocks.38.hook_resid_post	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_64 Load this SAE	jumprelu		blocks.38.hook_resid_post	38	16384	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.39.hook_resid_post	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.39.hook_resid_post	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_199 Load this SAE	jumprelu		blocks.39.hook_resid_post	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.39.hook_resid_post	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_54 Load this SAE	jumprelu	gemma-2-9b/39-gemmascope-res-131k__l0-54	blocks.39.hook_resid_post	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_99 Load this SAE	jumprelu		blocks.39.hook_resid_post	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.39.hook_resid_post	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_131 Load this SAE	jumprelu		blocks.39.hook_resid_post	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.39.hook_resid_post	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_298 Load this SAE	jumprelu		blocks.39.hook_resid_post	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/39-gemmascope-res-16k__l0-34	blocks.39.hook_resid_post	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_64 Load this SAE	jumprelu		blocks.39.hook_resid_post	39	16384	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_101 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_16 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_28 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/4-gemmascope-res-131k__l0-51	blocks.4.hook_resid_post	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_6 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_9 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_18 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_234 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_37 Load this SAE	jumprelu	gemma-2-9b/4-gemmascope-res-16k__l0-37	blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_91 Load this SAE	jumprelu		blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.40.hook_resid_post	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.40.hook_resid_post	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_193 Load this SAE	jumprelu		blocks.40.hook_resid_post	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_29 Load this SAE	jumprelu		blocks.40.hook_resid_post	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_49 Load this SAE	jumprelu	gemma-2-9b/40-gemmascope-res-131k__l0-49	blocks.40.hook_resid_post	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_94 Load this SAE	jumprelu		blocks.40.hook_resid_post	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.40.hook_resid_post	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_125 Load this SAE	jumprelu		blocks.40.hook_resid_post	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_18 Load this SAE	jumprelu		blocks.40.hook_resid_post	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_292 Load this SAE	jumprelu		blocks.40.hook_resid_post	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_32 Load this SAE	jumprelu	gemma-2-9b/40-gemmascope-res-16k__l0-32	blocks.40.hook_resid_post	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_61 Load this SAE	jumprelu		blocks.40.hook_resid_post	40	16384	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.41.hook_resid_post	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_15 Load this SAE	jumprelu		blocks.41.hook_resid_post	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_175 Load this SAE	jumprelu		blocks.41.hook_resid_post	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_26 Load this SAE	jumprelu		blocks.41.hook_resid_post	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_45 Load this SAE	jumprelu	gemma-2-9b/41-gemmascope-res-131k__l0-45	blocks.41.hook_resid_post	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_84 Load this SAE	jumprelu		blocks.41.hook_resid_post	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.41.hook_resid_post	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_113 Load this SAE	jumprelu		blocks.41.hook_resid_post	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_16 Load this SAE	jumprelu		blocks.41.hook_resid_post	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_270 Load this SAE	jumprelu		blocks.41.hook_resid_post	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_28 Load this SAE	jumprelu		blocks.41.hook_resid_post	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_52 Load this SAE	jumprelu	gemma-2-9b/41-gemmascope-res-16k__l0-52	blocks.41.hook_resid_post	41	16384	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_16 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_29 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/5-gemmascope-res-131k__l0-51	blocks.5.hook_resid_post	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_6 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_94 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_193 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_37 Load this SAE	jumprelu	gemma-2-9b/5-gemmascope-res-16k__l0-37	blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_77 Load this SAE	jumprelu		blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_120 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_21 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_36 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_66 Load this SAE	jumprelu	gemma-2-9b/6-gemmascope-res-131k__l0-66	blocks.6.hook_resid_post	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_7 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_14 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_224 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_25 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_47 Load this SAE	jumprelu	gemma-2-9b/6-gemmascope-res-16k__l0-47	blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_8 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_93 Load this SAE	jumprelu		blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_119 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_13 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_21 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_38 Load this SAE	jumprelu	gemma-2-9b/7-gemmascope-res-131k__l0-38	blocks.7.hook_resid_post	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_65 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_8 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_14 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_198 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_25 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_46 Load this SAE	jumprelu	gemma-2-9b/7-gemmascope-res-16k__l0-46	blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_8 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_92 Load this SAE	jumprelu		blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_129 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_14 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_24 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_41 Load this SAE	jumprelu	gemma-2-9b/8-gemmascope-res-131k__l0-41	blocks.8.hook_resid_post	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_72 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_8 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_16 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_207 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_28 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/8-gemmascope-res-16k__l0-51	blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_9 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_99 Load this SAE	jumprelu		blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_134 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-131k__l0-134	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_14 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-131k__l0-14	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_25 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-131k__l0-25	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_42 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-131k__l0-42	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_75 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_8 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-131k__l0-8	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_100 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_16 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-16k__l0-16	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_209 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-16k__l0-209	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_28 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-16k__l0-28	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-16k__l0-51	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_9 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-16k__l0-9	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_1m/average_l0_122 Load this SAE	jumprelu		blocks.9.hook_resid_post	9	1048576	1024	monology/pile-uncopyrighted
layer_9/width_1m/average_l0_14 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-1m__l0-14	blocks.9.hook_resid_post	9	1048576	1024	monology/pile-uncopyrighted
layer_9/width_1m/average_l0_24 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-1m__l0-24	blocks.9.hook_resid_post	9	1048576	1024	monology/pile-uncopyrighted
layer_9/width_1m/average_l0_41 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-1m__l0-41	blocks.9.hook_resid_post	9	1048576	1024	monology/pile-uncopyrighted
layer_9/width_1m/average_l0_70 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-1m__l0-70	blocks.9.hook_resid_post	9	1048576	1024	monology/pile-uncopyrighted
layer_9/width_1m/average_l0_9 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-1m__l0-9	blocks.9.hook_resid_post	9	1048576	1024	monology/pile-uncopyrighted

gemma-scope-9b-pt-res-canonical

Huggingface Repo: google/gemma-scope-9b-pt-res
model: gemma-2-9b

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_0/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/0-gemmascope-res-16k	blocks.0.hook_resid_post	0	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/1-gemmascope-res-16k	blocks.1.hook_resid_post	1	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/2-gemmascope-res-16k	blocks.2.hook_resid_post	2	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/3-gemmascope-res-16k	blocks.3.hook_resid_post	3	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/4-gemmascope-res-16k	blocks.4.hook_resid_post	4	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/5-gemmascope-res-16k	blocks.5.hook_resid_post	5	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/6-gemmascope-res-16k	blocks.6.hook_resid_post	6	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/7-gemmascope-res-16k	blocks.7.hook_resid_post	7	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/8-gemmascope-res-16k	blocks.8.hook_resid_post	8	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-16k	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/10-gemmascope-res-16k	blocks.10.hook_resid_post	10	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/11-gemmascope-res-16k	blocks.11.hook_resid_post	11	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/12-gemmascope-res-16k	blocks.12.hook_resid_post	12	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/13-gemmascope-res-16k	blocks.13.hook_resid_post	13	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/14-gemmascope-res-16k	blocks.14.hook_resid_post	14	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/15-gemmascope-res-16k	blocks.15.hook_resid_post	15	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/16-gemmascope-res-16k	blocks.16.hook_resid_post	16	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/17-gemmascope-res-16k	blocks.17.hook_resid_post	17	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/18-gemmascope-res-16k	blocks.18.hook_resid_post	18	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/19-gemmascope-res-16k	blocks.19.hook_resid_post	19	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-16k	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/21-gemmascope-res-16k	blocks.21.hook_resid_post	21	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/22-gemmascope-res-16k	blocks.22.hook_resid_post	22	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/23-gemmascope-res-16k	blocks.23.hook_resid_post	23	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/24-gemmascope-res-16k	blocks.24.hook_resid_post	24	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/25-gemmascope-res-16k	blocks.25.hook_resid_post	25	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/26-gemmascope-res-16k	blocks.26.hook_resid_post	26	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/27-gemmascope-res-16k	blocks.27.hook_resid_post	27	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/28-gemmascope-res-16k	blocks.28.hook_resid_post	28	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/29-gemmascope-res-16k	blocks.29.hook_resid_post	29	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/30-gemmascope-res-16k	blocks.30.hook_resid_post	30	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-16k	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/32-gemmascope-res-16k	blocks.32.hook_resid_post	32	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/33-gemmascope-res-16k	blocks.33.hook_resid_post	33	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/34-gemmascope-res-16k	blocks.34.hook_resid_post	34	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/35-gemmascope-res-16k	blocks.35.hook_resid_post	35	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/36-gemmascope-res-16k	blocks.36.hook_resid_post	36	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/37-gemmascope-res-16k	blocks.37.hook_resid_post	37	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/38-gemmascope-res-16k	blocks.38.hook_resid_post	38	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/39-gemmascope-res-16k	blocks.39.hook_resid_post	39	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/40-gemmascope-res-16k	blocks.40.hook_resid_post	40	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/41-gemmascope-res-16k	blocks.41.hook_resid_post	41	16384	1024	monology/pile-uncopyrighted
layer_0/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/0-gemmascope-res-131k	blocks.0.hook_resid_post	0	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/1-gemmascope-res-131k	blocks.1.hook_resid_post	1	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/2-gemmascope-res-131k	blocks.2.hook_resid_post	2	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/3-gemmascope-res-131k	blocks.3.hook_resid_post	3	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/4-gemmascope-res-131k	blocks.4.hook_resid_post	4	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/5-gemmascope-res-131k	blocks.5.hook_resid_post	5	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/6-gemmascope-res-131k	blocks.6.hook_resid_post	6	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/7-gemmascope-res-131k	blocks.7.hook_resid_post	7	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/8-gemmascope-res-131k	blocks.8.hook_resid_post	8	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-131k	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/10-gemmascope-res-131k	blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/11-gemmascope-res-131k	blocks.11.hook_resid_post	11	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/12-gemmascope-res-131k	blocks.12.hook_resid_post	12	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/13-gemmascope-res-131k	blocks.13.hook_resid_post	13	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/14-gemmascope-res-131k	blocks.14.hook_resid_post	14	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/15-gemmascope-res-131k	blocks.15.hook_resid_post	15	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/16-gemmascope-res-131k	blocks.16.hook_resid_post	16	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/17-gemmascope-res-131k	blocks.17.hook_resid_post	17	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/18-gemmascope-res-131k	blocks.18.hook_resid_post	18	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/19-gemmascope-res-131k	blocks.19.hook_resid_post	19	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-131k	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/21-gemmascope-res-131k	blocks.21.hook_resid_post	21	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/22-gemmascope-res-131k	blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/23-gemmascope-res-131k	blocks.23.hook_resid_post	23	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/24-gemmascope-res-131k	blocks.24.hook_resid_post	24	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/25-gemmascope-res-131k	blocks.25.hook_resid_post	25	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/26-gemmascope-res-131k	blocks.26.hook_resid_post	26	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/27-gemmascope-res-131k	blocks.27.hook_resid_post	27	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/28-gemmascope-res-131k	blocks.28.hook_resid_post	28	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/29-gemmascope-res-131k	blocks.29.hook_resid_post	29	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/30-gemmascope-res-131k	blocks.30.hook_resid_post	30	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-131k	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/32-gemmascope-res-131k	blocks.32.hook_resid_post	32	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/33-gemmascope-res-131k	blocks.33.hook_resid_post	33	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/34-gemmascope-res-131k	blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/35-gemmascope-res-131k	blocks.35.hook_resid_post	35	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/36-gemmascope-res-131k	blocks.36.hook_resid_post	36	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/37-gemmascope-res-131k	blocks.37.hook_resid_post	37	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/38-gemmascope-res-131k	blocks.38.hook_resid_post	38	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/39-gemmascope-res-131k	blocks.39.hook_resid_post	39	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/40-gemmascope-res-131k	blocks.40.hook_resid_post	40	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/41-gemmascope-res-131k	blocks.41.hook_resid_post	41	131072	1024	monology/pile-uncopyrighted
layer_9/width_1m/canonical Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-res-1m	blocks.9.hook_resid_post	9	1048576	1024	monology/pile-uncopyrighted
layer_20/width_1m/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-1m	blocks.20.hook_resid_post	20	1048576	1024	monology/pile-uncopyrighted
layer_31/width_1m/canonical Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-res-1m	blocks.31.hook_resid_post	31	1048576	1024	monology/pile-uncopyrighted
layer_20/width_262k/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-262k	blocks.20.hook_resid_post	20	262144	1024	monology/pile-uncopyrighted
layer_20/width_32k/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-32k	blocks.20.hook_resid_post	20	32768	1024	monology/pile-uncopyrighted
layer_20/width_524k/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-524k	blocks.20.hook_resid_post	20	524288	1024	monology/pile-uncopyrighted
layer_20/width_65k/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-res-65k	blocks.20.hook_resid_post	20	65536	1024	monology/pile-uncopyrighted

gemma-scope-9b-pt-att

Huggingface Repo: google/gemma-scope-9b-pt-att
model: gemma-2-9b

id	architecture	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_0/width_16k/average_l0_12 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_16 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_25 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_38 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_61 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_8 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_11 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_15 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_22 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_33 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_55 Load this SAE	jumprelu	blocks.0.attn.hook_z	0	131072	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_17 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_34 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_77 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_147 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_266 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_8 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_12 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_18 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_29 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_63 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_116 Load this SAE	jumprelu	blocks.1.attn.hook_z	1	131072	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_33 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_63 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_132 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_301 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_16 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_28 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_51 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_97 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_199 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_440 Load this SAE	jumprelu	blocks.10.attn.hook_z	10	131072	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_34 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_67 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_153 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_366 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_17 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_29 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_54 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_104 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_241 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_552 Load this SAE	jumprelu	blocks.11.attn.hook_z	11	131072	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_19 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_35 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_68 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_149 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_337 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_654 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_17 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_29 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_55 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_110 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_237 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_525 Load this SAE	jumprelu	blocks.12.attn.hook_z	12	131072	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_20 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_38 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_77 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_170 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_380 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_675 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_18 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_33 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_64 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_126 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_283 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_611 Load this SAE	jumprelu	blocks.13.attn.hook_z	13	131072	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_21 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_40 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_81 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_179 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_411 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_767 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_18 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_35 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_67 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_131 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_306 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_650 Load this SAE	jumprelu	blocks.14.attn.hook_z	14	131072	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_21 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_40 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_79 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_168 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_344 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_638 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_19 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_35 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_67 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_130 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_283 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_540 Load this SAE	jumprelu	blocks.15.attn.hook_z	15	131072	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_21 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_40 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_81 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_172 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_376 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_705 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_19 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_36 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_71 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_140 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_298 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_621 Load this SAE	jumprelu	blocks.16.attn.hook_z	16	131072	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_24 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_50 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_110 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_227 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_435 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_719 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_22 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_44 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_90 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_191 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_380 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_672 Load this SAE	jumprelu	blocks.17.attn.hook_z	17	131072	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_21 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_40 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_80 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_171 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_352 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_646 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_19 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_35 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_69 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_133 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_294 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_557 Load this SAE	jumprelu	blocks.18.attn.hook_z	18	131072	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_21 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_41 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_86 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_186 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_360 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_661 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_19 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_38 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_71 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_152 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_307 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_571 Load this SAE	jumprelu	blocks.19.attn.hook_z	19	131072	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_15 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_30 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_69 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_180 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_384 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_7 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_11 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_18 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_32 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_62 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_135 Load this SAE	jumprelu	blocks.2.attn.hook_z	2	131072	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_20 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_39 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_76 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_158 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_342 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_674 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_18 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_34 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_65 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_125 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_270 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_558 Load this SAE	jumprelu	blocks.20.attn.hook_z	20	131072	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_21 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_41 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_86 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_195 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_420 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_792 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_18 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_35 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_71 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_150 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_333 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_665 Load this SAE	jumprelu	blocks.21.attn.hook_z	21	131072	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_20 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_36 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_70 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_141 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_289 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_569 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_17 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_32 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_59 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_115 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_231 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_446 Load this SAE	jumprelu	blocks.22.attn.hook_z	22	131072	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_21 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_41 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_80 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_173 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_356 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_649 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_19 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_36 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_66 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_134 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_288 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_568 Load this SAE	jumprelu	blocks.23.attn.hook_z	23	131072	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_21 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_40 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_79 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_167 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_348 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_615 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_19 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_35 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_66 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_130 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_273 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_542 Load this SAE	jumprelu	blocks.24.attn.hook_z	24	131072	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_19 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_36 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_73 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_156 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_371 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_686 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_17 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_31 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_59 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_115 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_261 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_605 Load this SAE	jumprelu	blocks.25.attn.hook_z	25	131072	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_20 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_38 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_75 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_159 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_336 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_634 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_18 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_32 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_62 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_120 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_267 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_525 Load this SAE	jumprelu	blocks.26.attn.hook_z	26	131072	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_33 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_64 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_136 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_306 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_613 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_16 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_28 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_53 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_102 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_211 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_458 Load this SAE	jumprelu	blocks.27.attn.hook_z	27	131072	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_20 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_37 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_71 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_143 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_279 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_498 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_19 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_32 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_59 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_115 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_230 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_452 Load this SAE	jumprelu	blocks.28.attn.hook_z	28	131072	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_35 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_76 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_171 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_308 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_559 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_17 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_30 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_57 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_128 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_265 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_446 Load this SAE	jumprelu	blocks.29.attn.hook_z	29	131072	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_23 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_44 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_102 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_221 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_435 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_10 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_17 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_31 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_58 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_119 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_252 Load this SAE	jumprelu	blocks.3.attn.hook_z	3	131072	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_19 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_36 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_73 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_157 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_313 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_558 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_17 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_29 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_55 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_109 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_236 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_491 Load this SAE	jumprelu	blocks.30.attn.hook_z	30	131072	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_36 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_73 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_168 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_356 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_630 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_16 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_29 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_56 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_117 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_265 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_543 Load this SAE	jumprelu	blocks.31.attn.hook_z	31	131072	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_35 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_74 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_158 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_306 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_534 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_16 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_31 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_56 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_117 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_248 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_464 Load this SAE	jumprelu	blocks.32.attn.hook_z	32	131072	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_17 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_37 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_78 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_158 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_318 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_531 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_16 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_28 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_58 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_128 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_248 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_471 Load this SAE	jumprelu	blocks.33.attn.hook_z	33	131072	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_17 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_38 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_91 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_192 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_339 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_527 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_15 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_29 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_63 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_199 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_291 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_483 Load this SAE	jumprelu	blocks.34.attn.hook_z	34	131072	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_14 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_33 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_77 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_168 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_303 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_488 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_13 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_26 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_54 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_124 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_258 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_427 Load this SAE	jumprelu	blocks.35.attn.hook_z	35	131072	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_15 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_32 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_69 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_144 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_293 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_544 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_16 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_26 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_51 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_105 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_229 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_455 Load this SAE	jumprelu	blocks.36.attn.hook_z	36	131072	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_17 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_34 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_82 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_172 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_309 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_519 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_15 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_28 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_55 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_124 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_248 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_450 Load this SAE	jumprelu	blocks.37.attn.hook_z	37	131072	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_36 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_81 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_175 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_334 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_547 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_17 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_30 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_60 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_135 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_284 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_489 Load this SAE	jumprelu	blocks.38.attn.hook_z	38	131072	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_15 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_33 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_77 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_176 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_391 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_694 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_17 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_27 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_54 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_120 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_273 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_604 Load this SAE	jumprelu	blocks.39.attn.hook_z	39	131072	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_26 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_54 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_126 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_274 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_524 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_12 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_21 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_38 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_75 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_163 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_330 Load this SAE	jumprelu	blocks.4.attn.hook_z	4	131072	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_38 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_91 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_189 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_341 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_603 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_16 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_30 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_64 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_144 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_269 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_493 Load this SAE	jumprelu	blocks.40.attn.hook_z	40	131072	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_13 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_25 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_56 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_129 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_254 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_450 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_13 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_22 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_43 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_92 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_202 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_370 Load this SAE	jumprelu	blocks.41.attn.hook_z	41	131072	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_25 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_53 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_125 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_270 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_529 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_12 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_21 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_39 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_78 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_160 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_351 Load this SAE	jumprelu	blocks.5.attn.hook_z	5	131072	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_16 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_28 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_51 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_108 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_258 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_14 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_24 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_41 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_73 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_148 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_353 Load this SAE	jumprelu	blocks.6.attn.hook_z	6	131072	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_33 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_70 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_160 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_335 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_16 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_28 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_52 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_106 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_229 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_473 Load this SAE	jumprelu	blocks.7.attn.hook_z	7	131072	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_17 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_32 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_65 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_150 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_362 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_16 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_27 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_51 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_98 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_222 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_531 Load this SAE	jumprelu	blocks.8.attn.hook_z	8	131072	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_18 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_34 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_71 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_172 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_349 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_16 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_30 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_54 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_111 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_263 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_511 Load this SAE	jumprelu	blocks.9.attn.hook_z	9	131072	1024	monology/pile-uncopyrighted

gemma-scope-9b-pt-att-canonical

Huggingface Repo: google/gemma-scope-9b-pt-att
model: gemma-2-9b

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_0/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/0-gemmascope-att-16k	blocks.0.attn.hook_z	0	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/1-gemmascope-att-16k	blocks.1.attn.hook_z	1	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/2-gemmascope-att-16k	blocks.2.attn.hook_z	2	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/3-gemmascope-att-16k	blocks.3.attn.hook_z	3	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/4-gemmascope-att-16k	blocks.4.attn.hook_z	4	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/5-gemmascope-att-16k	blocks.5.attn.hook_z	5	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/6-gemmascope-att-16k	blocks.6.attn.hook_z	6	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/7-gemmascope-att-16k	blocks.7.attn.hook_z	7	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/8-gemmascope-att-16k	blocks.8.attn.hook_z	8	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-att-16k	blocks.9.attn.hook_z	9	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/10-gemmascope-att-16k	blocks.10.attn.hook_z	10	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/11-gemmascope-att-16k	blocks.11.attn.hook_z	11	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/12-gemmascope-att-16k	blocks.12.attn.hook_z	12	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/13-gemmascope-att-16k	blocks.13.attn.hook_z	13	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/14-gemmascope-att-16k	blocks.14.attn.hook_z	14	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/15-gemmascope-att-16k	blocks.15.attn.hook_z	15	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/16-gemmascope-att-16k	blocks.16.attn.hook_z	16	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/17-gemmascope-att-16k	blocks.17.attn.hook_z	17	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/18-gemmascope-att-16k	blocks.18.attn.hook_z	18	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/19-gemmascope-att-16k	blocks.19.attn.hook_z	19	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-att-16k	blocks.20.attn.hook_z	20	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/21-gemmascope-att-16k	blocks.21.attn.hook_z	21	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/22-gemmascope-att-16k	blocks.22.attn.hook_z	22	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/23-gemmascope-att-16k	blocks.23.attn.hook_z	23	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/24-gemmascope-att-16k	blocks.24.attn.hook_z	24	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/25-gemmascope-att-16k	blocks.25.attn.hook_z	25	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/26-gemmascope-att-16k	blocks.26.attn.hook_z	26	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/27-gemmascope-att-16k	blocks.27.attn.hook_z	27	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/28-gemmascope-att-16k	blocks.28.attn.hook_z	28	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/29-gemmascope-att-16k	blocks.29.attn.hook_z	29	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/30-gemmascope-att-16k	blocks.30.attn.hook_z	30	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-att-16k	blocks.31.attn.hook_z	31	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/32-gemmascope-att-16k	blocks.32.attn.hook_z	32	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/33-gemmascope-att-16k	blocks.33.attn.hook_z	33	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/34-gemmascope-att-16k	blocks.34.attn.hook_z	34	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/35-gemmascope-att-16k	blocks.35.attn.hook_z	35	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/36-gemmascope-att-16k	blocks.36.attn.hook_z	36	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/37-gemmascope-att-16k	blocks.37.attn.hook_z	37	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/38-gemmascope-att-16k	blocks.38.attn.hook_z	38	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/39-gemmascope-att-16k	blocks.39.attn.hook_z	39	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/40-gemmascope-att-16k	blocks.40.attn.hook_z	40	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/41-gemmascope-att-16k	blocks.41.attn.hook_z	41	16384	1024	monology/pile-uncopyrighted
layer_0/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/0-gemmascope-att-131k	blocks.0.attn.hook_z	0	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/1-gemmascope-att-131k	blocks.1.attn.hook_z	1	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/2-gemmascope-att-131k	blocks.2.attn.hook_z	2	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/3-gemmascope-att-131k	blocks.3.attn.hook_z	3	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/4-gemmascope-att-131k	blocks.4.attn.hook_z	4	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/5-gemmascope-att-131k	blocks.5.attn.hook_z	5	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/6-gemmascope-att-131k	blocks.6.attn.hook_z	6	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/7-gemmascope-att-131k	blocks.7.attn.hook_z	7	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/8-gemmascope-att-131k	blocks.8.attn.hook_z	8	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-att-131k	blocks.9.attn.hook_z	9	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/10-gemmascope-att-131k	blocks.10.attn.hook_z	10	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/11-gemmascope-att-131k	blocks.11.attn.hook_z	11	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/12-gemmascope-att-131k	blocks.12.attn.hook_z	12	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/13-gemmascope-att-131k	blocks.13.attn.hook_z	13	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/14-gemmascope-att-131k	blocks.14.attn.hook_z	14	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/15-gemmascope-att-131k	blocks.15.attn.hook_z	15	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/16-gemmascope-att-131k	blocks.16.attn.hook_z	16	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/17-gemmascope-att-131k	blocks.17.attn.hook_z	17	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/18-gemmascope-att-131k	blocks.18.attn.hook_z	18	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/19-gemmascope-att-131k	blocks.19.attn.hook_z	19	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-att-131k	blocks.20.attn.hook_z	20	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/21-gemmascope-att-131k	blocks.21.attn.hook_z	21	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/22-gemmascope-att-131k	blocks.22.attn.hook_z	22	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/23-gemmascope-att-131k	blocks.23.attn.hook_z	23	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/24-gemmascope-att-131k	blocks.24.attn.hook_z	24	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/25-gemmascope-att-131k	blocks.25.attn.hook_z	25	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/26-gemmascope-att-131k	blocks.26.attn.hook_z	26	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/27-gemmascope-att-131k	blocks.27.attn.hook_z	27	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/28-gemmascope-att-131k	blocks.28.attn.hook_z	28	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/29-gemmascope-att-131k	blocks.29.attn.hook_z	29	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/30-gemmascope-att-131k	blocks.30.attn.hook_z	30	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-att-131k	blocks.31.attn.hook_z	31	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/32-gemmascope-att-131k	blocks.32.attn.hook_z	32	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/33-gemmascope-att-131k	blocks.33.attn.hook_z	33	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/34-gemmascope-att-131k	blocks.34.attn.hook_z	34	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/35-gemmascope-att-131k	blocks.35.attn.hook_z	35	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/36-gemmascope-att-131k	blocks.36.attn.hook_z	36	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/37-gemmascope-att-131k	blocks.37.attn.hook_z	37	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/38-gemmascope-att-131k	blocks.38.attn.hook_z	38	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/39-gemmascope-att-131k	blocks.39.attn.hook_z	39	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/40-gemmascope-att-131k	blocks.40.attn.hook_z	40	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/41-gemmascope-att-131k	blocks.41.attn.hook_z	41	131072	1024	monology/pile-uncopyrighted

gemma-scope-9b-pt-mlp

Huggingface Repo: google/gemma-scope-9b-pt-mlp
model: gemma-2-9b

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_0/width_16k/average_l0_6 Load this SAE	jumprelu		blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_16 Load this SAE	jumprelu		blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_28 Load this SAE	jumprelu		blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_16k/average_l0_50 Load this SAE	jumprelu	gemma-2-9b/0-gemmascope-mlp-16k__l0-50	blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_3 Load this SAE	jumprelu		blocks.0.hook_mlp_out	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_5 Load this SAE	jumprelu		blocks.0.hook_mlp_out	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_7 Load this SAE	jumprelu		blocks.0.hook_mlp_out	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.0.hook_mlp_out	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.0.hook_mlp_out	0	131072	1024	monology/pile-uncopyrighted
layer_0/width_131k/average_l0_30 Load this SAE	jumprelu		blocks.0.hook_mlp_out	0	131072	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_26 Load this SAE	jumprelu		blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_56 Load this SAE	jumprelu	gemma-2-9b/1-gemmascope-mlp-16k__l0-56	blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_128 Load this SAE	jumprelu		blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/average_l0_278 Load this SAE	jumprelu		blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_6 Load this SAE	jumprelu		blocks.1.hook_mlp_out	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.1.hook_mlp_out	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.1.hook_mlp_out	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_32 Load this SAE	jumprelu		blocks.1.hook_mlp_out	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_59 Load this SAE	jumprelu		blocks.1.hook_mlp_out	1	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/average_l0_106 Load this SAE	jumprelu		blocks.1.hook_mlp_out	1	131072	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_13 Load this SAE	jumprelu		blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_24 Load this SAE	jumprelu		blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_49 Load this SAE	jumprelu	gemma-2-9b/10-gemmascope-mlp-16k__l0-49	blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_114 Load this SAE	jumprelu		blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/average_l0_276 Load this SAE	jumprelu		blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.10.hook_mlp_out	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_22 Load this SAE	jumprelu		blocks.10.hook_mlp_out	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_42 Load this SAE	jumprelu		blocks.10.hook_mlp_out	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_83 Load this SAE	jumprelu		blocks.10.hook_mlp_out	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_167 Load this SAE	jumprelu		blocks.10.hook_mlp_out	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_362 Load this SAE	jumprelu		blocks.10.hook_mlp_out	10	131072	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_17 Load this SAE	jumprelu		blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/11-gemmascope-mlp-16k__l0-34	blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_76 Load this SAE	jumprelu		blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_180 Load this SAE	jumprelu		blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/average_l0_421 Load this SAE	jumprelu		blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.11.hook_mlp_out	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_31 Load this SAE	jumprelu		blocks.11.hook_mlp_out	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_60 Load this SAE	jumprelu		blocks.11.hook_mlp_out	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_120 Load this SAE	jumprelu		blocks.11.hook_mlp_out	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_259 Load this SAE	jumprelu		blocks.11.hook_mlp_out	11	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/average_l0_569 Load this SAE	jumprelu		blocks.11.hook_mlp_out	11	131072	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_42 Load this SAE	jumprelu	gemma-2-9b/12-gemmascope-mlp-16k__l0-42	blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_96 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_237 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_543 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/average_l0_1033 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_38 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_77 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_159 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_338 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/average_l0_745 Load this SAE	jumprelu		blocks.12.hook_mlp_out	12	131072	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_40 Load this SAE	jumprelu	gemma-2-9b/13-gemmascope-mlp-16k__l0-40	blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_94 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_225 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_512 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/average_l0_992 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_20 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_38 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_75 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_160 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_351 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/average_l0_703 Load this SAE	jumprelu		blocks.13.hook_mlp_out	13	131072	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_41 Load this SAE	jumprelu	gemma-2-9b/14-gemmascope-mlp-16k__l0-41	blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_97 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_236 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_538 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/average_l0_1023 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_20 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_40 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_80 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_174 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_374 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/average_l0_743 Load this SAE	jumprelu		blocks.14.hook_mlp_out	14	131072	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_20 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_45 Load this SAE	jumprelu	gemma-2-9b/15-gemmascope-mlp-16k__l0-45	blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_107 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_260 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_572 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/average_l0_1053 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_21 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_43 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_89 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_194 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_421 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/average_l0_828 Load this SAE	jumprelu		blocks.15.hook_mlp_out	15	131072	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_16 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_37 Load this SAE	jumprelu	gemma-2-9b/16-gemmascope-mlp-16k__l0-37	blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_91 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_221 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_489 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/average_l0_916 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_38 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_81 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_175 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_384 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/average_l0_744 Load this SAE	jumprelu		blocks.16.hook_mlp_out	16	131072	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_18 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_41 Load this SAE	jumprelu	gemma-2-9b/17-gemmascope-mlp-16k__l0-41	blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_104 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_274 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_624 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/average_l0_1137 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_22 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_43 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_91 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_207 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_483 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/average_l0_950 Load this SAE	jumprelu		blocks.17.hook_mlp_out	17	131072	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_16 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_36 Load this SAE	jumprelu	gemma-2-9b/18-gemmascope-mlp-16k__l0-36	blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_89 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_235 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_564 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/average_l0_1052 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_37 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_82 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_174 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_420 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/average_l0_865 Load this SAE	jumprelu		blocks.18.hook_mlp_out	18	131072	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_16 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_38 Load this SAE	jumprelu	gemma-2-9b/19-gemmascope-mlp-16k__l0-38	blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_98 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_255 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_599 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/average_l0_1097 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_40 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_85 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_189 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_440 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/average_l0_899 Load this SAE	jumprelu		blocks.19.hook_mlp_out	19	131072	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_8 Load this SAE	jumprelu		blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_16 Load this SAE	jumprelu		blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_33 Load this SAE	jumprelu	gemma-2-9b/2-gemmascope-mlp-16k__l0-33	blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_81 Load this SAE	jumprelu		blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/average_l0_163 Load this SAE	jumprelu		blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_4 Load this SAE	jumprelu		blocks.2.hook_mlp_out	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_7 Load this SAE	jumprelu		blocks.2.hook_mlp_out	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.2.hook_mlp_out	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_20 Load this SAE	jumprelu		blocks.2.hook_mlp_out	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_35 Load this SAE	jumprelu		blocks.2.hook_mlp_out	2	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/average_l0_61 Load this SAE	jumprelu		blocks.2.hook_mlp_out	2	131072	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_17 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_41 Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-mlp-16k__l0-41	blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_108 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_284 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_643 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_1127 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_20 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_41 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_93 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_212 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_477 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_992 Load this SAE	jumprelu		blocks.20.hook_mlp_out	20	131072	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_15 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/21-gemmascope-mlp-16k__l0-34	blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_88 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_241 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_571 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/average_l0_1063 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_16 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_35 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_79 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_179 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_417 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/average_l0_884 Load this SAE	jumprelu		blocks.21.hook_mlp_out	21	131072	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_15 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_34 Load this SAE	jumprelu	gemma-2-9b/22-gemmascope-mlp-16k__l0-34	blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_85 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_226 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_566 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/average_l0_1065 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_35 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_77 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_172 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_404 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_861 Load this SAE	jumprelu		blocks.22.hook_mlp_out	22	131072	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_15 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_31 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_73 Load this SAE	jumprelu	gemma-2-9b/23-gemmascope-mlp-16k__l0-73	blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_190 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_492 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/average_l0_990 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_32 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_67 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_146 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_354 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/average_l0_754 Load this SAE	jumprelu		blocks.23.hook_mlp_out	23	131072	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_15 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_32 Load this SAE	jumprelu	gemma-2-9b/24-gemmascope-mlp-16k__l0-32	blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_73 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_192 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_494 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/average_l0_999 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_17 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_33 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_67 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_147 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_351 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/average_l0_709 Load this SAE	jumprelu		blocks.24.hook_mlp_out	24	131072	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_15 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_31 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_72 Load this SAE	jumprelu	gemma-2-9b/25-gemmascope-mlp-16k__l0-72	blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_184 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_494 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/average_l0_1013 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_16 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_32 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_65 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_139 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_326 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/average_l0_691 Load this SAE	jumprelu		blocks.25.hook_mlp_out	25	131072	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_14 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_26 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_57 Load this SAE	jumprelu	gemma-2-9b/26-gemmascope-mlp-16k__l0-57	blocks.26.hook_mlp_out	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_142 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_394 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/average_l0_887 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	16384	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_14 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_27 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_53 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_110 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_249 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/average_l0_568 Load this SAE	jumprelu		blocks.26.hook_mlp_out	26	131072	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_14 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_25 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_52 Load this SAE	jumprelu	gemma-2-9b/27-gemmascope-mlp-16k__l0-52	blocks.27.hook_mlp_out	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_126 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_352 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/average_l0_813 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	16384	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_14 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_26 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_49 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_99 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_211 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/average_l0_487 Load this SAE	jumprelu		blocks.27.hook_mlp_out	27	131072	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_14 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_26 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_50 Load this SAE	jumprelu	gemma-2-9b/28-gemmascope-mlp-16k__l0-50	blocks.28.hook_mlp_out	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_115 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_324 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/average_l0_773 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	16384	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_15 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_26 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_47 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_91 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_189 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/average_l0_425 Load this SAE	jumprelu		blocks.28.hook_mlp_out	28	131072	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_15 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_26 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_49 Load this SAE	jumprelu	gemma-2-9b/29-gemmascope-mlp-16k__l0-49	blocks.29.hook_mlp_out	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_111 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_311 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/average_l0_725 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	16384	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_15 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_26 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_47 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_87 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_174 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/average_l0_386 Load this SAE	jumprelu		blocks.29.hook_mlp_out	29	131072	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_13 Load this SAE	jumprelu		blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_25 Load this SAE	jumprelu		blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_55 Load this SAE	jumprelu	gemma-2-9b/3-gemmascope-mlp-16k__l0-55	blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_126 Load this SAE	jumprelu		blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/average_l0_234 Load this SAE	jumprelu		blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_6 Load this SAE	jumprelu		blocks.3.hook_mlp_out	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.3.hook_mlp_out	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.3.hook_mlp_out	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_33 Load this SAE	jumprelu		blocks.3.hook_mlp_out	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_58 Load this SAE	jumprelu		blocks.3.hook_mlp_out	3	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/average_l0_109 Load this SAE	jumprelu		blocks.3.hook_mlp_out	3	131072	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_14 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_26 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_51 Load this SAE	jumprelu	gemma-2-9b/30-gemmascope-mlp-16k__l0-51	blocks.30.hook_mlp_out	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_116 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_333 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/average_l0_806 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	16384	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_14 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_26 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_47 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_89 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_179 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/average_l0_391 Load this SAE	jumprelu		blocks.30.hook_mlp_out	30	131072	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_22 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_43 Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-mlp-16k__l0-43	blocks.31.hook_mlp_out	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_94 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_263 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_671 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_22 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_40 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_77 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_153 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_326 Load this SAE	jumprelu		blocks.31.hook_mlp_out	31	131072	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_44 Load this SAE	jumprelu	gemma-2-9b/32-gemmascope-mlp-16k__l0-44	blocks.32.hook_mlp_out	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_98 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_267 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/average_l0_623 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	16384	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_21 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_40 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_76 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_155 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/average_l0_336 Load this SAE	jumprelu		blocks.32.hook_mlp_out	32	131072	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_23 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_48 Load this SAE	jumprelu	gemma-2-9b/33-gemmascope-mlp-16k__l0-48	blocks.33.hook_mlp_out	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_107 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_282 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/average_l0_628 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	16384	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_22 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_42 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_83 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_168 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/average_l0_394 Load this SAE	jumprelu		blocks.33.hook_mlp_out	33	131072	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_22 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_47 Load this SAE	jumprelu	gemma-2-9b/34-gemmascope-mlp-16k__l0-47	blocks.34.hook_mlp_out	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_107 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_268 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/average_l0_559 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	16384	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_20 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_40 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_82 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_167 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_390 Load this SAE	jumprelu		blocks.34.hook_mlp_out	34	131072	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_10 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_46 Load this SAE	jumprelu	gemma-2-9b/35-gemmascope-mlp-16k__l0-46	blocks.35.hook_mlp_out	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_108 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_254 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/average_l0_538 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	16384	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_10 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_19 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_39 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_80 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_176 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/average_l0_389 Load this SAE	jumprelu		blocks.35.hook_mlp_out	35	131072	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_22 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_47 Load this SAE	jumprelu	gemma-2-9b/36-gemmascope-mlp-16k__l0-47	blocks.36.hook_mlp_out	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_109 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_256 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/average_l0_523 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	16384	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_20 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_40 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_81 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_174 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/average_l0_389 Load this SAE	jumprelu		blocks.36.hook_mlp_out	36	131072	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_24 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_53 Load this SAE	jumprelu	gemma-2-9b/37-gemmascope-mlp-16k__l0-53	blocks.37.hook_mlp_out	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_119 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_267 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/average_l0_549 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	16384	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_23 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_44 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_90 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_203 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/average_l0_403 Load this SAE	jumprelu		blocks.37.hook_mlp_out	37	131072	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_22 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_45 Load this SAE	jumprelu	gemma-2-9b/38-gemmascope-mlp-16k__l0-45	blocks.38.hook_mlp_out	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_98 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_225 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/average_l0_491 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	16384	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_21 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_40 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_79 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_161 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/average_l0_347 Load this SAE	jumprelu		blocks.38.hook_mlp_out	38	131072	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_22 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_43 Load this SAE	jumprelu	gemma-2-9b/39-gemmascope-mlp-16k__l0-43	blocks.39.hook_mlp_out	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_90 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_207 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/average_l0_458 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	16384	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_21 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_38 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_75 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_150 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/average_l0_319 Load this SAE	jumprelu		blocks.39.hook_mlp_out	39	131072	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_15 Load this SAE	jumprelu		blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_30 Load this SAE	jumprelu		blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_66 Load this SAE	jumprelu	gemma-2-9b/4-gemmascope-mlp-16k__l0-66	blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_151 Load this SAE	jumprelu		blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/average_l0_343 Load this SAE	jumprelu		blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_8 Load this SAE	jumprelu		blocks.4.hook_mlp_out	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_14 Load this SAE	jumprelu		blocks.4.hook_mlp_out	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_24 Load this SAE	jumprelu		blocks.4.hook_mlp_out	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_45 Load this SAE	jumprelu		blocks.4.hook_mlp_out	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_84 Load this SAE	jumprelu		blocks.4.hook_mlp_out	4	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/average_l0_157 Load this SAE	jumprelu		blocks.4.hook_mlp_out	4	131072	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_11 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_19 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_37 Load this SAE	jumprelu	gemma-2-9b/40-gemmascope-mlp-16k__l0-37	blocks.40.hook_mlp_out	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_74 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_162 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/average_l0_371 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	16384	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_11 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_18 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_33 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_63 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_125 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/average_l0_267 Load this SAE	jumprelu		blocks.40.hook_mlp_out	40	131072	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_8 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_15 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_28 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_58 Load this SAE	jumprelu	gemma-2-9b/41-gemmascope-mlp-16k__l0-58	blocks.41.hook_mlp_out	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_126 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/average_l0_288 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	16384	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_8 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_14 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_25 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_49 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_99 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/average_l0_208 Load this SAE	jumprelu		blocks.41.hook_mlp_out	41	131072	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_14 Load this SAE	jumprelu		blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_24 Load this SAE	jumprelu		blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_46 Load this SAE	jumprelu	gemma-2-9b/5-gemmascope-mlp-16k__l0-46	blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_93 Load this SAE	jumprelu		blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/average_l0_194 Load this SAE	jumprelu		blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_7 Load this SAE	jumprelu		blocks.5.hook_mlp_out	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.5.hook_mlp_out	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_21 Load this SAE	jumprelu		blocks.5.hook_mlp_out	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_37 Load this SAE	jumprelu		blocks.5.hook_mlp_out	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_68 Load this SAE	jumprelu		blocks.5.hook_mlp_out	5	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/average_l0_131 Load this SAE	jumprelu		blocks.5.hook_mlp_out	5	131072	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_23 Load this SAE	jumprelu		blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_46 Load this SAE	jumprelu	gemma-2-9b/6-gemmascope-mlp-16k__l0-46	blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_96 Load this SAE	jumprelu		blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/average_l0_206 Load this SAE	jumprelu		blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.6.hook_mlp_out	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_22 Load this SAE	jumprelu		blocks.6.hook_mlp_out	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_40 Load this SAE	jumprelu		blocks.6.hook_mlp_out	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_72 Load this SAE	jumprelu		blocks.6.hook_mlp_out	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_135 Load this SAE	jumprelu		blocks.6.hook_mlp_out	6	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/average_l0_271 Load this SAE	jumprelu		blocks.6.hook_mlp_out	6	131072	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_14 Load this SAE	jumprelu		blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_25 Load this SAE	jumprelu		blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_47 Load this SAE	jumprelu	gemma-2-9b/7-gemmascope-mlp-16k__l0-47	blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_101 Load this SAE	jumprelu		blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/average_l0_231 Load this SAE	jumprelu		blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_13 Load this SAE	jumprelu		blocks.7.hook_mlp_out	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_23 Load this SAE	jumprelu		blocks.7.hook_mlp_out	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_41 Load this SAE	jumprelu		blocks.7.hook_mlp_out	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_75 Load this SAE	jumprelu		blocks.7.hook_mlp_out	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_143 Load this SAE	jumprelu		blocks.7.hook_mlp_out	7	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/average_l0_309 Load this SAE	jumprelu		blocks.7.hook_mlp_out	7	131072	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_15 Load this SAE	jumprelu		blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_27 Load this SAE	jumprelu		blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_55 Load this SAE	jumprelu	gemma-2-9b/8-gemmascope-mlp-16k__l0-55	blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_124 Load this SAE	jumprelu		blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/average_l0_309 Load this SAE	jumprelu		blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_15 Load this SAE	jumprelu		blocks.8.hook_mlp_out	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_26 Load this SAE	jumprelu		blocks.8.hook_mlp_out	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_48 Load this SAE	jumprelu		blocks.8.hook_mlp_out	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_89 Load this SAE	jumprelu		blocks.8.hook_mlp_out	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_184 Load this SAE	jumprelu		blocks.8.hook_mlp_out	8	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/average_l0_423 Load this SAE	jumprelu		blocks.8.hook_mlp_out	8	131072	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_12 Load this SAE	jumprelu		blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_21 Load this SAE	jumprelu		blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_40 Load this SAE	jumprelu		blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_83 Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-mlp-16k__l0-83	blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_200 Load this SAE	jumprelu		blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_12 Load this SAE	jumprelu		blocks.9.hook_mlp_out	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_21 Load this SAE	jumprelu		blocks.9.hook_mlp_out	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_38 Load this SAE	jumprelu		blocks.9.hook_mlp_out	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_67 Load this SAE	jumprelu		blocks.9.hook_mlp_out	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_129 Load this SAE	jumprelu		blocks.9.hook_mlp_out	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_269 Load this SAE	jumprelu		blocks.9.hook_mlp_out	9	131072	1024	monology/pile-uncopyrighted

gemma-scope-9b-pt-mlp-canonical

Huggingface Repo: google/gemma-scope-9b-pt-mlp
model: gemma-2-9b

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_0/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/0-gemmascope-mlp-16k	blocks.0.hook_mlp_out	0	16384	1024	monology/pile-uncopyrighted
layer_1/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/1-gemmascope-mlp-16k	blocks.1.hook_mlp_out	1	16384	1024	monology/pile-uncopyrighted
layer_2/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/2-gemmascope-mlp-16k	blocks.2.hook_mlp_out	2	16384	1024	monology/pile-uncopyrighted
layer_3/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/3-gemmascope-mlp-16k	blocks.3.hook_mlp_out	3	16384	1024	monology/pile-uncopyrighted
layer_4/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/4-gemmascope-mlp-16k	blocks.4.hook_mlp_out	4	16384	1024	monology/pile-uncopyrighted
layer_5/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/5-gemmascope-mlp-16k	blocks.5.hook_mlp_out	5	16384	1024	monology/pile-uncopyrighted
layer_6/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/6-gemmascope-mlp-16k	blocks.6.hook_mlp_out	6	16384	1024	monology/pile-uncopyrighted
layer_7/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/7-gemmascope-mlp-16k	blocks.7.hook_mlp_out	7	16384	1024	monology/pile-uncopyrighted
layer_8/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/8-gemmascope-mlp-16k	blocks.8.hook_mlp_out	8	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-mlp-16k	blocks.9.hook_mlp_out	9	16384	1024	monology/pile-uncopyrighted
layer_10/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/10-gemmascope-mlp-16k	blocks.10.hook_mlp_out	10	16384	1024	monology/pile-uncopyrighted
layer_11/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/11-gemmascope-mlp-16k	blocks.11.hook_mlp_out	11	16384	1024	monology/pile-uncopyrighted
layer_12/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/12-gemmascope-mlp-16k	blocks.12.hook_mlp_out	12	16384	1024	monology/pile-uncopyrighted
layer_13/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/13-gemmascope-mlp-16k	blocks.13.hook_mlp_out	13	16384	1024	monology/pile-uncopyrighted
layer_14/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/14-gemmascope-mlp-16k	blocks.14.hook_mlp_out	14	16384	1024	monology/pile-uncopyrighted
layer_15/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/15-gemmascope-mlp-16k	blocks.15.hook_mlp_out	15	16384	1024	monology/pile-uncopyrighted
layer_16/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/16-gemmascope-mlp-16k	blocks.16.hook_mlp_out	16	16384	1024	monology/pile-uncopyrighted
layer_17/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/17-gemmascope-mlp-16k	blocks.17.hook_mlp_out	17	16384	1024	monology/pile-uncopyrighted
layer_18/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/18-gemmascope-mlp-16k	blocks.18.hook_mlp_out	18	16384	1024	monology/pile-uncopyrighted
layer_19/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/19-gemmascope-mlp-16k	blocks.19.hook_mlp_out	19	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-mlp-16k	blocks.20.hook_mlp_out	20	16384	1024	monology/pile-uncopyrighted
layer_21/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/21-gemmascope-mlp-16k	blocks.21.hook_mlp_out	21	16384	1024	monology/pile-uncopyrighted
layer_22/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/22-gemmascope-mlp-16k	blocks.22.hook_mlp_out	22	16384	1024	monology/pile-uncopyrighted
layer_23/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/23-gemmascope-mlp-16k	blocks.23.hook_mlp_out	23	16384	1024	monology/pile-uncopyrighted
layer_24/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/24-gemmascope-mlp-16k	blocks.24.hook_mlp_out	24	16384	1024	monology/pile-uncopyrighted
layer_25/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/25-gemmascope-mlp-16k	blocks.25.hook_mlp_out	25	16384	1024	monology/pile-uncopyrighted
layer_26/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/26-gemmascope-mlp-16k	blocks.26.hook_mlp_out	26	16384	1024	monology/pile-uncopyrighted
layer_27/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/27-gemmascope-mlp-16k	blocks.27.hook_mlp_out	27	16384	1024	monology/pile-uncopyrighted
layer_28/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/28-gemmascope-mlp-16k	blocks.28.hook_mlp_out	28	16384	1024	monology/pile-uncopyrighted
layer_29/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/29-gemmascope-mlp-16k	blocks.29.hook_mlp_out	29	16384	1024	monology/pile-uncopyrighted
layer_30/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/30-gemmascope-mlp-16k	blocks.30.hook_mlp_out	30	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-mlp-16k	blocks.31.hook_mlp_out	31	16384	1024	monology/pile-uncopyrighted
layer_32/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/32-gemmascope-mlp-16k	blocks.32.hook_mlp_out	32	16384	1024	monology/pile-uncopyrighted
layer_33/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/33-gemmascope-mlp-16k	blocks.33.hook_mlp_out	33	16384	1024	monology/pile-uncopyrighted
layer_34/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/34-gemmascope-mlp-16k	blocks.34.hook_mlp_out	34	16384	1024	monology/pile-uncopyrighted
layer_35/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/35-gemmascope-mlp-16k	blocks.35.hook_mlp_out	35	16384	1024	monology/pile-uncopyrighted
layer_36/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/36-gemmascope-mlp-16k	blocks.36.hook_mlp_out	36	16384	1024	monology/pile-uncopyrighted
layer_37/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/37-gemmascope-mlp-16k	blocks.37.hook_mlp_out	37	16384	1024	monology/pile-uncopyrighted
layer_38/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/38-gemmascope-mlp-16k	blocks.38.hook_mlp_out	38	16384	1024	monology/pile-uncopyrighted
layer_39/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/39-gemmascope-mlp-16k	blocks.39.hook_mlp_out	39	16384	1024	monology/pile-uncopyrighted
layer_40/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/40-gemmascope-mlp-16k	blocks.40.hook_mlp_out	40	16384	1024	monology/pile-uncopyrighted
layer_41/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b/41-gemmascope-mlp-16k	blocks.41.hook_mlp_out	41	16384	1024	monology/pile-uncopyrighted
layer_0/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/0-gemmascope-mlp-131k	blocks.0.hook_mlp_out	0	131072	1024	monology/pile-uncopyrighted
layer_1/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/1-gemmascope-mlp-131k	blocks.1.hook_mlp_out	1	131072	1024	monology/pile-uncopyrighted
layer_2/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/2-gemmascope-mlp-131k	blocks.2.hook_mlp_out	2	131072	1024	monology/pile-uncopyrighted
layer_3/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/3-gemmascope-mlp-131k	blocks.3.hook_mlp_out	3	131072	1024	monology/pile-uncopyrighted
layer_4/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/4-gemmascope-mlp-131k	blocks.4.hook_mlp_out	4	131072	1024	monology/pile-uncopyrighted
layer_5/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/5-gemmascope-mlp-131k	blocks.5.hook_mlp_out	5	131072	1024	monology/pile-uncopyrighted
layer_6/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/6-gemmascope-mlp-131k	blocks.6.hook_mlp_out	6	131072	1024	monology/pile-uncopyrighted
layer_7/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/7-gemmascope-mlp-131k	blocks.7.hook_mlp_out	7	131072	1024	monology/pile-uncopyrighted
layer_8/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/8-gemmascope-mlp-131k	blocks.8.hook_mlp_out	8	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/9-gemmascope-mlp-131k	blocks.9.hook_mlp_out	9	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/10-gemmascope-mlp-131k	blocks.10.hook_mlp_out	10	131072	1024	monology/pile-uncopyrighted
layer_11/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/11-gemmascope-mlp-131k	blocks.11.hook_mlp_out	11	131072	1024	monology/pile-uncopyrighted
layer_12/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/12-gemmascope-mlp-131k	blocks.12.hook_mlp_out	12	131072	1024	monology/pile-uncopyrighted
layer_13/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/13-gemmascope-mlp-131k	blocks.13.hook_mlp_out	13	131072	1024	monology/pile-uncopyrighted
layer_14/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/14-gemmascope-mlp-131k	blocks.14.hook_mlp_out	14	131072	1024	monology/pile-uncopyrighted
layer_15/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/15-gemmascope-mlp-131k	blocks.15.hook_mlp_out	15	131072	1024	monology/pile-uncopyrighted
layer_16/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/16-gemmascope-mlp-131k	blocks.16.hook_mlp_out	16	131072	1024	monology/pile-uncopyrighted
layer_17/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/17-gemmascope-mlp-131k	blocks.17.hook_mlp_out	17	131072	1024	monology/pile-uncopyrighted
layer_18/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/18-gemmascope-mlp-131k	blocks.18.hook_mlp_out	18	131072	1024	monology/pile-uncopyrighted
layer_19/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/19-gemmascope-mlp-131k	blocks.19.hook_mlp_out	19	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/20-gemmascope-mlp-131k	blocks.20.hook_mlp_out	20	131072	1024	monology/pile-uncopyrighted
layer_21/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/21-gemmascope-mlp-131k	blocks.21.hook_mlp_out	21	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/22-gemmascope-mlp-131k	blocks.22.hook_mlp_out	22	131072	1024	monology/pile-uncopyrighted
layer_23/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/23-gemmascope-mlp-131k	blocks.23.hook_mlp_out	23	131072	1024	monology/pile-uncopyrighted
layer_24/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/24-gemmascope-mlp-131k	blocks.24.hook_mlp_out	24	131072	1024	monology/pile-uncopyrighted
layer_25/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/25-gemmascope-mlp-131k	blocks.25.hook_mlp_out	25	131072	1024	monology/pile-uncopyrighted
layer_26/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/26-gemmascope-mlp-131k	blocks.26.hook_mlp_out	26	131072	1024	monology/pile-uncopyrighted
layer_27/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/27-gemmascope-mlp-131k	blocks.27.hook_mlp_out	27	131072	1024	monology/pile-uncopyrighted
layer_28/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/28-gemmascope-mlp-131k	blocks.28.hook_mlp_out	28	131072	1024	monology/pile-uncopyrighted
layer_29/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/29-gemmascope-mlp-131k	blocks.29.hook_mlp_out	29	131072	1024	monology/pile-uncopyrighted
layer_30/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/30-gemmascope-mlp-131k	blocks.30.hook_mlp_out	30	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/31-gemmascope-mlp-131k	blocks.31.hook_mlp_out	31	131072	1024	monology/pile-uncopyrighted
layer_32/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/32-gemmascope-mlp-131k	blocks.32.hook_mlp_out	32	131072	1024	monology/pile-uncopyrighted
layer_33/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/33-gemmascope-mlp-131k	blocks.33.hook_mlp_out	33	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/34-gemmascope-mlp-131k	blocks.34.hook_mlp_out	34	131072	1024	monology/pile-uncopyrighted
layer_35/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/35-gemmascope-mlp-131k	blocks.35.hook_mlp_out	35	131072	1024	monology/pile-uncopyrighted
layer_36/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/36-gemmascope-mlp-131k	blocks.36.hook_mlp_out	36	131072	1024	monology/pile-uncopyrighted
layer_37/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/37-gemmascope-mlp-131k	blocks.37.hook_mlp_out	37	131072	1024	monology/pile-uncopyrighted
layer_38/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/38-gemmascope-mlp-131k	blocks.38.hook_mlp_out	38	131072	1024	monology/pile-uncopyrighted
layer_39/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/39-gemmascope-mlp-131k	blocks.39.hook_mlp_out	39	131072	1024	monology/pile-uncopyrighted
layer_40/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/40-gemmascope-mlp-131k	blocks.40.hook_mlp_out	40	131072	1024	monology/pile-uncopyrighted
layer_41/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b/41-gemmascope-mlp-131k	blocks.41.hook_mlp_out	41	131072	1024	monology/pile-uncopyrighted

gemma-scope-9b-it-res

Huggingface Repo: google/gemma-scope-9b-it-res
model: gemma-2-9b

id	architecture	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_20/width_131k/average_l0_13 Load this SAE	jumprelu	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_153 Load this SAE	jumprelu	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_24 Load this SAE	jumprelu	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_43 Load this SAE	jumprelu	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/average_l0_81 Load this SAE	jumprelu	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_14 Load this SAE	jumprelu	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_189 Load this SAE	jumprelu	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_25 Load this SAE	jumprelu	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_47 Load this SAE	jumprelu	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/average_l0_91 Load this SAE	jumprelu	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_109 Load this SAE	jumprelu	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_13 Load this SAE	jumprelu	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_22 Load this SAE	jumprelu	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_37 Load this SAE	jumprelu	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/average_l0_63 Load this SAE	jumprelu	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_14 Load this SAE	jumprelu	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_142 Load this SAE	jumprelu	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_24 Load this SAE	jumprelu	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_43 Load this SAE	jumprelu	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/average_l0_76 Load this SAE	jumprelu	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_121 Load this SAE	jumprelu	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_13 Load this SAE	jumprelu	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_22 Load this SAE	jumprelu	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_39 Load this SAE	jumprelu	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_131k/average_l0_67 Load this SAE	jumprelu	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_14 Load this SAE	jumprelu	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_186 Load this SAE	jumprelu	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_26 Load this SAE	jumprelu	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_47 Load this SAE	jumprelu	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_9/width_16k/average_l0_88 Load this SAE	jumprelu	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted

gemma-scope-9b-it-res-canonical

Huggingface Repo: google/gemma-scope-9b-it-res
model: gemma-2-9b-it

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_9/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b-it/9-gemmascope-res-16k	blocks.9.hook_resid_post	9	16384	1024	monology/pile-uncopyrighted
layer_20/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b-it/20-gemmascope-res-16k	blocks.20.hook_resid_post	20	16384	1024	monology/pile-uncopyrighted
layer_31/width_16k/canonical Load this SAE	jumprelu	gemma-2-9b-it/31-gemmascope-res-16k	blocks.31.hook_resid_post	31	16384	1024	monology/pile-uncopyrighted
layer_9/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b-it/9-gemmascope-res-131k	blocks.9.hook_resid_post	9	131072	1024	monology/pile-uncopyrighted
layer_20/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b-it/20-gemmascope-res-131k	blocks.20.hook_resid_post	20	131072	1024	monology/pile-uncopyrighted
layer_31/width_131k/canonical Load this SAE	jumprelu	gemma-2-9b-it/31-gemmascope-res-131k	blocks.31.hook_resid_post	31	131072	1024	monology/pile-uncopyrighted

gemma-scope-27b-pt-res

Huggingface Repo: google/gemma-scope-27b-pt-res
model: gemma-2-27b

id	architecture	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_10/width_131k/average_l0_106 Load this SAE	jumprelu	blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_15 Load this SAE	jumprelu	blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_200 Load this SAE	jumprelu	blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_24 Load this SAE	jumprelu	blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_37 Load this SAE	jumprelu	blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_10/width_131k/average_l0_64 Load this SAE	jumprelu	blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_150 Load this SAE	jumprelu	blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_20 Load this SAE	jumprelu	blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_290 Load this SAE	jumprelu	blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_31 Load this SAE	jumprelu	blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_48 Load this SAE	jumprelu	blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/average_l0_82 Load this SAE	jumprelu	blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_155 Load this SAE	jumprelu	blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_21 Load this SAE	jumprelu	blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_333 Load this SAE	jumprelu	blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_38 Load this SAE	jumprelu	blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_72 Load this SAE	jumprelu	blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/average_l0_785 Load this SAE	jumprelu	blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted

gemma-scope-27b-pt-res-canonical

Huggingface Repo: google/gemma-scope-27b-pt-res
model: gemma-2-27b

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path
layer_10/width_131k/canonical Load this SAE	jumprelu	gemma-2-27b/10-gemmascope-res-131k	blocks.10.hook_resid_post	10	131072	1024	monology/pile-uncopyrighted
layer_22/width_131k/canonical Load this SAE	jumprelu	gemma-2-27b/22-gemmascope-res-131k	blocks.22.hook_resid_post	22	131072	1024	monology/pile-uncopyrighted
layer_34/width_131k/canonical Load this SAE	jumprelu	gemma-2-27b/34-gemmascope-res-131k	blocks.34.hook_resid_post	34	131072	1024	monology/pile-uncopyrighted

pythia-70m-deduped-res-sm

Huggingface Repo: ctigges/pythia-70m-deduped__res-sm_processed
model: pythia-70m-deduped
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_resid_pre Load this SAE	standard	pythia-70m-deduped/e-att-sm	blocks.0.hook_resid_pre	0	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.0.hook_resid_post Load this SAE	standard	pythia-70m-deduped/0-res-sm	blocks.0.hook_resid_post	0	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.1.hook_resid_post Load this SAE	standard	pythia-70m-deduped/1-res-sm	blocks.1.hook_resid_post	1	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.2.hook_resid_post Load this SAE	standard	pythia-70m-deduped/2-res-sm	blocks.2.hook_resid_post	2	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.3.hook_resid_post Load this SAE	standard	pythia-70m-deduped/3-res-sm	blocks.3.hook_resid_post	3	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.4.hook_resid_post Load this SAE	standard	pythia-70m-deduped/4-res-sm	blocks.4.hook_resid_post	4	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.5.hook_resid_post Load this SAE	standard	pythia-70m-deduped/5-res-sm	blocks.5.hook_resid_post	5	32768	128	EleutherAI/the_pile_deduplicated	none

pythia-70m-deduped-mlp-sm

Huggingface Repo: ctigges/pythia-70m-deduped__mlp-sm_processed
model: pythia-70m-deduped
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_mlp_out Load this SAE	standard	pythia-70m-deduped/0-mlp-sm	blocks.0.hook_mlp_out	0	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.1.hook_mlp_out Load this SAE	standard	pythia-70m-deduped/1-mlp-sm	blocks.1.hook_mlp_out	1	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.2.hook_mlp_out Load this SAE	standard	pythia-70m-deduped/2-mlp-sm	blocks.2.hook_mlp_out	2	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.3.hook_mlp_out Load this SAE	standard	pythia-70m-deduped/3-mlp-sm	blocks.3.hook_mlp_out	3	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.4.hook_mlp_out Load this SAE	standard	pythia-70m-deduped/4-mlp-sm	blocks.4.hook_mlp_out	4	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.5.hook_mlp_out Load this SAE	standard	pythia-70m-deduped/5-mlp-sm	blocks.5.hook_mlp_out	5	32768	128	EleutherAI/the_pile_deduplicated	none

pythia-70m-deduped-att-sm

Huggingface Repo: ctigges/pythia-70m-deduped__att-sm_processed
model: pythia-70m-deduped
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.0.hook_attn_out Load this SAE	standard	pythia-70m-deduped/0-att-sm	blocks.0.hook_attn_out	0	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.1.hook_attn_out Load this SAE	standard	pythia-70m-deduped/1-att-sm	blocks.1.hook_attn_out	1	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.2.hook_attn_out Load this SAE	standard	pythia-70m-deduped/2-att-sm	blocks.2.hook_attn_out	2	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.3.hook_attn_out Load this SAE	standard	pythia-70m-deduped/3-att-sm	blocks.3.hook_attn_out	3	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.4.hook_attn_out Load this SAE	standard	pythia-70m-deduped/4-att-sm	blocks.4.hook_attn_out	4	32768	128	EleutherAI/the_pile_deduplicated	none
blocks.5.hook_attn_out Load this SAE	standard	pythia-70m-deduped/5-att-sm	blocks.5.hook_attn_out	5	32768	128	EleutherAI/the_pile_deduplicated	none

gpt2-small-res_sll-ajt

Huggingface Repo: neuronpedia/gpt2-small__res_sll-ajt
model: gpt2-small
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.2.hook_resid_pre Load this SAE	standard	gpt2-small/2-res_sll-ajt	blocks.2.hook_resid_pre	2	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.6.hook_resid_pre Load this SAE	standard	gpt2-small/6-res_sll-ajt	blocks.6.hook_resid_pre	6	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.10.hook_resid_pre Load this SAE	standard	gpt2-small/10-res_sll-ajt	blocks.10.hook_resid_pre	10	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none

gpt2-small-res_slefr-ajt

Huggingface Repo: neuronpedia/gpt2-small__res_slefr-ajt
model: gpt2-small
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.2.hook_resid_pre Load this SAE	standard	gpt2-small/2-res_slefr-ajt	blocks.2.hook_resid_pre	2	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.6.hook_resid_pre Load this SAE	standard	gpt2-small/6-res_slefr-ajt	blocks.6.hook_resid_pre	6	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.10.hook_resid_pre Load this SAE	standard	gpt2-small/10-res_slefr-ajt	blocks.10.hook_resid_pre	10	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none

gpt2-small-res_scl-ajt

Huggingface Repo: neuronpedia/gpt2-small__res_scl-ajt
model: gpt2-small
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.2.hook_resid_pre Load this SAE	standard	gpt2-small/2-res_scl-ajt	blocks.2.hook_resid_pre	2	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.6.hook_resid_pre Load this SAE	standard	gpt2-small/6-res_scl-ajt	blocks.6.hook_resid_pre	6	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.10.hook_resid_pre Load this SAE	standard	gpt2-small/10-res_scl-ajt	blocks.10.hook_resid_pre	10	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none

gpt2-small-res_sle-ajt

Huggingface Repo: neuronpedia/gpt2-small__res_sle-ajt
model: gpt2-small
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.2.hook_resid_pre Load this SAE	standard	gpt2-small/2-res_sle-ajt	blocks.2.hook_resid_pre	2	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.6.hook_resid_pre Load this SAE	standard	gpt2-small/6-res_sle-ajt	blocks.6.hook_resid_pre	6	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.10.hook_resid_pre Load this SAE	standard	gpt2-small/10-res_sle-ajt	blocks.10.hook_resid_pre	10	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none

gpt2-small-res_sce-ajt

Huggingface Repo: neuronpedia/gpt2-small__res_sce-ajt
model: gpt2-small
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.2.hook_resid_pre Load this SAE	standard	gpt2-small/2-res_sce-ajt	blocks.2.hook_resid_pre	2	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.6.hook_resid_pre Load this SAE	standard	gpt2-small/6-res_sce-ajt	blocks.6.hook_resid_pre	6	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.10.hook_resid_pre Load this SAE	standard	gpt2-small/10-res_sce-ajt	blocks.10.hook_resid_pre	10	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none

gpt2-small-res_scefr-ajt

Huggingface Repo: neuronpedia/gpt2-small__res_scefr-ajt
model: gpt2-small
Additional Links:
- Model
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.2.hook_resid_pre Load this SAE	standard	gpt2-small/2-res_scefr-ajt	blocks.2.hook_resid_pre	2	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.6.hook_resid_pre Load this SAE	standard	gpt2-small/6-res_scefr-ajt	blocks.6.hook_resid_pre	6	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none
blocks.10.hook_resid_pre Load this SAE	standard	gpt2-small/10-res_scefr-ajt	blocks.10.hook_resid_pre	10	46080	128	apollo-research/Skylion007-openwebtext-tokenizer-gpt2	none

sae_bench_pythia70m_sweep_gated_ctx128_0730

Huggingface Repo: canrager/lm_sae
model: pythia-70m-deduped
Additional Links:
- Model

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.3.hook_resid_post__trainer_0 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_0_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_1 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_1_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_10 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_10_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_12 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_12_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_13 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_13_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_14 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_14_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_15 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_15_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_16 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_16_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_17 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_17_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_18 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_18_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_19 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_19_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_2 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_2_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_3 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_3_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_4 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_4_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_5 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_5_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_6 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_6_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_7 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_7_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_8 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_8_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_9 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_9_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_11 Load this SAE	gated	pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_11_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_0 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_0_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_1 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_1_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_10 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_10_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_11 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_11_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_12 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_12_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_13 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_13_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_14 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_14_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_15 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_15_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_16 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_16_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_17 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_17_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_18 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_18_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_19 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_19_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_2 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_2_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_3 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_3_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_4 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_4_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_5 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_5_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_6 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_6_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_9 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_9_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_8 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_8_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_7 Load this SAE	gated	pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_7_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none

sae_bench_pythia70m_sweep_panneal_ctx128_0730

Huggingface Repo: canrager/lm_sae
model: pythia-70m-deduped
Additional Links:
- Model

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.3.hook_resid_post__trainer_16 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_16_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_17 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_17_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_18 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_18_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_19 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_19_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_2 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_2_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_20 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_20_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_21 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_21_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_22 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_22_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_15 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_15_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_23 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_23_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_25 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_25_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_26 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_26_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_27 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_27_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_3 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_3_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_4 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_4_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_5 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_5_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_6 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_6_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_7 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_7_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_24 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_24_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_14 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_14_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_13 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_13_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_12 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_12_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_0 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_0_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_1 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_1_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_10 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_10_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_11 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_11_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_8 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_8_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_9 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_9_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_17 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_17_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_18 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_18_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_19 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_19_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_16 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_16_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_15 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_15_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_14 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_14_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_13 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_13_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_12 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_12_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_11 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_11_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_10 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_10_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_1 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_1_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_0 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_0_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_2 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_2_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_20 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_20_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_22 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_22_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_9 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_9_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_8 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_8_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_7 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_7_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_6 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_6_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_5 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_5_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_4 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_4_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_27 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_27_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_26 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_26_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_25 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_25_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_3 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_3_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_24 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_24_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_21 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_21_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_23 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_23_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none

sae_bench_pythia70m_sweep_standard_ctx128_0712

Huggingface Repo: canrager/lm_sae
model: pythia-70m-deduped
Additional Links:
- Model

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.3.hook_resid_post__trainer_10 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_10_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_11 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_11_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_8 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_8_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_7 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_7_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_6 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_6_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_5 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_5_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_4 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_4_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_3 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_3_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_2 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_2_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_19 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_19_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_18 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_18_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_17 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_17_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_16 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_16_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_15 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_15_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_14 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_14_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_0 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_0_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_1 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_1_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_13 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_13_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_12 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_12_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_9 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_9_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_0 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_0_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_11 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_11_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_10 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_10_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_1 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_1_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_13 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_13_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_14 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_14_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_16 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_16_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_17 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_17_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_18 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_18_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_2 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_2_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_20 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_20_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_21 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_21_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_12 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_12_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_22 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_22_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_3 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_3_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_4 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_4_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_5 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_5_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_6 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_6_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_7 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_7_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_8 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_8_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_9 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_9_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_23 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_23_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_15 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_15_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_19 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_19_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none

sae_bench_pythia70m_sweep_topk_ctx128_0730

Huggingface Repo: canrager/lm_sae
model: pythia-70m-deduped
Additional Links:
- Model

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.3.hook_resid_post__trainer_0 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_0_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_1 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_1_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_10 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_10_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_11 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_11_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_12 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_12_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_13 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_13_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_14 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_14_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_22 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_22_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_19 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_19_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_2 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_2_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_20 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_20_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_21 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_21_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_16 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_16_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_23 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_23_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_18 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_18_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_3 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_3_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_5 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_5_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_6 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_6_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_7 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_7_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_8 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_8_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_9 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_9_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_15 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_15_step_final	blocks.3.hook_resid_post	3	16384	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_4 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_4_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.3.hook_resid_post__trainer_17 Load this SAE	standard	pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_17_step_final	blocks.3.hook_resid_post	3	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_13 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_13_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_14 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_14_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_15 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_15_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_16 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_16_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_17 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_17_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_18 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_18_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_19 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_19_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_2 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_2_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_20 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_20_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_21 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_21_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_22 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_22_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_23 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_23_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_3 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_3_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_4 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_4_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_5 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_5_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_6 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_6_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_7 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_7_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_12 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_12_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_11 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_11_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_10 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_10_step_final	blocks.4.hook_resid_post	4	16384	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_1 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_1_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_0 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_0_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_9 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_9_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none
blocks.4.hook_resid_post__trainer_8 Load this SAE	standard	pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_8_step_final	blocks.4.hook_resid_post	4	4096	128	monology/pile-uncopyrighted	none

llama-3-8b-it-res-jh

Huggingface Repo: Juliushanhanhan/llama-3-8b-it-res
model: meta-llama/Meta-Llama-3-8B-Instruct
Additional Links:
- Dashboards

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.25.hook_resid_post Load this SAE	gated	llama3-8b-it/25-res-jh	blocks.25.hook_resid_post	25	65536	1024	Juliushanhanhan/openwebtext-1b-llama3-tokenized-cxt-1024	expected_average_only_in

llama_scope_lxa_32x

Huggingface Repo: fnlp/Llama3_1-8B-Base-LXA-32x
model: meta-llama/Llama-3.1-8B

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
l0a_32x Load this SAE	jumprelu	llama3.1-8b/0-llamascope-att-131k	blocks.0.hook_attn_out	0	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l1a_32x Load this SAE	jumprelu	llama3.1-8b/1-llamascope-att-131k	blocks.1.hook_attn_out	1	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l2a_32x Load this SAE	jumprelu	llama3.1-8b/2-llamascope-att-131k	blocks.2.hook_attn_out	2	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l3a_32x Load this SAE	jumprelu	llama3.1-8b/3-llamascope-att-131k	blocks.3.hook_attn_out	3	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l4a_32x Load this SAE	jumprelu	llama3.1-8b/4-llamascope-att-131k	blocks.4.hook_attn_out	4	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l5a_32x Load this SAE	jumprelu	llama3.1-8b/5-llamascope-att-131k	blocks.5.hook_attn_out	5	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l6a_32x Load this SAE	jumprelu	llama3.1-8b/6-llamascope-att-131k	blocks.6.hook_attn_out	6	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l7a_32x Load this SAE	jumprelu	llama3.1-8b/7-llamascope-att-131k	blocks.7.hook_attn_out	7	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l8a_32x Load this SAE	jumprelu	llama3.1-8b/8-llamascope-att-131k	blocks.8.hook_attn_out	8	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l9a_32x Load this SAE	jumprelu	llama3.1-8b/9-llamascope-att-131k	blocks.9.hook_attn_out	9	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l10a_32x Load this SAE	jumprelu	llama3.1-8b/10-llamascope-att-131k	blocks.10.hook_attn_out	10	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l11a_32x Load this SAE	jumprelu	llama3.1-8b/11-llamascope-att-131k	blocks.11.hook_attn_out	11	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l12a_32x Load this SAE	jumprelu	llama3.1-8b/12-llamascope-att-131k	blocks.12.hook_attn_out	12	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l13a_32x Load this SAE	jumprelu	llama3.1-8b/13-llamascope-att-131k	blocks.13.hook_attn_out	13	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l14a_32x Load this SAE	jumprelu	llama3.1-8b/14-llamascope-att-131k	blocks.14.hook_attn_out	14	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l15a_32x Load this SAE	jumprelu	llama3.1-8b/15-llamascope-att-131k	blocks.15.hook_attn_out	15	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l16a_32x Load this SAE	jumprelu	llama3.1-8b/16-llamascope-att-131k	blocks.16.hook_attn_out	16	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l17a_32x Load this SAE	jumprelu	llama3.1-8b/17-llamascope-att-131k	blocks.17.hook_attn_out	17	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l18a_32x Load this SAE	jumprelu	llama3.1-8b/18-llamascope-att-131k	blocks.18.hook_attn_out	18	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l19a_32x Load this SAE	jumprelu	llama3.1-8b/19-llamascope-att-131k	blocks.19.hook_attn_out	19	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l20a_32x Load this SAE	jumprelu	llama3.1-8b/20-llamascope-att-131k	blocks.20.hook_attn_out	20	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l21a_32x Load this SAE	jumprelu	llama3.1-8b/21-llamascope-att-131k	blocks.21.hook_attn_out	21	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l22a_32x Load this SAE	jumprelu	llama3.1-8b/22-llamascope-att-131k	blocks.22.hook_attn_out	22	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l23a_32x Load this SAE	jumprelu	llama3.1-8b/23-llamascope-att-131k	blocks.23.hook_attn_out	23	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l24a_32x Load this SAE	jumprelu	llama3.1-8b/24-llamascope-att-131k	blocks.24.hook_attn_out	24	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l25a_32x Load this SAE	jumprelu	llama3.1-8b/25-llamascope-att-131k	blocks.25.hook_attn_out	25	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l26a_32x Load this SAE	jumprelu	llama3.1-8b/26-llamascope-att-131k	blocks.26.hook_attn_out	26	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l27a_32x Load this SAE	jumprelu	llama3.1-8b/27-llamascope-att-131k	blocks.27.hook_attn_out	27	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l28a_32x Load this SAE	jumprelu	llama3.1-8b/28-llamascope-att-131k	blocks.28.hook_attn_out	28	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l29a_32x Load this SAE	jumprelu	llama3.1-8b/29-llamascope-att-131k	blocks.29.hook_attn_out	29	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l30a_32x Load this SAE	jumprelu	llama3.1-8b/30-llamascope-att-131k	blocks.30.hook_attn_out	30	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l31a_32x Load this SAE	jumprelu	llama3.1-8b/31-llamascope-att-131k	blocks.31.hook_attn_out	31	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in

llama_scope_lxa_8x

Huggingface Repo: fnlp/Llama3_1-8B-Base-LXA-8x
model: meta-llama/Llama-3.1-8B

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
l0a_8x Load this SAE	jumprelu	llama3.1-8b/0-llamascope-att-32k	blocks.0.hook_attn_out	0	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l1a_8x Load this SAE	jumprelu	llama3.1-8b/1-llamascope-att-32k	blocks.1.hook_attn_out	1	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l2a_8x Load this SAE	jumprelu	llama3.1-8b/2-llamascope-att-32k	blocks.2.hook_attn_out	2	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l3a_8x Load this SAE	jumprelu	llama3.1-8b/3-llamascope-att-32k	blocks.3.hook_attn_out	3	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l4a_8x Load this SAE	jumprelu	llama3.1-8b/4-llamascope-att-32k	blocks.4.hook_attn_out	4	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l5a_8x Load this SAE	jumprelu	llama3.1-8b/5-llamascope-att-32k	blocks.5.hook_attn_out	5	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l6a_8x Load this SAE	jumprelu	llama3.1-8b/6-llamascope-att-32k	blocks.6.hook_attn_out	6	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l7a_8x Load this SAE	jumprelu	llama3.1-8b/7-llamascope-att-32k	blocks.7.hook_attn_out	7	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l8a_8x Load this SAE	jumprelu	llama3.1-8b/8-llamascope-att-32k	blocks.8.hook_attn_out	8	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l9a_8x Load this SAE	jumprelu	llama3.1-8b/9-llamascope-att-32k	blocks.9.hook_attn_out	9	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l10a_8x Load this SAE	jumprelu	llama3.1-8b/10-llamascope-att-32k	blocks.10.hook_attn_out	10	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l11a_8x Load this SAE	jumprelu	llama3.1-8b/11-llamascope-att-32k	blocks.11.hook_attn_out	11	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l12a_8x Load this SAE	jumprelu	llama3.1-8b/12-llamascope-att-32k	blocks.12.hook_attn_out	12	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l13a_8x Load this SAE	jumprelu	llama3.1-8b/13-llamascope-att-32k	blocks.13.hook_attn_out	13	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l14a_8x Load this SAE	jumprelu	llama3.1-8b/14-llamascope-att-32k	blocks.14.hook_attn_out	14	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l15a_8x Load this SAE	jumprelu	llama3.1-8b/15-llamascope-att-32k	blocks.15.hook_attn_out	15	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l16a_8x Load this SAE	jumprelu	llama3.1-8b/16-llamascope-att-32k	blocks.16.hook_attn_out	16	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l17a_8x Load this SAE	jumprelu	llama3.1-8b/17-llamascope-att-32k	blocks.17.hook_attn_out	17	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l18a_8x Load this SAE	jumprelu	llama3.1-8b/18-llamascope-att-32k	blocks.18.hook_attn_out	18	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l19a_8x Load this SAE	jumprelu	llama3.1-8b/19-llamascope-att-32k	blocks.19.hook_attn_out	19	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l20a_8x Load this SAE	jumprelu	llama3.1-8b/20-llamascope-att-32k	blocks.20.hook_attn_out	20	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l21a_8x Load this SAE	jumprelu	llama3.1-8b/21-llamascope-att-32k	blocks.21.hook_attn_out	21	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l22a_8x Load this SAE	jumprelu	llama3.1-8b/22-llamascope-att-32k	blocks.22.hook_attn_out	22	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l23a_8x Load this SAE	jumprelu	llama3.1-8b/23-llamascope-att-32k	blocks.23.hook_attn_out	23	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l24a_8x Load this SAE	jumprelu	llama3.1-8b/24-llamascope-att-32k	blocks.24.hook_attn_out	24	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l25a_8x Load this SAE	jumprelu	llama3.1-8b/25-llamascope-att-32k	blocks.25.hook_attn_out	25	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l26a_8x Load this SAE	jumprelu	llama3.1-8b/26-llamascope-att-32k	blocks.26.hook_attn_out	26	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l27a_8x Load this SAE	jumprelu	llama3.1-8b/27-llamascope-att-32k	blocks.27.hook_attn_out	27	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l28a_8x Load this SAE	jumprelu	llama3.1-8b/28-llamascope-att-32k	blocks.28.hook_attn_out	28	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l29a_8x Load this SAE	jumprelu	llama3.1-8b/29-llamascope-att-32k	blocks.29.hook_attn_out	29	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l30a_8x Load this SAE	jumprelu	llama3.1-8b/30-llamascope-att-32k	blocks.30.hook_attn_out	30	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l31a_8x Load this SAE	jumprelu	llama3.1-8b/31-llamascope-att-32k	blocks.31.hook_attn_out	31	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in

llama_scope_lxm_32x

Huggingface Repo: fnlp/Llama3_1-8B-Base-LXM-32x
model: meta-llama/Llama-3.1-8B

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
l0m_32x Load this SAE	jumprelu	llama3.1-8b/0-llamascope-mlp-131k	blocks.0.hook_mlp_out	0	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l1m_32x Load this SAE	jumprelu	llama3.1-8b/1-llamascope-mlp-131k	blocks.1.hook_mlp_out	1	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l2m_32x Load this SAE	jumprelu	llama3.1-8b/2-llamascope-mlp-131k	blocks.2.hook_mlp_out	2	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l3m_32x Load this SAE	jumprelu	llama3.1-8b/3-llamascope-mlp-131k	blocks.3.hook_mlp_out	3	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l4m_32x Load this SAE	jumprelu	llama3.1-8b/4-llamascope-mlp-131k	blocks.4.hook_mlp_out	4	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l5m_32x Load this SAE	jumprelu	llama3.1-8b/5-llamascope-mlp-131k	blocks.5.hook_mlp_out	5	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l6m_32x Load this SAE	jumprelu	llama3.1-8b/6-llamascope-mlp-131k	blocks.6.hook_mlp_out	6	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l7m_32x Load this SAE	jumprelu	llama3.1-8b/7-llamascope-mlp-131k	blocks.7.hook_mlp_out	7	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l8m_32x Load this SAE	jumprelu	llama3.1-8b/8-llamascope-mlp-131k	blocks.8.hook_mlp_out	8	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l9m_32x Load this SAE	jumprelu	llama3.1-8b/9-llamascope-mlp-131k	blocks.9.hook_mlp_out	9	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l10m_32x Load this SAE	jumprelu	llama3.1-8b/10-llamascope-mlp-131k	blocks.10.hook_mlp_out	10	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l11m_32x Load this SAE	jumprelu	llama3.1-8b/11-llamascope-mlp-131k	blocks.11.hook_mlp_out	11	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l12m_32x Load this SAE	jumprelu	llama3.1-8b/12-llamascope-mlp-131k	blocks.12.hook_mlp_out	12	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l13m_32x Load this SAE	jumprelu	llama3.1-8b/13-llamascope-mlp-131k	blocks.13.hook_mlp_out	13	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l14m_32x Load this SAE	jumprelu	llama3.1-8b/14-llamascope-mlp-131k	blocks.14.hook_mlp_out	14	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l15m_32x Load this SAE	jumprelu	llama3.1-8b/15-llamascope-mlp-131k	blocks.15.hook_mlp_out	15	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l16m_32x Load this SAE	jumprelu	llama3.1-8b/16-llamascope-mlp-131k	blocks.16.hook_mlp_out	16	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l17m_32x Load this SAE	jumprelu	llama3.1-8b/17-llamascope-mlp-131k	blocks.17.hook_mlp_out	17	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l18m_32x Load this SAE	jumprelu	llama3.1-8b/18-llamascope-mlp-131k	blocks.18.hook_mlp_out	18	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l19m_32x Load this SAE	jumprelu	llama3.1-8b/19-llamascope-mlp-131k	blocks.19.hook_mlp_out	19	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l20m_32x Load this SAE	jumprelu	llama3.1-8b/20-llamascope-mlp-131k	blocks.20.hook_mlp_out	20	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l21m_32x Load this SAE	jumprelu	llama3.1-8b/21-llamascope-mlp-131k	blocks.21.hook_mlp_out	21	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l22m_32x Load this SAE	jumprelu	llama3.1-8b/22-llamascope-mlp-131k	blocks.22.hook_mlp_out	22	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l23m_32x Load this SAE	jumprelu	llama3.1-8b/23-llamascope-mlp-131k	blocks.23.hook_mlp_out	23	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l24m_32x Load this SAE	jumprelu	llama3.1-8b/24-llamascope-mlp-131k	blocks.24.hook_mlp_out	24	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l25m_32x Load this SAE	jumprelu	llama3.1-8b/25-llamascope-mlp-131k	blocks.25.hook_mlp_out	25	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l26m_32x Load this SAE	jumprelu	llama3.1-8b/26-llamascope-mlp-131k	blocks.26.hook_mlp_out	26	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l27m_32x Load this SAE	jumprelu	llama3.1-8b/27-llamascope-mlp-131k	blocks.27.hook_mlp_out	27	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l28m_32x Load this SAE	jumprelu	llama3.1-8b/28-llamascope-mlp-131k	blocks.28.hook_mlp_out	28	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l29m_32x Load this SAE	jumprelu	llama3.1-8b/29-llamascope-mlp-131k	blocks.29.hook_mlp_out	29	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l30m_32x Load this SAE	jumprelu	llama3.1-8b/30-llamascope-mlp-131k	blocks.30.hook_mlp_out	30	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l31m_32x Load this SAE	jumprelu	llama3.1-8b/31-llamascope-mlp-131k	blocks.31.hook_mlp_out	31	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in

llama_scope_lxm_8x

Huggingface Repo: fnlp/Llama3_1-8B-Base-LXM-8x
model: meta-llama/Llama-3.1-8B

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
l0m_8x Load this SAE	jumprelu	llama3.1-8b/0-llamascope-mlp-32k	blocks.0.hook_mlp_out	0	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l1m_8x Load this SAE	jumprelu	llama3.1-8b/1-llamascope-mlp-32k	blocks.1.hook_mlp_out	1	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l2m_8x Load this SAE	jumprelu	llama3.1-8b/2-llamascope-mlp-32k	blocks.2.hook_mlp_out	2	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l3m_8x Load this SAE	jumprelu	llama3.1-8b/3-llamascope-mlp-32k	blocks.3.hook_mlp_out	3	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l4m_8x Load this SAE	jumprelu	llama3.1-8b/4-llamascope-mlp-32k	blocks.4.hook_mlp_out	4	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l5m_8x Load this SAE	jumprelu	llama3.1-8b/5-llamascope-mlp-32k	blocks.5.hook_mlp_out	5	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l6m_8x Load this SAE	jumprelu	llama3.1-8b/6-llamascope-mlp-32k	blocks.6.hook_mlp_out	6	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l7m_8x Load this SAE	jumprelu	llama3.1-8b/7-llamascope-mlp-32k	blocks.7.hook_mlp_out	7	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l8m_8x Load this SAE	jumprelu	llama3.1-8b/8-llamascope-mlp-32k	blocks.8.hook_mlp_out	8	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l9m_8x Load this SAE	jumprelu	llama3.1-8b/9-llamascope-mlp-32k	blocks.9.hook_mlp_out	9	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l10m_8x Load this SAE	jumprelu	llama3.1-8b/10-llamascope-mlp-32k	blocks.10.hook_mlp_out	10	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l11m_8x Load this SAE	jumprelu	llama3.1-8b/11-llamascope-mlp-32k	blocks.11.hook_mlp_out	11	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l12m_8x Load this SAE	jumprelu	llama3.1-8b/12-llamascope-mlp-32k	blocks.12.hook_mlp_out	12	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l13m_8x Load this SAE	jumprelu	llama3.1-8b/13-llamascope-mlp-32k	blocks.13.hook_mlp_out	13	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l14m_8x Load this SAE	jumprelu	llama3.1-8b/14-llamascope-mlp-32k	blocks.14.hook_mlp_out	14	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l15m_8x Load this SAE	jumprelu	llama3.1-8b/15-llamascope-mlp-32k	blocks.15.hook_mlp_out	15	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l16m_8x Load this SAE	jumprelu	llama3.1-8b/16-llamascope-mlp-32k	blocks.16.hook_mlp_out	16	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l17m_8x Load this SAE	jumprelu	llama3.1-8b/17-llamascope-mlp-32k	blocks.17.hook_mlp_out	17	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l18m_8x Load this SAE	jumprelu	llama3.1-8b/18-llamascope-mlp-32k	blocks.18.hook_mlp_out	18	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l19m_8x Load this SAE	jumprelu	llama3.1-8b/19-llamascope-mlp-32k	blocks.19.hook_mlp_out	19	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l20m_8x Load this SAE	jumprelu	llama3.1-8b/20-llamascope-mlp-32k	blocks.20.hook_mlp_out	20	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l21m_8x Load this SAE	jumprelu	llama3.1-8b/21-llamascope-mlp-32k	blocks.21.hook_mlp_out	21	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l22m_8x Load this SAE	jumprelu	llama3.1-8b/22-llamascope-mlp-32k	blocks.22.hook_mlp_out	22	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l23m_8x Load this SAE	jumprelu	llama3.1-8b/23-llamascope-mlp-32k	blocks.23.hook_mlp_out	23	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l24m_8x Load this SAE	jumprelu	llama3.1-8b/24-llamascope-mlp-32k	blocks.24.hook_mlp_out	24	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l25m_8x Load this SAE	jumprelu	llama3.1-8b/25-llamascope-mlp-32k	blocks.25.hook_mlp_out	25	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l26m_8x Load this SAE	jumprelu	llama3.1-8b/26-llamascope-mlp-32k	blocks.26.hook_mlp_out	26	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l27m_8x Load this SAE	jumprelu	llama3.1-8b/27-llamascope-mlp-32k	blocks.27.hook_mlp_out	27	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l28m_8x Load this SAE	jumprelu	llama3.1-8b/28-llamascope-mlp-32k	blocks.28.hook_mlp_out	28	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l29m_8x Load this SAE	jumprelu	llama3.1-8b/29-llamascope-mlp-32k	blocks.29.hook_mlp_out	29	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l30m_8x Load this SAE	jumprelu	llama3.1-8b/30-llamascope-mlp-32k	blocks.30.hook_mlp_out	30	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l31m_8x Load this SAE	jumprelu	llama3.1-8b/31-llamascope-mlp-32k	blocks.31.hook_mlp_out	31	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in

llama_scope_lxr_32x

Huggingface Repo: fnlp/Llama3_1-8B-Base-LXR-32x
model: meta-llama/Llama-3.1-8B

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
l0r_32x Load this SAE	jumprelu	llama3.1-8b/0-llamascope-res-131k	blocks.0.hook_resid_post	0	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l1r_32x Load this SAE	jumprelu	llama3.1-8b/1-llamascope-res-131k	blocks.1.hook_resid_post	1	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l2r_32x Load this SAE	jumprelu	llama3.1-8b/2-llamascope-res-131k	blocks.2.hook_resid_post	2	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l3r_32x Load this SAE	jumprelu	llama3.1-8b/3-llamascope-res-131k	blocks.3.hook_resid_post	3	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l4r_32x Load this SAE	jumprelu	llama3.1-8b/4-llamascope-res-131k	blocks.4.hook_resid_post	4	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l5r_32x Load this SAE	jumprelu	llama3.1-8b/5-llamascope-res-131k	blocks.5.hook_resid_post	5	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l6r_32x Load this SAE	jumprelu	llama3.1-8b/6-llamascope-res-131k	blocks.6.hook_resid_post	6	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l7r_32x Load this SAE	jumprelu	llama3.1-8b/7-llamascope-res-131k	blocks.7.hook_resid_post	7	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l8r_32x Load this SAE	jumprelu	llama3.1-8b/8-llamascope-res-131k	blocks.8.hook_resid_post	8	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l9r_32x Load this SAE	jumprelu	llama3.1-8b/9-llamascope-res-131k	blocks.9.hook_resid_post	9	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l10r_32x Load this SAE	jumprelu	llama3.1-8b/10-llamascope-res-131k	blocks.10.hook_resid_post	10	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l11r_32x Load this SAE	jumprelu	llama3.1-8b/11-llamascope-res-131k	blocks.11.hook_resid_post	11	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l12r_32x Load this SAE	jumprelu	llama3.1-8b/12-llamascope-res-131k	blocks.12.hook_resid_post	12	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l13r_32x Load this SAE	jumprelu	llama3.1-8b/13-llamascope-res-131k	blocks.13.hook_resid_post	13	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l14r_32x Load this SAE	jumprelu	llama3.1-8b/14-llamascope-res-131k	blocks.14.hook_resid_post	14	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l15r_32x Load this SAE	jumprelu	llama3.1-8b/15-llamascope-res-131k	blocks.15.hook_resid_post	15	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l16r_32x Load this SAE	jumprelu	llama3.1-8b/16-llamascope-res-131k	blocks.16.hook_resid_post	16	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l17r_32x Load this SAE	jumprelu	llama3.1-8b/17-llamascope-res-131k	blocks.17.hook_resid_post	17	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l18r_32x Load this SAE	jumprelu	llama3.1-8b/18-llamascope-res-131k	blocks.18.hook_resid_post	18	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l19r_32x Load this SAE	jumprelu	llama3.1-8b/19-llamascope-res-131k	blocks.19.hook_resid_post	19	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l20r_32x Load this SAE	jumprelu	llama3.1-8b/20-llamascope-res-131k	blocks.20.hook_resid_post	20	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l21r_32x Load this SAE	jumprelu	llama3.1-8b/21-llamascope-res-131k	blocks.21.hook_resid_post	21	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l22r_32x Load this SAE	jumprelu	llama3.1-8b/22-llamascope-res-131k	blocks.22.hook_resid_post	22	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l23r_32x Load this SAE	jumprelu	llama3.1-8b/23-llamascope-res-131k	blocks.23.hook_resid_post	23	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l24r_32x Load this SAE	jumprelu	llama3.1-8b/24-llamascope-res-131k	blocks.24.hook_resid_post	24	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l25r_32x Load this SAE	jumprelu	llama3.1-8b/25-llamascope-res-131k	blocks.25.hook_resid_post	25	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l26r_32x Load this SAE	jumprelu	llama3.1-8b/26-llamascope-res-131k	blocks.26.hook_resid_post	26	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l27r_32x Load this SAE	jumprelu	llama3.1-8b/27-llamascope-res-131k	blocks.27.hook_resid_post	27	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l28r_32x Load this SAE	jumprelu	llama3.1-8b/28-llamascope-res-131k	blocks.28.hook_resid_post	28	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l29r_32x Load this SAE	jumprelu	llama3.1-8b/29-llamascope-res-131k	blocks.29.hook_resid_post	29	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l30r_32x Load this SAE	jumprelu	llama3.1-8b/30-llamascope-res-131k	blocks.30.hook_resid_post	30	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in
l31r_32x Load this SAE	jumprelu	llama3.1-8b/31-llamascope-res-131k	blocks.31.hook_resid_post	31	131072	1024	cerebras/SlimPajama-627B	expected_average_only_in

llama_scope_lxr_8x

Huggingface Repo: fnlp/Llama3_1-8B-Base-LXR-8x
model: meta-llama/Llama-3.1-8B

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
l0r_8x Load this SAE	jumprelu	llama3.1-8b/0-llamascope-res-32k	blocks.0.hook_resid_post	0	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l1r_8x Load this SAE	jumprelu	llama3.1-8b/1-llamascope-res-32k	blocks.1.hook_resid_post	1	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l2r_8x Load this SAE	jumprelu	llama3.1-8b/2-llamascope-res-32k	blocks.2.hook_resid_post	2	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l3r_8x Load this SAE	jumprelu	llama3.1-8b/3-llamascope-res-32k	blocks.3.hook_resid_post	3	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l4r_8x Load this SAE	jumprelu	llama3.1-8b/4-llamascope-res-32k	blocks.4.hook_resid_post	4	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l5r_8x Load this SAE	jumprelu	llama3.1-8b/5-llamascope-res-32k	blocks.5.hook_resid_post	5	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l6r_8x Load this SAE	jumprelu	llama3.1-8b/6-llamascope-res-32k	blocks.6.hook_resid_post	6	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l7r_8x Load this SAE	jumprelu	llama3.1-8b/7-llamascope-res-32k	blocks.7.hook_resid_post	7	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l8r_8x Load this SAE	jumprelu	llama3.1-8b/8-llamascope-res-32k	blocks.8.hook_resid_post	8	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l9r_8x Load this SAE	jumprelu	llama3.1-8b/9-llamascope-res-32k	blocks.9.hook_resid_post	9	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l10r_8x Load this SAE	jumprelu	llama3.1-8b/10-llamascope-res-32k	blocks.10.hook_resid_post	10	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l11r_8x Load this SAE	jumprelu	llama3.1-8b/11-llamascope-res-32k	blocks.11.hook_resid_post	11	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l12r_8x Load this SAE	jumprelu	llama3.1-8b/12-llamascope-res-32k	blocks.12.hook_resid_post	12	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l13r_8x Load this SAE	jumprelu	llama3.1-8b/13-llamascope-res-32k	blocks.13.hook_resid_post	13	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l14r_8x Load this SAE	jumprelu	llama3.1-8b/14-llamascope-res-32k	blocks.14.hook_resid_post	14	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l15r_8x Load this SAE	jumprelu	llama3.1-8b/15-llamascope-res-32k	blocks.15.hook_resid_post	15	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l16r_8x Load this SAE	jumprelu	llama3.1-8b/16-llamascope-res-32k	blocks.16.hook_resid_post	16	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l17r_8x Load this SAE	jumprelu	llama3.1-8b/17-llamascope-res-32k	blocks.17.hook_resid_post	17	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l18r_8x Load this SAE	jumprelu	llama3.1-8b/18-llamascope-res-32k	blocks.18.hook_resid_post	18	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l19r_8x Load this SAE	jumprelu	llama3.1-8b/19-llamascope-res-32k	blocks.19.hook_resid_post	19	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l20r_8x Load this SAE	jumprelu	llama3.1-8b/20-llamascope-res-32k	blocks.20.hook_resid_post	20	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l21r_8x Load this SAE	jumprelu	llama3.1-8b/21-llamascope-res-32k	blocks.21.hook_resid_post	21	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l22r_8x Load this SAE	jumprelu	llama3.1-8b/22-llamascope-res-32k	blocks.22.hook_resid_post	22	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l23r_8x Load this SAE	jumprelu	llama3.1-8b/23-llamascope-res-32k	blocks.23.hook_resid_post	23	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l24r_8x Load this SAE	jumprelu	llama3.1-8b/24-llamascope-res-32k	blocks.24.hook_resid_post	24	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l25r_8x Load this SAE	jumprelu	llama3.1-8b/25-llamascope-res-32k	blocks.25.hook_resid_post	25	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l26r_8x Load this SAE	jumprelu	llama3.1-8b/26-llamascope-res-32k	blocks.26.hook_resid_post	26	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l27r_8x Load this SAE	jumprelu	llama3.1-8b/27-llamascope-res-32k	blocks.27.hook_resid_post	27	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l28r_8x Load this SAE	jumprelu	llama3.1-8b/28-llamascope-res-32k	blocks.28.hook_resid_post	28	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l29r_8x Load this SAE	jumprelu	llama3.1-8b/29-llamascope-res-32k	blocks.29.hook_resid_post	29	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l30r_8x Load this SAE	jumprelu	llama3.1-8b/30-llamascope-res-32k	blocks.30.hook_resid_post	30	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in
l31r_8x Load this SAE	jumprelu	llama3.1-8b/31-llamascope-res-32k	blocks.31.hook_resid_post	31	32768	1024	cerebras/SlimPajama-627B	expected_average_only_in

sae_bench_gemma-2-2b_topk_width-2pow12_date-1109

Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow12_date-1109
model: gemma-2-2b
Additional Links:
- Model

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.12.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_0_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_1_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_2_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_3_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_4_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-4k__trainer_5_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_0_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_1_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_2_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_3_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_4_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-4k__trainer_5_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none

sae_bench_gemma-2-2b_vanilla_width-2pow12_date-1109

Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow12_date-1109
model: gemma-2-2b
Additional Links:
- Model

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.12.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_0_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_1_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_2_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_3_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_4_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_final	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_0	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_308	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_3088	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_30881	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_97	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_976	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-4k__trainer_5_step_9765	blocks.12.hook_resid_post	12	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_final	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_0	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_308 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_308	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_3088 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_3088	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_30881 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_30881	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_97 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_97	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_976 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_976	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_9765 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_9765	blocks.19.hook_resid_post	19	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_0_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_1_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_2_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_3_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_4_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_final	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_0	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_308	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_3088	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_30881	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_97	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_976	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-4k__trainer_5_step_9765	blocks.5.hook_resid_post	5	4096	128	monology/pile-uncopyrighted	none

sae_bench_gemma-2-2b_topk_width-2pow14_date-1109

Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow14_date-1109
model: gemma-2-2b
Additional Links:
- Model

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.12.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_0_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_1_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_2_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_3_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_4_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-16k__trainer_5_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_0_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_1_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_2_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_3_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_4_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-16k__trainer_5_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_0_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_1_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_2_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_3_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_4_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-16k__trainer_5_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none

sae_bench_gemma-2-2b_vanilla_width-2pow14_date-1109

Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow14_date-1109
model: gemma-2-2b
Additional Links:
- Model

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.12.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_0_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_1_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_2_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_3_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_4_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_final	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_0	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_146 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_146	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_1464 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_1464	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_14648 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_14648	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_463 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_463	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_4632 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_4632	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_46322 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-16k__trainer_5_step_46322	blocks.12.hook_resid_post	12	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_0_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_1_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_2_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_3_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_4_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_final	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_0	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_146 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_146	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_1464 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_1464	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_14648 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_14648	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_463 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_463	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_4632 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_4632	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_46322 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-16k__trainer_5_step_46322	blocks.19.hook_resid_post	19	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_0_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_1_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_2_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_3_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_4_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_final	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_0	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_146 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_146	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_1464 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_1464	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_14648 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_14648	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_463 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_463	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_4632 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_4632	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_46322 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-16k__trainer_5_step_46322	blocks.5.hook_resid_post	5	16384	128	monology/pile-uncopyrighted	none

sae_bench_gemma-2-2b_vanilla_width-2pow16_date-1109

Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow16_date-1109
model: gemma-2-2b
Additional Links:
- Model

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.12.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_0_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_0_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_195 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_0_step_195	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_1953 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_0_step_1953	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_19531 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_0_step_19531	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_617 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_0_step_617	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_6176 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_0_step_6176	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_61763 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_0_step_61763	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_1_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_1_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_195 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_1_step_195	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_1953 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_1_step_1953	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_19531 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_1_step_19531	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_617 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_1_step_617	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_6176 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_1_step_6176	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_61763 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_1_step_61763	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_2_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_2_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_195 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_2_step_195	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_1953 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_2_step_1953	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_19531 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_2_step_19531	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_617 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_2_step_617	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_6176 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_2_step_6176	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_61763 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_2_step_61763	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_3_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_3_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_195 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_3_step_195	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_1953 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_3_step_1953	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_19531 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_3_step_19531	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_617 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_3_step_617	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_6176 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_3_step_6176	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_61763 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_3_step_61763	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_4_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_4_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_195 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_4_step_195	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_1953 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_4_step_1953	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_19531 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_4_step_19531	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_617 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_4_step_617	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_6176 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_4_step_6176	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_61763 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_4_step_61763	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_5_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_5_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_195 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_5_step_195	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_1953 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_5_step_1953	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_19531 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_5_step_19531	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_617 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_5_step_617	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_6176 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_5_step_6176	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_61763 Load this SAE	standard	gemma-2-2b/12-sae_bench-standard-res-65k__trainer_5_step_61763	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_0_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_0_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_0_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_0_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_0_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_0_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_0_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_0_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_1_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_1_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_1_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_1_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_1_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_1_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_1_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_1_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_2_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_2_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_2_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_2_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_2_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_2_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_2_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_2_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_3_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_3_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_3_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_3_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_3_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_3_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_3_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_3_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_4_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_4_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_4_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_4_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_4_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_4_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_4_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_4_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_5_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_5_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_5_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_5_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_5_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_5_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_5_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-standard-res-65k__trainer_5_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_0_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_0_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_195 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_0_step_195	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_1953 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_0_step_1953	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_19531 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_0_step_19531	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_617 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_0_step_617	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_6176 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_0_step_6176	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_61763 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_0_step_61763	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_1_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_1_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_195 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_1_step_195	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_1953 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_1_step_1953	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_19531 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_1_step_19531	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_617 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_1_step_617	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_6176 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_1_step_6176	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_61763 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_1_step_61763	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_2_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_2_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_195 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_2_step_195	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_1953 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_2_step_1953	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_19531 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_2_step_19531	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_617 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_2_step_617	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_6176 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_2_step_6176	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_61763 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_2_step_61763	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_3_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_3_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_195 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_3_step_195	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_1953 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_3_step_1953	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_19531 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_3_step_19531	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_617 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_3_step_617	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_6176 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_3_step_6176	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_61763 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_3_step_61763	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_4_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_4_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_195 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_4_step_195	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_1953 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_4_step_1953	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_19531 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_4_step_19531	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_617 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_4_step_617	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_6176 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_4_step_6176	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_61763 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_4_step_61763	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_5_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_5_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_195 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_5_step_195	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_1953 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_5_step_1953	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_19531 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_5_step_19531	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_617 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_5_step_617	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_6176 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_5_step_6176	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_61763 Load this SAE	standard	gemma-2-2b/5-sae_bench-standard-res-65k__trainer_5_step_61763	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none

sae_bench_gemma-2-2b_topk_width-2pow16_date-1109

Huggingface Repo: canrager/saebench_gemma-2-2b_width-2pow16_date-1109
model: gemma-2-2b
Additional Links:
- Model

id	architecture	neuronpedia	hook_name	hook_layer	d_sae	context_size	dataset_path	normalize_activations
blocks.12.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_0_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_0_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_0_step_308	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_0_step_3088	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_0_step_30881	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_0_step_97	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_0_step_976	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_0_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_0_step_9765	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_1_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_1_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_1_step_308	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_1_step_3088	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_1_step_30881	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_1_step_97	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_1_step_976	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_1_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_1_step_9765	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_2_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_2_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_2_step_308	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_2_step_3088	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_2_step_30881	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_2_step_97	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_2_step_976	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_2_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_2_step_9765	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_3_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_3_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_3_step_308	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_3_step_3088	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_3_step_30881	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_3_step_97	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_3_step_976	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_3_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_3_step_9765	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_4_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_4_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_4_step_308	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_4_step_3088	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_4_step_30881	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_4_step_97	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_4_step_976	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_4_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_4_step_9765	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_5_step_final	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_5_step_0	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_308 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_5_step_308	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_3088 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_5_step_3088	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_30881 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_5_step_30881	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_97 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_5_step_97	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_976 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_5_step_976	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.12.hook_resid_post__trainer_5_step_9765 Load this SAE	standard	gemma-2-2b/12-sae_bench-topk-res-65k__trainer_5_step_9765	blocks.12.hook_resid_post	12	65536	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_0_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_0_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_0_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_0_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_0_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_0_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_0_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_0_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_0_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_1_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_1_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_1_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_1_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_1_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_1_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_1_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_1_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_1_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_2_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_2_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_2_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_2_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_2_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_2_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_2_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_2_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_2_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_3_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_3_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_3_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_3_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_3_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_3_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_3_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_3_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_3_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_4_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_4_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_4_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_4_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_4_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_4_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_4_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_4_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_4_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_5_step_final	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_5_step_0	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_195 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_5_step_195	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_1953 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_5_step_1953	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_19531 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_5_step_19531	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_617 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_5_step_617	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_6176 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_5_step_6176	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.19.hook_resid_post__trainer_5_step_61763 Load this SAE	standard	gemma-2-2b/19-sae_bench-topk-res-65k__trainer_5_step_61763	blocks.19.hook_resid_post	19	64512	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_0_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_0_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_0_step_308	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_0_step_3088	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_0_step_30881	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_0_step_97	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_0_step_976	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_0_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_0_step_9765	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_1_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_1_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_1_step_308	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_1_step_3088	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_1_step_30881	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_1_step_97	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_1_step_976	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_1_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_1_step_9765	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_2_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_2_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_2_step_308	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_2_step_3088	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_2_step_30881	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_2_step_97	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_2_step_976	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_2_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_2_step_9765	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_3_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_3_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_3_step_308	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_3_step_3088	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_3_step_30881	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_3_step_97	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_3_step_976	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_3_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_3_step_9765	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_4_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_4_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_4_step_308	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_4_step_3088	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_4_step_30881	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_4_step_97	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_4_step_976	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_4_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_4_step_9765	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_5_step_final	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_0 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_5_step_0	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_308 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_5_step_308	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_3088 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_5_step_3088	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_30881 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_5_step_30881	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_97 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_5_step_97	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_976 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_5_step_976	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none
blocks.5.hook_resid_post__trainer_5_step_9765 Load this SAE	standard	gemma-2-2b/5-sae_bench-topk-res-65k__trainer_5_step_9765	blocks.5.hook_resid_post	5	65536	128	monology/pile-uncopyrighted	none