Skip to content

Pretrained SAEs

This is a list of SAEs importable from the SAELens package. Click on each link for more details.

This file contains the contents of sae_lens/pretrained_saes.yaml in Markdown

gpt2-small-res-jb

id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_pre
Load this SAE
standard gpt2-small/0-res-jb blocks.0.hook_resid_pre 0 24576 128 Skylion007/openwebtext none
blocks.1.hook_resid_pre
Load this SAE
standard gpt2-small/1-res-jb blocks.1.hook_resid_pre 1 24576 128 Skylion007/openwebtext none
blocks.2.hook_resid_pre
Load this SAE
standard gpt2-small/2-res-jb blocks.2.hook_resid_pre 2 24576 128 Skylion007/openwebtext none
blocks.3.hook_resid_pre
Load this SAE
standard gpt2-small/3-res-jb blocks.3.hook_resid_pre 3 24576 128 Skylion007/openwebtext none
blocks.4.hook_resid_pre
Load this SAE
standard gpt2-small/4-res-jb blocks.4.hook_resid_pre 4 24576 128 Skylion007/openwebtext none
blocks.5.hook_resid_pre
Load this SAE
standard gpt2-small/5-res-jb blocks.5.hook_resid_pre 5 24576 128 Skylion007/openwebtext none
blocks.6.hook_resid_pre
Load this SAE
standard gpt2-small/6-res-jb blocks.6.hook_resid_pre 6 24576 128 Skylion007/openwebtext none
blocks.7.hook_resid_pre
Load this SAE
standard gpt2-small/7-res-jb blocks.7.hook_resid_pre 7 24576 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre
Load this SAE
standard gpt2-small/8-res-jb blocks.8.hook_resid_pre 8 24576 128 Skylion007/openwebtext none
blocks.9.hook_resid_pre
Load this SAE
standard gpt2-small/9-res-jb blocks.9.hook_resid_pre 9 24576 128 Skylion007/openwebtext none
blocks.10.hook_resid_pre
Load this SAE
standard gpt2-small/10-res-jb blocks.10.hook_resid_pre 10 24576 128 Skylion007/openwebtext none
blocks.11.hook_resid_pre
Load this SAE
standard gpt2-small/11-res-jb blocks.11.hook_resid_pre 11 24576 128 Skylion007/openwebtext none
blocks.11.hook_resid_post
Load this SAE
standard gpt2-small/12-res-jb blocks.11.hook_resid_post 11 24576 128 Skylion007/openwebtext none

gpt2-small-hook-z-kk

id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_z
Load this SAE
standard gpt2-small/0-att-kk blocks.0.attn.hook_z 0 24576 128 Skylion007/openwebtext none
blocks.1.hook_z
Load this SAE
standard gpt2-small/1-att-kk blocks.1.attn.hook_z 1 24576 128 Skylion007/openwebtext none
blocks.2.hook_z
Load this SAE
standard gpt2-small/2-att-kk blocks.2.attn.hook_z 2 24576 128 Skylion007/openwebtext none
blocks.3.hook_z
Load this SAE
standard gpt2-small/3-att-kk blocks.3.attn.hook_z 3 24576 128 Skylion007/openwebtext none
blocks.4.hook_z
Load this SAE
standard gpt2-small/4-att-kk blocks.4.attn.hook_z 4 24576 128 Skylion007/openwebtext none
blocks.5.hook_z
Load this SAE
standard gpt2-small/5-att-kk blocks.5.attn.hook_z 5 49152 128 Skylion007/openwebtext none
blocks.6.hook_z
Load this SAE
standard gpt2-small/6-att-kk blocks.6.attn.hook_z 6 24576 128 Skylion007/openwebtext none
blocks.7.hook_z
Load this SAE
standard gpt2-small/7-att-kk blocks.7.attn.hook_z 7 49152 128 Skylion007/openwebtext none
blocks.8.hook_z
Load this SAE
standard gpt2-small/8-att-kk blocks.8.attn.hook_z 8 24576 128 Skylion007/openwebtext none
blocks.9.hook_z
Load this SAE
standard gpt2-small/9-att-kk blocks.9.attn.hook_z 9 24576 128 Skylion007/openwebtext none
blocks.10.hook_z
Load this SAE
standard gpt2-small/10-att-kk blocks.10.attn.hook_z 10 24576 128 Skylion007/openwebtext none
blocks.11.hook_z
Load this SAE
standard gpt2-small/11-att-kk blocks.11.attn.hook_z 11 24576 128 Skylion007/openwebtext none

gpt2-small-mlp-tm

  • Huggingface Repo: tommmcgrath/gpt2-small-mlp-out-saes
  • model: gpt2-small
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_mlp_out
Load this SAE
standard blocks.0.hook_mlp_out 0 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.1.hook_mlp_out
Load this SAE
standard blocks.1.hook_mlp_out 1 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.2.hook_mlp_out
Load this SAE
standard blocks.2.hook_mlp_out 2 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.3.hook_mlp_out
Load this SAE
standard blocks.3.hook_mlp_out 3 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.4.hook_mlp_out
Load this SAE
standard blocks.4.hook_mlp_out 4 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.5.hook_mlp_out
Load this SAE
standard blocks.5.hook_mlp_out 5 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.6.hook_mlp_out
Load this SAE
standard blocks.6.hook_mlp_out 6 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.7.hook_mlp_out
Load this SAE
standard blocks.7.hook_mlp_out 7 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.8.hook_mlp_out
Load this SAE
standard blocks.8.hook_mlp_out 8 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.9.hook_mlp_out
Load this SAE
standard blocks.9.hook_mlp_out 9 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.10.hook_mlp_out
Load this SAE
standard blocks.10.hook_mlp_out 10 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.11.hook_mlp_out
Load this SAE
standard blocks.11.hook_mlp_out 11 24576 512 Skylion007/openwebtext expected_average_only_in

gpt2-small-res-jb-feature-splitting

  • Huggingface Repo: jbloom/GPT2-Small-Feature-Splitting-Experiment-Layer-8
  • model: gpt2-small
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.8.hook_resid_pre_768
Load this SAE
standard gpt2-small/8-res_fs768-jb blocks.8.hook_resid_pre 8 768 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_1536
Load this SAE
standard gpt2-small/8-res_fs1536-jb blocks.8.hook_resid_pre 8 1536 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_3072
Load this SAE
standard gpt2-small/8-res_fs3072-jb blocks.8.hook_resid_pre 8 3072 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_6144
Load this SAE
standard gpt2-small/8-res_fs6144-jb blocks.8.hook_resid_pre 8 6144 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_12288
Load this SAE
standard gpt2-small/8-res_fs12288-jb blocks.8.hook_resid_pre 8 12288 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_24576
Load this SAE
standard gpt2-small/8-res_fs24576-jb blocks.8.hook_resid_pre 8 24576 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_49152
Load this SAE
standard gpt2-small/8-res_fs49152-jb blocks.8.hook_resid_pre 8 49152 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_98304
Load this SAE
standard gpt2-small/8-res_fs98304-jb blocks.8.hook_resid_pre 8 98304 128 Skylion007/openwebtext none

gpt2-small-resid-post-v5-32k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-resid-post-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_post
Load this SAE
standard gpt2-small/0-res_post_32k-oai blocks.0.hook_resid_post 0 32768 64 Skylion007/openwebtext layer_norm
blocks.1.hook_resid_post
Load this SAE
standard gpt2-small/1-res_post_32k-oai blocks.1.hook_resid_post 1 32768 64 Skylion007/openwebtext layer_norm
blocks.2.hook_resid_post
Load this SAE
standard gpt2-small/2-res_post_32k-oai blocks.2.hook_resid_post 2 32768 64 Skylion007/openwebtext layer_norm
blocks.3.hook_resid_post
Load this SAE
standard gpt2-small/3-res_post_32k-oai blocks.3.hook_resid_post 3 32768 64 Skylion007/openwebtext layer_norm
blocks.4.hook_resid_post
Load this SAE
standard gpt2-small/4-res_post_32k-oai blocks.4.hook_resid_post 4 32768 64 Skylion007/openwebtext layer_norm
blocks.5.hook_resid_post
Load this SAE
standard gpt2-small/5-res_post_32k-oai blocks.5.hook_resid_post 5 32768 64 Skylion007/openwebtext layer_norm
blocks.6.hook_resid_post
Load this SAE
standard gpt2-small/6-res_post_32k-oai blocks.6.hook_resid_post 6 32768 64 Skylion007/openwebtext layer_norm
blocks.7.hook_resid_post
Load this SAE
standard gpt2-small/7-res_post_32k-oai blocks.7.hook_resid_post 7 32768 64 Skylion007/openwebtext layer_norm
blocks.8.hook_resid_post
Load this SAE
standard gpt2-small/8-res_post_32k-oai blocks.8.hook_resid_post 8 32768 64 Skylion007/openwebtext layer_norm
blocks.9.hook_resid_post
Load this SAE
standard gpt2-small/9-res_post_32k-oai blocks.9.hook_resid_post 9 32768 64 Skylion007/openwebtext layer_norm
blocks.10.hook_resid_post
Load this SAE
standard gpt2-small/10-res_post_32k-oai blocks.10.hook_resid_post 10 32768 64 Skylion007/openwebtext layer_norm
blocks.11.hook_resid_post
Load this SAE
standard gpt2-small/11-res_post_32k-oai blocks.11.hook_resid_post 11 32768 64 Skylion007/openwebtext layer_norm

gpt2-small-resid-post-v5-128k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-resid-post-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_post
Load this SAE
standard gpt2-small/0-res_post_128k-oai blocks.0.hook_resid_post 0 131072 64 Skylion007/openwebtext layer_norm
blocks.1.hook_resid_post
Load this SAE
standard gpt2-small/1-res_post_128k-oai blocks.1.hook_resid_post 1 131072 64 Skylion007/openwebtext layer_norm
blocks.2.hook_resid_post
Load this SAE
standard gpt2-small/2-res_post_128k-oai blocks.2.hook_resid_post 2 131072 64 Skylion007/openwebtext layer_norm
blocks.3.hook_resid_post
Load this SAE
standard gpt2-small/3-res_post_128k-oai blocks.3.hook_resid_post 3 131072 64 Skylion007/openwebtext layer_norm
blocks.4.hook_resid_post
Load this SAE
standard gpt2-small/4-res_post_128k-oai blocks.4.hook_resid_post 4 131072 64 Skylion007/openwebtext layer_norm
blocks.5.hook_resid_post
Load this SAE
standard gpt2-small/5-res_post_128k-oai blocks.5.hook_resid_post 5 131072 64 Skylion007/openwebtext layer_norm
blocks.6.hook_resid_post
Load this SAE
standard gpt2-small/6-res_post_128k-oai blocks.6.hook_resid_post 6 131072 64 Skylion007/openwebtext layer_norm
blocks.7.hook_resid_post
Load this SAE
standard gpt2-small/7-res_post_128k-oai blocks.7.hook_resid_post 7 131072 64 Skylion007/openwebtext layer_norm
blocks.8.hook_resid_post
Load this SAE
standard gpt2-small/8-res_post_128k-oai blocks.8.hook_resid_post 8 131072 64 Skylion007/openwebtext layer_norm
blocks.9.hook_resid_post
Load this SAE
standard gpt2-small/9-res_post_128k-oai blocks.9.hook_resid_post 9 131072 64 Skylion007/openwebtext layer_norm
blocks.10.hook_resid_post
Load this SAE
standard gpt2-small/10-res_post_128k-oai blocks.10.hook_resid_post 10 131072 64 Skylion007/openwebtext layer_norm
blocks.11.hook_resid_post
Load this SAE
standard gpt2-small/11-res_post_128k-oai blocks.11.hook_resid_post 11 131072 64 Skylion007/openwebtext layer_norm

gemma-2b-res-jb

  • Huggingface Repo: jbloom/Gemma-2b-Residual-Stream-SAEs
  • model: gemma-2b
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_post
Load this SAE
standard gemma-2b/0-res-jb blocks.0.hook_resid_post 0 16384 1024 HuggingFaceFW/fineweb none
blocks.6.hook_resid_post
Load this SAE
standard gemma-2b/6-res-jb blocks.6.hook_resid_post 6 16384 1024 HuggingFaceFW/fineweb none
blocks.10.hook_resid_post
Load this SAE
standard gemma-2b/10-res-jb blocks.10.hook_resid_post 10 16384 1024 ctigges/openwebtext-gemma-1024-cl none
blocks.12.hook_resid_post
Load this SAE
standard gemma-2b/12-res-jb blocks.12.hook_resid_post 12 16384 1024 HuggingFaceFW/fineweb expected_average_only_in
blocks.17.hook_resid_post
Load this SAE
standard blocks.17.hook_resid_post 17 16384 1024 ctigges/openwebtext-gemma-1024-cl none

gemma-2b-it-res-jb

  • Huggingface Repo: jbloom/Gemma-2b-IT-Residual-Stream-SAEs
  • model: gemma-2b-it
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.12.hook_resid_post
Load this SAE
standard gemma-2b-it/12-res-jb blocks.12.hook_resid_post 12 16384 1024 Skylion007/openwebtext none

mistral-7b-res-wg

  • Huggingface Repo: JoshEngels/Mistral-7B-Residual-Stream-SAEs
  • model: mistral-7b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.8.hook_resid_pre
Load this SAE
standard blocks.8.hook_resid_pre 8 65536 256 monology/pile-uncopyrighted constant_norm_rescale
blocks.16.hook_resid_pre
Load this SAE
standard blocks.16.hook_resid_pre 16 65536 256 monology/pile-uncopyrighted constant_norm_rescale
blocks.24.hook_resid_pre
Load this SAE
standard blocks.24.hook_resid_pre 24 65536 256 monology/pile-uncopyrighted constant_norm_rescale

gpt2-small-resid-mid-v5-32k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-resid-mid-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_mid
Load this SAE
standard gpt2-small/0-res_mid_32k-oai blocks.0.hook_resid_mid 0 32768 64 Skylion007/openwebtext layer_norm
blocks.1.hook_resid_mid
Load this SAE
standard gpt2-small/1-res_mid_32k-oai blocks.1.hook_resid_mid 1 32768 64 Skylion007/openwebtext layer_norm
blocks.2.hook_resid_mid
Load this SAE
standard gpt2-small/2-res_mid_32k-oai blocks.2.hook_resid_mid 2 32768 64 Skylion007/openwebtext layer_norm
blocks.3.hook_resid_mid
Load this SAE
standard gpt2-small/3-res_mid_32k-oai blocks.3.hook_resid_mid 3 32768 64 Skylion007/openwebtext layer_norm
blocks.4.hook_resid_mid
Load this SAE
standard gpt2-small/4-res_mid_32k-oai blocks.4.hook_resid_mid 4 32768 64 Skylion007/openwebtext layer_norm
blocks.5.hook_resid_mid
Load this SAE
standard gpt2-small/5-res_mid_32k-oai blocks.5.hook_resid_mid 5 32768 64 Skylion007/openwebtext layer_norm
blocks.6.hook_resid_mid
Load this SAE
standard gpt2-small/6-res_mid_32k-oai blocks.6.hook_resid_mid 6 32768 64 Skylion007/openwebtext layer_norm
blocks.7.hook_resid_mid
Load this SAE
standard gpt2-small/7-res_mid_32k-oai blocks.7.hook_resid_mid 7 32768 64 Skylion007/openwebtext layer_norm
blocks.8.hook_resid_mid
Load this SAE
standard gpt2-small/8-res_mid_32k-oai blocks.8.hook_resid_mid 8 32768 64 Skylion007/openwebtext layer_norm
blocks.9.hook_resid_mid
Load this SAE
standard gpt2-small/9-res_mid_32k-oai blocks.9.hook_resid_mid 9 32768 64 Skylion007/openwebtext layer_norm
blocks.10.hook_resid_mid
Load this SAE
standard gpt2-small/10-res_mid_32k-oai blocks.10.hook_resid_mid 10 32768 64 Skylion007/openwebtext layer_norm
blocks.11.hook_resid_mid
Load this SAE
standard gpt2-small/11-res_mid_32k-oai blocks.11.hook_resid_mid 11 32768 64 Skylion007/openwebtext layer_norm

gpt2-small-resid-mid-v5-128k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-resid-mid-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_mid
Load this SAE
standard gpt2-small/0-res_mid_128k-oai blocks.0.hook_resid_mid 0 131072 64 Skylion007/openwebtext layer_norm
blocks.1.hook_resid_mid
Load this SAE
standard gpt2-small/1-res_mid_128k-oai blocks.1.hook_resid_mid 1 131072 64 Skylion007/openwebtext layer_norm
blocks.2.hook_resid_mid
Load this SAE
standard gpt2-small/2-res_mid_128k-oai blocks.2.hook_resid_mid 2 131072 64 Skylion007/openwebtext layer_norm
blocks.3.hook_resid_mid
Load this SAE
standard gpt2-small/3-res_mid_128k-oai blocks.3.hook_resid_mid 3 131072 64 Skylion007/openwebtext layer_norm
blocks.4.hook_resid_mid
Load this SAE
standard gpt2-small/4-res_mid_128k-oai blocks.4.hook_resid_mid 4 131072 64 Skylion007/openwebtext layer_norm
blocks.5.hook_resid_mid
Load this SAE
standard gpt2-small/5-res_mid_128k-oai blocks.5.hook_resid_mid 5 131072 64 Skylion007/openwebtext layer_norm
blocks.6.hook_resid_mid
Load this SAE
standard gpt2-small/6-res_mid_128k-oai blocks.6.hook_resid_mid 6 131072 64 Skylion007/openwebtext layer_norm
blocks.7.hook_resid_mid
Load this SAE
standard gpt2-small/7-res_mid_128k-oai blocks.7.hook_resid_mid 7 131072 64 Skylion007/openwebtext layer_norm
blocks.8.hook_resid_mid
Load this SAE
standard gpt2-small/8-res_mid_128k-oai blocks.8.hook_resid_mid 8 131072 64 Skylion007/openwebtext layer_norm
blocks.9.hook_resid_mid
Load this SAE
standard gpt2-small/9-res_mid_128k-oai blocks.9.hook_resid_mid 9 131072 64 Skylion007/openwebtext layer_norm
blocks.10.hook_resid_mid
Load this SAE
standard gpt2-small/10-res_mid_128k-oai blocks.10.hook_resid_mid 10 131072 64 Skylion007/openwebtext layer_norm
blocks.11.hook_resid_mid
Load this SAE
standard gpt2-small/11-res_mid_128k-oai blocks.11.hook_resid_mid 11 131072 64 Skylion007/openwebtext layer_norm

gpt2-small-mlp-out-v5-32k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-mlp-out-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_mlp_out
Load this SAE
standard gpt2-small/0-mlp_32k-oai blocks.0.hook_mlp_out 0 32768 64 Skylion007/openwebtext layer_norm
blocks.1.hook_mlp_out
Load this SAE
standard gpt2-small/1-mlp_32k-oai blocks.1.hook_mlp_out 1 32768 64 Skylion007/openwebtext layer_norm
blocks.2.hook_mlp_out
Load this SAE
standard gpt2-small/2-mlp_32k-oai blocks.2.hook_mlp_out 2 32768 64 Skylion007/openwebtext layer_norm
blocks.3.hook_mlp_out
Load this SAE
standard gpt2-small/3-mlp_32k-oai blocks.3.hook_mlp_out 3 32768 64 Skylion007/openwebtext layer_norm
blocks.4.hook_mlp_out
Load this SAE
standard gpt2-small/4-mlp_32k-oai blocks.4.hook_mlp_out 4 32768 64 Skylion007/openwebtext layer_norm
blocks.5.hook_mlp_out
Load this SAE
standard gpt2-small/5-mlp_32k-oai blocks.5.hook_mlp_out 5 32768 64 Skylion007/openwebtext layer_norm
blocks.6.hook_mlp_out
Load this SAE
standard gpt2-small/6-mlp_32k-oai blocks.6.hook_mlp_out 6 32768 64 Skylion007/openwebtext layer_norm
blocks.7.hook_mlp_out
Load this SAE
standard gpt2-small/7-mlp_32k-oai blocks.7.hook_mlp_out 7 32768 64 Skylion007/openwebtext layer_norm
blocks.8.hook_mlp_out
Load this SAE
standard gpt2-small/8-mlp_32k-oai blocks.8.hook_mlp_out 8 32768 64 Skylion007/openwebtext layer_norm
blocks.9.hook_mlp_out
Load this SAE
standard gpt2-small/9-mlp_32k-oai blocks.9.hook_mlp_out 9 32768 64 Skylion007/openwebtext layer_norm
blocks.10.hook_mlp_out
Load this SAE
standard gpt2-small/10-mlp_32k-oai blocks.10.hook_mlp_out 10 32768 64 Skylion007/openwebtext layer_norm
blocks.11.hook_mlp_out
Load this SAE
standard gpt2-small/11-mlp_32k-oai blocks.11.hook_mlp_out 11 32768 64 Skylion007/openwebtext layer_norm

gpt2-small-mlp-out-v5-128k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-mlp-out-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_mlp_out
Load this SAE
standard gpt2-small/0-mlp_128k-oai blocks.0.hook_mlp_out 0 131072 64 Skylion007/openwebtext layer_norm
blocks.1.hook_mlp_out
Load this SAE
standard gpt2-small/1-mlp_128k-oai blocks.1.hook_mlp_out 1 131072 64 Skylion007/openwebtext layer_norm
blocks.2.hook_mlp_out
Load this SAE
standard gpt2-small/2-mlp_128k-oai blocks.2.hook_mlp_out 2 131072 64 Skylion007/openwebtext layer_norm
blocks.3.hook_mlp_out
Load this SAE
standard gpt2-small/3-mlp_128k-oai blocks.3.hook_mlp_out 3 131072 64 Skylion007/openwebtext layer_norm
blocks.4.hook_mlp_out
Load this SAE
standard gpt2-small/4-mlp_128k-oai blocks.4.hook_mlp_out 4 131072 64 Skylion007/openwebtext layer_norm
blocks.5.hook_mlp_out
Load this SAE
standard gpt2-small/5-mlp_128k-oai blocks.5.hook_mlp_out 5 131072 64 Skylion007/openwebtext layer_norm
blocks.6.hook_mlp_out
Load this SAE
standard gpt2-small/6-mlp_128k-oai blocks.6.hook_mlp_out 6 131072 64 Skylion007/openwebtext layer_norm
blocks.7.hook_mlp_out
Load this SAE
standard gpt2-small/7-mlp_128k-oai blocks.7.hook_mlp_out 7 131072 64 Skylion007/openwebtext layer_norm
blocks.8.hook_mlp_out
Load this SAE
standard gpt2-small/8-mlp_128k-oai blocks.8.hook_mlp_out 8 131072 64 Skylion007/openwebtext layer_norm
blocks.9.hook_mlp_out
Load this SAE
standard gpt2-small/9-mlp_128k-oai blocks.9.hook_mlp_out 9 131072 64 Skylion007/openwebtext layer_norm
blocks.10.hook_mlp_out
Load this SAE
standard gpt2-small/10-mlp_128k-oai blocks.10.hook_mlp_out 10 131072 64 Skylion007/openwebtext layer_norm
blocks.11.hook_mlp_out
Load this SAE
standard gpt2-small/11-mlp_128k-oai blocks.11.hook_mlp_out 11 131072 64 Skylion007/openwebtext layer_norm

gpt2-small-attn-out-v5-32k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-attn-out-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_attn_out
Load this SAE
standard gpt2-small/0-att_32k-oai blocks.0.hook_attn_out 0 32768 64 Skylion007/openwebtext layer_norm
blocks.1.hook_attn_out
Load this SAE
standard gpt2-small/1-att_32k-oai blocks.1.hook_attn_out 1 32768 64 Skylion007/openwebtext layer_norm
blocks.2.hook_attn_out
Load this SAE
standard gpt2-small/2-att_32k-oai blocks.2.hook_attn_out 2 32768 64 Skylion007/openwebtext layer_norm
blocks.3.hook_attn_out
Load this SAE
standard gpt2-small/3-att_32k-oai blocks.3.hook_attn_out 3 32768 64 Skylion007/openwebtext layer_norm
blocks.4.hook_attn_out
Load this SAE
standard gpt2-small/4-att_32k-oai blocks.4.hook_attn_out 4 32768 64 Skylion007/openwebtext layer_norm
blocks.5.hook_attn_out
Load this SAE
standard gpt2-small/5-att_32k-oai blocks.5.hook_attn_out 5 32768 64 Skylion007/openwebtext layer_norm
blocks.6.hook_attn_out
Load this SAE
standard gpt2-small/6-att_32k-oai blocks.6.hook_attn_out 6 32768 64 Skylion007/openwebtext layer_norm
blocks.7.hook_attn_out
Load this SAE
standard gpt2-small/7-att_32k-oai blocks.7.hook_attn_out 7 32768 64 Skylion007/openwebtext layer_norm
blocks.8.hook_attn_out
Load this SAE
standard gpt2-small/8-att_32k-oai blocks.8.hook_attn_out 8 32768 64 Skylion007/openwebtext layer_norm
blocks.9.hook_attn_out
Load this SAE
standard gpt2-small/9-att_32k-oai blocks.9.hook_attn_out 9 32768 64 Skylion007/openwebtext layer_norm
blocks.10.hook_attn_out
Load this SAE
standard gpt2-small/10-att_32k-oai blocks.10.hook_attn_out 10 32768 64 Skylion007/openwebtext layer_norm
blocks.11.hook_attn_out
Load this SAE
standard gpt2-small/11-att_32k-oai blocks.11.hook_attn_out 11 32768 64 Skylion007/openwebtext layer_norm

gpt2-small-attn-out-v5-128k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-attn-out-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_attn_out
Load this SAE
standard gpt2-small/0-att_128k-oai blocks.0.hook_attn_out 0 131072 64 Skylion007/openwebtext layer_norm
blocks.1.hook_attn_out
Load this SAE
standard gpt2-small/1-att_128k-oai blocks.1.hook_attn_out 1 131072 64 Skylion007/openwebtext layer_norm
blocks.2.hook_attn_out
Load this SAE
standard gpt2-small/2-att_128k-oai blocks.2.hook_attn_out 2 131072 64 Skylion007/openwebtext layer_norm
blocks.3.hook_attn_out
Load this SAE
standard gpt2-small/3-att_128k-oai blocks.3.hook_attn_out 3 131072 64 Skylion007/openwebtext layer_norm
blocks.4.hook_attn_out
Load this SAE
standard gpt2-small/4-att_128k-oai blocks.4.hook_attn_out 4 131072 64 Skylion007/openwebtext layer_norm
blocks.5.hook_attn_out
Load this SAE
standard gpt2-small/5-att_128k-oai blocks.5.hook_attn_out 5 131072 64 Skylion007/openwebtext layer_norm
blocks.6.hook_attn_out
Load this SAE
standard gpt2-small/6-att_128k-oai blocks.6.hook_attn_out 6 131072 64 Skylion007/openwebtext layer_norm
blocks.7.hook_attn_out
Load this SAE
standard gpt2-small/7-att_128k-oai blocks.7.hook_attn_out 7 131072 64 Skylion007/openwebtext layer_norm
blocks.8.hook_attn_out
Load this SAE
standard gpt2-small/8-att_128k-oai blocks.8.hook_attn_out 8 131072 64 Skylion007/openwebtext layer_norm
blocks.9.hook_attn_out
Load this SAE
standard gpt2-small/9-att_128k-oai blocks.9.hook_attn_out 9 131072 64 Skylion007/openwebtext layer_norm
blocks.10.hook_attn_out
Load this SAE
standard gpt2-small/10-att_128k-oai blocks.10.hook_attn_out 10 131072 64 Skylion007/openwebtext layer_norm
blocks.11.hook_attn_out
Load this SAE
standard gpt2-small/11-att_128k-oai blocks.11.hook_attn_out 11 131072 64 Skylion007/openwebtext layer_norm

gemma-scope-2b-pt-res

  • Huggingface Repo: google/gemma-scope-2b-pt-res
  • model: gemma-2-2b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
embedding/width_4k/average_l0_6
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_44
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_21
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_111
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_105
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_13
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_226
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_25
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_46
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_10
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_102
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_20
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_250
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_40
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_13
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_141
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_142
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_24
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_304
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_53
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_14
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_142
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_28
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_315
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_59
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_124
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_125
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_17
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_281
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_31
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_60
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_143
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-16k__l0-143 blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_18
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-16k__l0-18 blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_309
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-16k__l0-309 blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-16k__l0-34 blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_68
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_144
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_19
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_301
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_36
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_70
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_137
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_20
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_285
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_36
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_69
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_142
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_20
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_301
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_37
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_71
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_151
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_21
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_340
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_37
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_73
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_166
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_21
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_39
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_395
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_77
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_168
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_22
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_393
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_41
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_80
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_176
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-16k__l0-176 blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_22
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-16k__l0-22 blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_41
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-16k__l0-41 blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_445
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-16k__l0-445 blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_82
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_173
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_23
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_403
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_43
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_83
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_84
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_173
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_23
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_388
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_43
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_83
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_84
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_150
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_23
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_308
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_41
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_78
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_154
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_23
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_335
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_42
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_78
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_150
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_23
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_304
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_42
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_77
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_138
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_23
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_280
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_40
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_74
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_137
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-16k__l0-137 blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_23
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-16k__l0-23 blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_279
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-16k__l0-279 blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_40
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-16k__l0-40 blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_73
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_139
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_22
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_294
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_38
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_71
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_139
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_22
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_301
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_38
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_70
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_147
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_21
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_349
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_38
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_72
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_157
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_21
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_38
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_404
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_74
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_75
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_158
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_20
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_38
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_457
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_73
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_116
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_16
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_28
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_285
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_55
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_114
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-1m__l0-114 blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_13
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-1m__l0-13 blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_21
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-1m__l0-21 blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_36
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-1m__l0-36 blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_63
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-1m__l0-63 blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_9
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-1m__l0-9 blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_107
Load this SAE
jumprelu blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_19
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-1m__l0-19 blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_207
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-1m__l0-207 blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_26
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-1m__l0-26 blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_58
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-1m__l0-58 blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_73
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-1m__l0-73 blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_157
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-1m__l0-157 blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_16
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-1m__l0-16 blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_18
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-1m__l0-18 blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_29
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-1m__l0-29 blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_50
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-1m__l0-50 blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_88
Load this SAE
jumprelu blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_11
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_121
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_21
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_243
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_36
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_67
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_12
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_155
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_22
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_360
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_40
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_76
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_115
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_22
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_227
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_29
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_46
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_65
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_12
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_129
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_20
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_264
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_36
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_67
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_11
Load this SAE
jumprelu blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_17
Load this SAE
jumprelu blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_27
Load this SAE
jumprelu blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_43
Load this SAE
jumprelu blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_73
Load this SAE
jumprelu blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_121
Load this SAE
jumprelu blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_16
Load this SAE
jumprelu blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_30
Load this SAE
jumprelu blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_54
Load this SAE
jumprelu blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_9
Load this SAE
jumprelu blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_11
Load this SAE
jumprelu blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_169
Load this SAE
jumprelu blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_20
Load this SAE
jumprelu blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_37
Load this SAE
jumprelu blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_77
Load this SAE
jumprelu blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_13
Load this SAE
jumprelu blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_193
Load this SAE
jumprelu blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_23
Load this SAE
jumprelu blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_42
Load this SAE
jumprelu blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_89
Load this SAE
jumprelu blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_14
Load this SAE
jumprelu blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_177
Load this SAE
jumprelu blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_25
Load this SAE
jumprelu blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_46
Load this SAE
jumprelu blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_89
Load this SAE
jumprelu blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_105
Load this SAE
jumprelu blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_17
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-65k__l0-17 blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_211
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-65k__l0-211 blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_29
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-65k__l0-29 blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_53
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-65k__l0-53 blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_107
Load this SAE
jumprelu blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_17
Load this SAE
jumprelu blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_208
Load this SAE
jumprelu blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_30
Load this SAE
jumprelu blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_56
Load this SAE
jumprelu blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_107
Load this SAE
jumprelu blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_18
Load this SAE
jumprelu blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_203
Load this SAE
jumprelu blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_31
Load this SAE
jumprelu blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_57
Load this SAE
jumprelu blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_111
Load this SAE
jumprelu blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_19
Load this SAE
jumprelu blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_213
Load this SAE
jumprelu blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_33
Load this SAE
jumprelu blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_59
Load this SAE
jumprelu blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_118
Load this SAE
jumprelu blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_19
Load this SAE
jumprelu blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_240
Load this SAE
jumprelu blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_34
Load this SAE
jumprelu blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_61
Load this SAE
jumprelu blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_128
Load this SAE
jumprelu blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_20
Load this SAE
jumprelu blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_265
Load this SAE
jumprelu blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_36
Load this SAE
jumprelu blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_66
Load this SAE
jumprelu blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_134
Load this SAE
jumprelu blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_21
Load this SAE
jumprelu blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_273
Load this SAE
jumprelu blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_37
Load this SAE
jumprelu blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_70
Load this SAE
jumprelu blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_141
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-65k__l0-141 blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_21
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-65k__l0-21 blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_297
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-65k__l0-297 blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_38
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-65k__l0-38 blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_72
Load this SAE
jumprelu blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_142
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_22
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_288
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_40
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_74
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_75
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_144
Load this SAE
jumprelu blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_21
Load this SAE
jumprelu blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_284
Load this SAE
jumprelu blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_40
Load this SAE
jumprelu blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_73
Load this SAE
jumprelu blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_127
Load this SAE
jumprelu blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_21
Load this SAE
jumprelu blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_240
Load this SAE
jumprelu blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_38
Load this SAE
jumprelu blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_68
Load this SAE
jumprelu blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_128
Load this SAE
jumprelu blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_21
Load this SAE
jumprelu blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_244
Load this SAE
jumprelu blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_38
Load this SAE
jumprelu blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_69
Load this SAE
jumprelu blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_125
Load this SAE
jumprelu blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_21
Load this SAE
jumprelu blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_233
Load this SAE
jumprelu blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_38
Load this SAE
jumprelu blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_68
Load this SAE
jumprelu blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_116
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_117
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_21
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_216
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_36
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_64
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_115
Load this SAE
jumprelu blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_21
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-65k__l0-21 blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_216
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-65k__l0-216 blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_35
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-65k__l0-35 blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_63
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-65k__l0-63 blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_114
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_20
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_221
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_34
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_61
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_111
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_112
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_20
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_225
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_33
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_61
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_116
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_117
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_20
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_248
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_33
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_62
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_123
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_124
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_20
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_272
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_35
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_64
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_124
Load this SAE
jumprelu blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_19
Load this SAE
jumprelu blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_273
Load this SAE
jumprelu blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_34
Load this SAE
jumprelu blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_63
Load this SAE
jumprelu blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_15
Load this SAE
jumprelu blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_197
Load this SAE
jumprelu blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_26
Load this SAE
jumprelu blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_48
Load this SAE
jumprelu blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_93
Load this SAE
jumprelu blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-2b-pt-res-canonical

id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-res-16k blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-res-16k blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-res-16k blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-res-16k blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-res-16k blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-16k blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-res-16k blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-res-16k blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-res-16k blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-res-16k blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-res-16k blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-res-16k blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-16k blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-res-16k blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-res-16k blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-res-16k blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-res-16k blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-res-16k blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-res-16k blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-16k blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-res-16k blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-res-16k blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-res-16k blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-res-16k blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-res-16k blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-res-16k blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_5/width_1m/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-1m blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-1m blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-1m blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_12/width_262k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-262k blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_32k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-32k blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_524k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-524k blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_0/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-res-65k blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-res-65k blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-res-65k blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-res-65k blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-res-65k blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-65k blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-res-65k blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-res-65k blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-res-65k blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-res-65k blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-res-65k blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-res-65k blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-65k blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-res-65k blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-res-65k blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-res-65k blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-res-65k blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-res-65k blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-res-65k blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-65k blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-res-65k blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-res-65k blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-res-65k blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-res-65k blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-res-65k blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-res-65k blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-2b-pt-mlp

  • Huggingface Repo: google/gemma-scope-2b-pt-mlp
  • model: gemma-2-2b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/average_l0_119
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_16
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_30
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_60
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_9
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_105
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_12
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_239
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_24
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_50
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_19
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_213
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_41
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_434
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_95
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_195
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_21
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_377
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_44
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_95
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_18
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_198
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_38
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_433
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_85
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_114
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_23
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_269
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_48
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_575
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_133
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_25
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_328
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_55
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_699
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_146
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_28
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_355
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_60
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_731
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_136
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_27
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_351
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_56
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_739
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_216
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_38
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_482
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_861
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_88
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_110
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_266
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_45
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_568
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_908
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_234
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_42
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_499
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_847
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_98
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_108
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_262
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_44
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_548
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_879
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_112
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_267
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_47
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_553
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_892
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_246
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_41
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_536
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_894
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_97
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_207
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_35
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_492
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_80
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_879
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_185
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_33
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_452
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_72
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_847
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_179
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_31
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_453
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_68
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_853
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_106
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_24
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_292
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_47
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_672
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_109
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_25
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_295
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_50
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_673
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_109
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_24
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_289
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_49
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_658
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_113
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_23
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_279
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_48
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_633
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_121
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_24
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_290
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_51
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_624
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_128
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_27
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_287
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_57
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_627
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_158
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_19
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_35
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_357
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_73
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_126
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_15
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_277
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_29
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_59
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_12
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_21
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_39
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_7
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_72
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_11
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_127
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_20
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_37
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_67
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_134
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_16
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_265
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_31
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_60
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_144
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_18
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_279
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_33
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_68
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_138
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_17
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_299
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_32
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_66
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_186
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_22
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_407
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_43
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_86
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_101
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_224
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_24
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_47
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_515
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_115
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_266
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_28
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_56
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_571
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_110
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_256
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_31
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_547
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_55
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_168
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_38
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_387
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_745
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_77
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_218
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_43
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_474
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_851
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_95
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_200
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_41
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_436
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_771
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_88
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_222
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_44
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_482
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_848
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_96
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_228
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_44
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_480
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_841
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_98
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_204
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_39
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_463
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_816
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_89
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_164
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_35
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_405
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_72
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_754
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_142
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_32
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_348
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_66
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_695
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_136
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_30
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_342
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_61
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_666
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_191
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_24
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_44
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_491
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_88
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_192
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_25
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_45
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_470
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_88
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_189
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_23
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_44
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_446
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_88
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_192
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_23
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_42
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_472
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_86
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_203
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_23
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_46
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_487
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_92
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_102
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_218
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_25
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_49
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_497
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_128
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_18
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_268
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_32
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_62
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_107
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_14
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_215
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_26
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_52
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-2b-pt-mlp-canonical

  • Huggingface Repo: google/gemma-scope-2b-pt-mlp
  • model: gemma-2-2b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-mlp-16k blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-mlp-16k blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-mlp-16k blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-mlp-16k blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-mlp-16k blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-mlp-16k blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-mlp-16k blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-mlp-16k blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-mlp-16k blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-mlp-16k blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-mlp-16k blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-mlp-16k blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-mlp-16k blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-mlp-16k blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-mlp-16k blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-mlp-16k blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-mlp-16k blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-mlp-16k blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-mlp-16k blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-mlp-16k blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-mlp-16k blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-mlp-16k blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-mlp-16k blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-mlp-16k blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-mlp-16k blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-mlp-16k blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_0/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-mlp-65k blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-mlp-65k blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-mlp-65k blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-mlp-65k blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-mlp-65k blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-mlp-65k blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-mlp-65k blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-mlp-65k blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-mlp-65k blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-mlp-65k blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-mlp-65k blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-mlp-65k blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-mlp-65k blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-mlp-65k blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-mlp-65k blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-mlp-65k blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-mlp-65k blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-mlp-65k blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-mlp-65k blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-mlp-65k blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-mlp-65k blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-mlp-65k blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-mlp-65k blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-mlp-65k blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-mlp-65k blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-mlp-65k blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-2b-pt-att

  • Huggingface Repo: google/gemma-scope-2b-pt-att
  • model: gemma-2-2b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/average_l0_104
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_12
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_18
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_30
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_57
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_146
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_20
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_251
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_40
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_79
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_174
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_19
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_297
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_43
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_93
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_117
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_219
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_24
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_386
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_55
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_116
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_249
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_26
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_454
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_53
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_135
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_268
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_30
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_449
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_59
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_143
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_292
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_30
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_479
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_61
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_184
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_331
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_46
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_537
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_99
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_129
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_282
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_32
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_482
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_64
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_127
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_270
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_34
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_499
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_64
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_148
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_307
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_36
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_541
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_70
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_170
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_350
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_41
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_593
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_80
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_184
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_328
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_41
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_514
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_85
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_203
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_372
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_43
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_570
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_92
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_161
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_298
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_37
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_468
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_71
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_195
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_342
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_44
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_535
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_98
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_144
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_293
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_37
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_527
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_71
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_176
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_316
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_38
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_509
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_79
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_144
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_292
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_34
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_491
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_72
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_122
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_249
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_28
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_423
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_56
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_141
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_274
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_31
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_446
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_62
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_142
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_301
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_32
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_505
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_65
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_106
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_215
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_22
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_373
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_47
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_161
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_30
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_300
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_474
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_73
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_212
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_372
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_39
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_558
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_96
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_177
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_313
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_35
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_492
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_77
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_10
Load this SAE
jumprelu blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_16
Load this SAE
jumprelu blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_24
Load this SAE
jumprelu blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_43
Load this SAE
jumprelu blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_75
Load this SAE
jumprelu blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_15
Load this SAE
jumprelu blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_181
Load this SAE
jumprelu blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_28
Load this SAE
jumprelu blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_55
Load this SAE
jumprelu blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_98
Load this SAE
jumprelu blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_125
Load this SAE
jumprelu blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_14
Load this SAE
jumprelu blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_228
Load this SAE
jumprelu blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_28
Load this SAE
jumprelu blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_59
Load this SAE
jumprelu blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_174
Load this SAE
jumprelu blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_19
Load this SAE
jumprelu blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_320
Load this SAE
jumprelu blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_39
Load this SAE
jumprelu blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_83
Load this SAE
jumprelu blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_188
Load this SAE
jumprelu blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_22
Load this SAE
jumprelu blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_382
Load this SAE
jumprelu blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_43
Load this SAE
jumprelu blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_87
Load this SAE
jumprelu blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_227
Load this SAE
jumprelu blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_28
Load this SAE
jumprelu blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_400
Load this SAE
jumprelu blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_51
Load this SAE
jumprelu blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_99
Load this SAE
jumprelu blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_112
Load this SAE
jumprelu blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_261
Load this SAE
jumprelu blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_30
Load this SAE
jumprelu blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_449
Load this SAE
jumprelu blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_55
Load this SAE
jumprelu blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_176
Load this SAE
jumprelu blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_311
Load this SAE
jumprelu blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_519
Load this SAE
jumprelu blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_52
Load this SAE
jumprelu blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_96
Load this SAE
jumprelu blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_112
Load this SAE
jumprelu blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_246
Load this SAE
jumprelu blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_35
Load this SAE
jumprelu blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_454
Load this SAE
jumprelu blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_56
Load this SAE
jumprelu blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_107
Load this SAE
jumprelu blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_231
Load this SAE
jumprelu blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_31
Load this SAE
jumprelu blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_454
Load this SAE
jumprelu blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_57
Load this SAE
jumprelu blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_134
Load this SAE
jumprelu blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_292
Load this SAE
jumprelu blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_35
Load this SAE
jumprelu blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_521
Load this SAE
jumprelu blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_67
Load this SAE
jumprelu blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_154
Load this SAE
jumprelu blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_330
Load this SAE
jumprelu blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_41
Load this SAE
jumprelu blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_576
Load this SAE
jumprelu blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_75
Load this SAE
jumprelu blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_172
Load this SAE
jumprelu blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_320
Load this SAE
jumprelu blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_39
Load this SAE
jumprelu blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_503
Load this SAE
jumprelu blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_79
Load this SAE
jumprelu blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_191
Load this SAE
jumprelu blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_363
Load this SAE
jumprelu blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_41
Load this SAE
jumprelu blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_556
Load this SAE
jumprelu blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_87
Load this SAE
jumprelu blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_138
Load this SAE
jumprelu blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_283
Load this SAE
jumprelu blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_37
Load this SAE
jumprelu blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_453
Load this SAE
jumprelu blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_66
Load this SAE
jumprelu blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_182
Load this SAE
jumprelu blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_327
Load this SAE
jumprelu blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_42
Load this SAE
jumprelu blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_517
Load this SAE
jumprelu blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_90
Load this SAE
jumprelu blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_129
Load this SAE
jumprelu blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_260
Load this SAE
jumprelu blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_35
Load this SAE
jumprelu blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_502
Load this SAE
jumprelu blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_64
Load this SAE
jumprelu blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_157
Load this SAE
jumprelu blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_293
Load this SAE
jumprelu blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_35
Load this SAE
jumprelu blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_489
Load this SAE
jumprelu blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_70
Load this SAE
jumprelu blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_123
Load this SAE
jumprelu blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_255
Load this SAE
jumprelu blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_29
Load this SAE
jumprelu blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_466
Load this SAE
jumprelu blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_58
Load this SAE
jumprelu blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_106
Load this SAE
jumprelu blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_220
Load this SAE
jumprelu blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_26
Load this SAE
jumprelu blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_411
Load this SAE
jumprelu blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_49
Load this SAE
jumprelu blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_102
Load this SAE
jumprelu blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_242
Load this SAE
jumprelu blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_26
Load this SAE
jumprelu blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_419
Load this SAE
jumprelu blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_49
Load this SAE
jumprelu blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_118
Load this SAE
jumprelu blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_266
Load this SAE
jumprelu blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_29
Load this SAE
jumprelu blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_474
Load this SAE
jumprelu blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_56
Load this SAE
jumprelu blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_112
Load this SAE
jumprelu blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_196
Load this SAE
jumprelu blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_20
Load this SAE
jumprelu blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_361
Load this SAE
jumprelu blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_37
Load this SAE
jumprelu blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_140
Load this SAE
jumprelu blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_27
Load this SAE
jumprelu blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_276
Load this SAE
jumprelu blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_457
Load this SAE
jumprelu blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_56
Load this SAE
jumprelu blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_186
Load this SAE
jumprelu blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_32
Load this SAE
jumprelu blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_347
Load this SAE
jumprelu blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_537
Load this SAE
jumprelu blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_77
Load this SAE
jumprelu blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_153
Load this SAE
jumprelu blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_290
Load this SAE
jumprelu blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_30
Load this SAE
jumprelu blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_465
Load this SAE
jumprelu blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_63
Load this SAE
jumprelu blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-2b-pt-att-canonical

  • Huggingface Repo: google/gemma-scope-2b-pt-att
  • model: gemma-2-2b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-att-16k blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-att-16k blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-att-16k blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-att-16k blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-att-16k blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-att-16k blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-att-16k blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-att-16k blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-att-16k blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-att-16k blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-att-16k blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-att-16k blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-att-16k blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-att-16k blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-att-16k blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-att-16k blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-att-16k blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-att-16k blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-att-16k blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-att-16k blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-att-16k blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-att-16k blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-att-16k blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-att-16k blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-att-16k blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-att-16k blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_0/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-att-65k blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-att-65k blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-att-65k blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-att-65k blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-att-65k blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-att-65k blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-att-65k blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-att-65k blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-att-65k blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-att-65k blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-att-65k blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-att-65k blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-att-65k blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-att-65k blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-att-65k blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-att-65k blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-att-65k blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-att-65k blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-att-65k blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-att-65k blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-att-65k blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-att-65k blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-att-65k blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-att-65k blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-att-65k blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-att-65k blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-9b-pt-res

  • Huggingface Repo: google/gemma-scope-9b-pt-res
  • model: gemma-2-9b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
embedding/width_4k/average_l0_14
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_22
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_7
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_80
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_11
Load this SAE
jumprelu blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_15
Load this SAE
jumprelu blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_21
Load this SAE
jumprelu blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_30
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-res-131k__l0-30 blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_41
Load this SAE
jumprelu blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_8
Load this SAE
jumprelu blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_11
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_129
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_17
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-res-16k__l0-35 blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_68
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_13
Load this SAE
jumprelu blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_20
Load this SAE
jumprelu blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-res-131k__l0-33 blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_56
Load this SAE
jumprelu blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_6
Load this SAE
jumprelu blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_9
Load this SAE
jumprelu blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_15
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_175
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_31
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_69
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-res-16k__l0-69 blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_9
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_15
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_151
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_27
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_47
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-res-131k__l0-47 blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_84
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_9
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_10
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_113
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_17
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_243
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_31
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_57
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-res-16k__l0-57 blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_16
Load this SAE
jumprelu blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_162
Load this SAE
jumprelu blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_27
Load this SAE
jumprelu blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_49
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-res-131k__l0-49 blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_88
Load this SAE
jumprelu blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_9
Load this SAE
jumprelu blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_10
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_118
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_18
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_255
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-res-16k__l0-32 blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_60
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_10
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_17
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_183
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_29
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_52
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-res-131k__l0-52 blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_96
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_10
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_130
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_19
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_287
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-res-16k__l0-33 blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_64
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_10
Load this SAE
jumprelu blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_17
Load this SAE
jumprelu blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_189
Load this SAE
jumprelu blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_30
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-res-131k__l0-30 blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_54
Load this SAE
jumprelu blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_99
Load this SAE
jumprelu blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_11
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_132
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_19
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_285
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-res-16k__l0-34 blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_65
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_10
Load this SAE
jumprelu blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_105
Load this SAE
jumprelu blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_18
Load this SAE
jumprelu blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_197
Load this SAE
jumprelu blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_31
Load this SAE
jumprelu blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_56
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-res-131k__l0-56 blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_11
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_137
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_19
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_294
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-res-16k__l0-35 blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_67
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_10
Load this SAE
jumprelu blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_103
Load this SAE
jumprelu blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_17
Load this SAE
jumprelu blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_198
Load this SAE
jumprelu blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_30
Load this SAE
jumprelu blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_55
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-res-131k__l0-55 blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_10
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_131
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_18
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_290
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-res-16k__l0-34 blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_65
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_11
Load this SAE
jumprelu blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_121
Load this SAE
jumprelu blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_20
Load this SAE
jumprelu blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_232
Load this SAE
jumprelu blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-res-131k__l0-35 blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_65
Load this SAE
jumprelu blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_11
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_152
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_21
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_346
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_39
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-res-16k__l0-39 blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_75
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_11
Load this SAE
jumprelu blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_117
Load this SAE
jumprelu blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_19
Load this SAE
jumprelu blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_221
Load this SAE
jumprelu blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-res-131k__l0-35 blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_64
Load this SAE
jumprelu blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_12
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_144
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_21
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_317
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_38
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-res-16k__l0-38 blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_73
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_11
Load this SAE
jumprelu blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_113
Load this SAE
jumprelu blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_19
Load this SAE
jumprelu blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_221
Load this SAE
jumprelu blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-res-131k__l0-34 blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_62
Load this SAE
jumprelu blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_11
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_140
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_20
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_309
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-res-16k__l0-37 blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_71
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_10
Load this SAE
jumprelu blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_110
Load this SAE
jumprelu blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_18
Load this SAE
jumprelu blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_210
Load this SAE
jumprelu blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-res-131k__l0-32 blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_60
Load this SAE
jumprelu blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_11
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_132
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_19
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_293
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-res-16k__l0-35 blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_67
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_12
Load this SAE
jumprelu blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_19
Load this SAE
jumprelu blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_36
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-res-131k__l0-36 blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_5
Load this SAE
jumprelu blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_70
Load this SAE
jumprelu blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_8
Load this SAE
jumprelu blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_14
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_189
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_29
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_67
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-res-16k__l0-67 blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_8
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k__l0-10 blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_11
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k__l0-11 blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_114
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k__l0-12 blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_19
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k__l0-19 blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_221
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k__l0-221 blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_276
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k__l0-276 blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k__l0-34 blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_53
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k__l0-53 blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_62
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k__l0-62 blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_11
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-16k__l0-11 blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_138
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-16k__l0-138 blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_20
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-16k__l0-20 blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_310
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-16k__l0-310 blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_36
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-16k__l0-36 blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_408
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-16k__l0-408 blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_58
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-16k__l0-58 blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_68
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_101
Load this SAE
jumprelu blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_11
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-1m__l0-11 blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_19
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-1m__l0-19 blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_193
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-1m__l0-193 blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_34
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-1m__l0-34 blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_57
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-1m__l0-57 blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_11
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_259
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_50
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_32k/average_l0_11
Load this SAE
jumprelu blocks.20.hook_resid_post 20 32768 1024 monology/pile-uncopyrighted
layer_20/width_32k/average_l0_344
Load this SAE
jumprelu blocks.20.hook_resid_post 20 32768 1024 monology/pile-uncopyrighted
layer_20/width_32k/average_l0_57
Load this SAE
jumprelu blocks.20.hook_resid_post 20 32768 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_10
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_241
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_48
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_11
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_55
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_298
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_109
Load this SAE
jumprelu blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_11
Load this SAE
jumprelu blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_19
Load this SAE
jumprelu blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_204
Load this SAE
jumprelu blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-res-131k__l0-33 blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_58
Load this SAE
jumprelu blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_11
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_129
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_19
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_278
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_36
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-res-16k__l0-36 blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_66
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_10
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_105
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_18
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_197
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-res-131k__l0-32 blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_58
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_11
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_123
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_19
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_268
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-res-16k__l0-35 blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_65
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_10
Load this SAE
jumprelu blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_101
Load this SAE
jumprelu blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_18
Load this SAE
jumprelu blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_187
Load this SAE
jumprelu blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-res-131k__l0-32 blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_56
Load this SAE
jumprelu blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_11
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_120
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_19
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_248
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-res-16k__l0-35 blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_63
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_10
Load this SAE
jumprelu blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_17
Load this SAE
jumprelu blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_180
Load this SAE
jumprelu blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_30
Load this SAE
jumprelu blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_55
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-res-131k__l0-55 blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_97
Load this SAE
jumprelu blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_10
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_114
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_19
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_234
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-res-16k__l0-34 blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_61
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_10
Load this SAE
jumprelu blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_177
Load this SAE
jumprelu blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_18
Load this SAE
jumprelu blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_31
Load this SAE
jumprelu blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_54
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-res-131k__l0-54 blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_96
Load this SAE
jumprelu blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_11
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_114
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_19
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_231
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-res-16k__l0-34 blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_61
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_10
Load this SAE
jumprelu blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_176
Load this SAE
jumprelu blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_18
Load this SAE
jumprelu blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-res-131k__l0-32 blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_55
Load this SAE
jumprelu blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_97
Load this SAE
jumprelu blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_11
Load this SAE
jumprelu blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_116
Load this SAE
jumprelu blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_20
Load this SAE
jumprelu blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_233
Load this SAE
jumprelu blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-res-16k__l0-35 blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_63
Load this SAE
jumprelu blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_11
Load this SAE
jumprelu blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_171
Load this SAE
jumprelu blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_19
Load this SAE
jumprelu blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-res-131k__l0-33 blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_56
Load this SAE
jumprelu blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_96
Load this SAE
jumprelu blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_118
Load this SAE
jumprelu blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_12
Load this SAE
jumprelu blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_21
Load this SAE
jumprelu blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_230
Load this SAE
jumprelu blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_36
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-res-16k__l0-36 blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_65
Load this SAE
jumprelu blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_11
Load this SAE
jumprelu blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_171
Load this SAE
jumprelu blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_19
Load this SAE
jumprelu blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-res-131k__l0-32 blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_57
Load this SAE
jumprelu blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_98
Load this SAE
jumprelu blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_119
Load this SAE
jumprelu blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_12
Load this SAE
jumprelu blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_21
Load this SAE
jumprelu blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_229
Load this SAE
jumprelu blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-res-16k__l0-37 blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_65
Load this SAE
jumprelu blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_11
Load this SAE
jumprelu blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_171
Load this SAE
jumprelu blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_19
Load this SAE
jumprelu blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-res-131k__l0-33 blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_56
Load this SAE
jumprelu blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_97
Load this SAE
jumprelu blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_119
Load this SAE
jumprelu blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_12
Load this SAE
jumprelu blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_21
Load this SAE
jumprelu blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_224
Load this SAE
jumprelu blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_38
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-res-16k__l0-38 blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_66
Load this SAE
jumprelu blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_103
Load this SAE
jumprelu blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_14
Load this SAE
jumprelu blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_25
Load this SAE
jumprelu blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_46
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-res-131k__l0-46 blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_6
Load this SAE
jumprelu blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_9
Load this SAE
jumprelu blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_10
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_17
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_229
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-res-16k__l0-37 blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_90
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_11
Load this SAE
jumprelu blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_170
Load this SAE
jumprelu blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_18
Load this SAE
jumprelu blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-res-131k__l0-32 blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_56
Load this SAE
jumprelu blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_95
Load this SAE
jumprelu blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_12
Load this SAE
jumprelu blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_120
Load this SAE
jumprelu blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_21
Load this SAE
jumprelu blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_226
Load this SAE
jumprelu blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-res-16k__l0-37 blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_66
Load this SAE
jumprelu blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_10
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-131k__l0-10 blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_160
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-131k__l0-160 blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_18
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-131k__l0-18 blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_31
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-131k__l0-31 blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_52
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-131k__l0-52 blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_92
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_11
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-16k__l0-11 blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_114
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-16k__l0-114 blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_20
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-16k__l0-20 blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_218
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-16k__l0-218 blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-16k__l0-35 blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_63
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-16k__l0-63 blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_11
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-1m__l0-11 blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_132
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-1m__l0-132 blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_25
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-1m__l0-25 blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_27
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-1m__l0-27 blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_45
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-1m__l0-45 blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_77
Load this SAE
jumprelu blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_10
Load this SAE
jumprelu blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_158
Load this SAE
jumprelu blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_18
Load this SAE
jumprelu blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_30
Load this SAE
jumprelu blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-res-131k__l0-51 blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_88
Load this SAE
jumprelu blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_11
Load this SAE
jumprelu blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_111
Load this SAE
jumprelu blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_20
Load this SAE
jumprelu blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_219
Load this SAE
jumprelu blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-res-16k__l0-34 blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_61
Load this SAE
jumprelu blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_10
Load this SAE
jumprelu blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_165
Load this SAE
jumprelu blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_18
Load this SAE
jumprelu blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_30
Load this SAE
jumprelu blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-res-131k__l0-51 blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_91
Load this SAE
jumprelu blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_11
Load this SAE
jumprelu blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_114
Load this SAE
jumprelu blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_20
Load this SAE
jumprelu blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_228
Load this SAE
jumprelu blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-res-16k__l0-34 blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_63
Load this SAE
jumprelu blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_10
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_163
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_17
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_30
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-res-131k__l0-51 blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_89
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_11
Load this SAE
jumprelu blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_114
Load this SAE
jumprelu blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_19
Load this SAE
jumprelu blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_229
Load this SAE
jumprelu blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-res-16k__l0-34 blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_60
Load this SAE
jumprelu blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_10
Load this SAE
jumprelu blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_17
Load this SAE
jumprelu blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_171
Load this SAE
jumprelu blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_30
Load this SAE
jumprelu blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-res-131k__l0-51 blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_94
Load this SAE
jumprelu blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_11
Load this SAE
jumprelu blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_120
Load this SAE
jumprelu blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_19
Load this SAE
jumprelu blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_246
Load this SAE
jumprelu blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-res-16k__l0-34 blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_61
Load this SAE
jumprelu blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_10
Load this SAE
jumprelu blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_17
Load this SAE
jumprelu blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_180
Load this SAE
jumprelu blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_30
Load this SAE
jumprelu blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-res-131k__l0-51 blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_93
Load this SAE
jumprelu blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_11
Load this SAE
jumprelu blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_120
Load this SAE
jumprelu blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_19
Load this SAE
jumprelu blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_252
Load this SAE
jumprelu blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-res-16k__l0-34 blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_61
Load this SAE
jumprelu blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_10
Load this SAE
jumprelu blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_18
Load this SAE
jumprelu blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_184
Load this SAE
jumprelu blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_30
Load this SAE
jumprelu blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_53
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-res-131k__l0-53 blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_96
Load this SAE
jumprelu blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_11
Load this SAE
jumprelu blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_124
Load this SAE
jumprelu blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_20
Load this SAE
jumprelu blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_266
Load this SAE
jumprelu blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-res-16k__l0-34 blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_63
Load this SAE
jumprelu blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_10
Load this SAE
jumprelu blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_101
Load this SAE
jumprelu blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_18
Load this SAE
jumprelu blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_194
Load this SAE
jumprelu blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_30
Load this SAE
jumprelu blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_53
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-res-131k__l0-53 blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_11
Load this SAE
jumprelu blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_128
Load this SAE
jumprelu blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_20
Load this SAE
jumprelu blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_286
Load this SAE
jumprelu blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-res-16k__l0-34 blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_64
Load this SAE
jumprelu blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_10
Load this SAE
jumprelu blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_18
Load this SAE
jumprelu blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_199
Load this SAE
jumprelu blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_30
Load this SAE
jumprelu blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_54
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-res-131k__l0-54 blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_99
Load this SAE
jumprelu blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_11
Load this SAE
jumprelu blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_131
Load this SAE
jumprelu blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_19
Load this SAE
jumprelu blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_298
Load this SAE
jumprelu blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-res-16k__l0-34 blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_64
Load this SAE
jumprelu blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_101
Load this SAE
jumprelu blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_16
Load this SAE
jumprelu blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_28
Load this SAE
jumprelu blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-res-131k__l0-51 blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_6
Load this SAE
jumprelu blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_9
Load this SAE
jumprelu blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_10
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_18
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_234
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-res-16k__l0-37 blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_91
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_10
Load this SAE
jumprelu blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_17
Load this SAE
jumprelu blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_193
Load this SAE
jumprelu blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_29
Load this SAE
jumprelu blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_49
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-res-131k__l0-49 blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_94
Load this SAE
jumprelu blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_10
Load this SAE
jumprelu blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_125
Load this SAE
jumprelu blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_18
Load this SAE
jumprelu blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_292
Load this SAE
jumprelu blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-res-16k__l0-32 blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_61
Load this SAE
jumprelu blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_10
Load this SAE
jumprelu blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_15
Load this SAE
jumprelu blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_175
Load this SAE
jumprelu blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_26
Load this SAE
jumprelu blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_45
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-res-131k__l0-45 blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_84
Load this SAE
jumprelu blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_10
Load this SAE
jumprelu blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_113
Load this SAE
jumprelu blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_16
Load this SAE
jumprelu blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_270
Load this SAE
jumprelu blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_28
Load this SAE
jumprelu blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_52
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-res-16k__l0-52 blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_10
Load this SAE
jumprelu blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_16
Load this SAE
jumprelu blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_29
Load this SAE
jumprelu blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-res-131k__l0-51 blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_6
Load this SAE
jumprelu blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_94
Load this SAE
jumprelu blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_11
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_193
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_20
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-res-16k__l0-37 blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_77
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_12
Load this SAE
jumprelu blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_120
Load this SAE
jumprelu blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_21
Load this SAE
jumprelu blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_36
Load this SAE
jumprelu blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_66
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-res-131k__l0-66 blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_7
Load this SAE
jumprelu blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_14
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_224
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_25
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_47
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-res-16k__l0-47 blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_8
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_93
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_119
Load this SAE
jumprelu blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_13
Load this SAE
jumprelu blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_21
Load this SAE
jumprelu blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_38
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-res-131k__l0-38 blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_65
Load this SAE
jumprelu blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_8
Load this SAE
jumprelu blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_14
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_198
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_25
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_46
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-res-16k__l0-46 blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_8
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_92
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_129
Load this SAE
jumprelu blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_14
Load this SAE
jumprelu blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_24
Load this SAE
jumprelu blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_41
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-res-131k__l0-41 blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_72
Load this SAE
jumprelu blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_8
Load this SAE
jumprelu blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_16
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_207
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_28
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-res-16k__l0-51 blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_9
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_99
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_134
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-res-131k__l0-134 blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_14
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-res-131k__l0-14 blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_25
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-res-131k__l0-25