Skip to content

Pretrained SAEs

This is a list of SAEs importable from the SAELens package. Click on each link for more details.

This file contains the contents of sae_lens/pretrained_saes.yaml in Markdown

gpt2-small-res-jb

id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_pre
Load this SAE
standard gpt2-small/0-res-jb blocks.0.hook_resid_pre 0 24576 128 Skylion007/openwebtext none
blocks.1.hook_resid_pre
Load this SAE
standard gpt2-small/1-res-jb blocks.1.hook_resid_pre 1 24576 128 Skylion007/openwebtext none
blocks.2.hook_resid_pre
Load this SAE
standard gpt2-small/2-res-jb blocks.2.hook_resid_pre 2 24576 128 Skylion007/openwebtext none
blocks.3.hook_resid_pre
Load this SAE
standard gpt2-small/3-res-jb blocks.3.hook_resid_pre 3 24576 128 Skylion007/openwebtext none
blocks.4.hook_resid_pre
Load this SAE
standard gpt2-small/4-res-jb blocks.4.hook_resid_pre 4 24576 128 Skylion007/openwebtext none
blocks.5.hook_resid_pre
Load this SAE
standard gpt2-small/5-res-jb blocks.5.hook_resid_pre 5 24576 128 Skylion007/openwebtext none
blocks.6.hook_resid_pre
Load this SAE
standard gpt2-small/6-res-jb blocks.6.hook_resid_pre 6 24576 128 Skylion007/openwebtext none
blocks.7.hook_resid_pre
Load this SAE
standard gpt2-small/7-res-jb blocks.7.hook_resid_pre 7 24576 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre
Load this SAE
standard gpt2-small/8-res-jb blocks.8.hook_resid_pre 8 24576 128 Skylion007/openwebtext none
blocks.9.hook_resid_pre
Load this SAE
standard gpt2-small/9-res-jb blocks.9.hook_resid_pre 9 24576 128 Skylion007/openwebtext none
blocks.10.hook_resid_pre
Load this SAE
standard gpt2-small/10-res-jb blocks.10.hook_resid_pre 10 24576 128 Skylion007/openwebtext none
blocks.11.hook_resid_pre
Load this SAE
standard gpt2-small/11-res-jb blocks.11.hook_resid_pre 11 24576 128 Skylion007/openwebtext none
blocks.11.hook_resid_post
Load this SAE
standard gpt2-small/12-res-jb blocks.11.hook_resid_post 11 24576 128 Skylion007/openwebtext none

gpt2-small-hook-z-kk

id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_z
Load this SAE
standard gpt2-small/0-att-kk blocks.0.attn.hook_z 0 24576 128 Skylion007/openwebtext none
blocks.1.hook_z
Load this SAE
standard gpt2-small/1-att-kk blocks.1.attn.hook_z 1 24576 128 Skylion007/openwebtext none
blocks.2.hook_z
Load this SAE
standard gpt2-small/2-att-kk blocks.2.attn.hook_z 2 24576 128 Skylion007/openwebtext none
blocks.3.hook_z
Load this SAE
standard gpt2-small/3-att-kk blocks.3.attn.hook_z 3 24576 128 Skylion007/openwebtext none
blocks.4.hook_z
Load this SAE
standard gpt2-small/4-att-kk blocks.4.attn.hook_z 4 24576 128 Skylion007/openwebtext none
blocks.5.hook_z
Load this SAE
standard gpt2-small/5-att-kk blocks.5.attn.hook_z 5 49152 128 Skylion007/openwebtext none
blocks.6.hook_z
Load this SAE
standard gpt2-small/6-att-kk blocks.6.attn.hook_z 6 24576 128 Skylion007/openwebtext none
blocks.7.hook_z
Load this SAE
standard gpt2-small/7-att-kk blocks.7.attn.hook_z 7 49152 128 Skylion007/openwebtext none
blocks.8.hook_z
Load this SAE
standard gpt2-small/8-att-kk blocks.8.attn.hook_z 8 24576 128 Skylion007/openwebtext none
blocks.9.hook_z
Load this SAE
standard gpt2-small/9-att-kk blocks.9.attn.hook_z 9 24576 128 Skylion007/openwebtext none
blocks.10.hook_z
Load this SAE
standard gpt2-small/10-att-kk blocks.10.attn.hook_z 10 24576 128 Skylion007/openwebtext none
blocks.11.hook_z
Load this SAE
standard gpt2-small/11-att-kk blocks.11.attn.hook_z 11 24576 128 Skylion007/openwebtext none

gpt2-small-mlp-tm

  • Huggingface Repo: tommmcgrath/gpt2-small-mlp-out-saes
  • model: gpt2-small
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_mlp_out
Load this SAE
standard blocks.0.hook_mlp_out 0 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.1.hook_mlp_out
Load this SAE
standard blocks.1.hook_mlp_out 1 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.2.hook_mlp_out
Load this SAE
standard blocks.2.hook_mlp_out 2 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.3.hook_mlp_out
Load this SAE
standard blocks.3.hook_mlp_out 3 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.4.hook_mlp_out
Load this SAE
standard blocks.4.hook_mlp_out 4 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.5.hook_mlp_out
Load this SAE
standard blocks.5.hook_mlp_out 5 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.6.hook_mlp_out
Load this SAE
standard blocks.6.hook_mlp_out 6 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.7.hook_mlp_out
Load this SAE
standard blocks.7.hook_mlp_out 7 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.8.hook_mlp_out
Load this SAE
standard blocks.8.hook_mlp_out 8 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.9.hook_mlp_out
Load this SAE
standard blocks.9.hook_mlp_out 9 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.10.hook_mlp_out
Load this SAE
standard blocks.10.hook_mlp_out 10 24576 512 Skylion007/openwebtext expected_average_only_in
blocks.11.hook_mlp_out
Load this SAE
standard blocks.11.hook_mlp_out 11 24576 512 Skylion007/openwebtext expected_average_only_in

gpt2-small-res-jb-feature-splitting

  • Huggingface Repo: jbloom/GPT2-Small-Feature-Splitting-Experiment-Layer-8
  • model: gpt2-small
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.8.hook_resid_pre_768
Load this SAE
standard gpt2-small/8-res_fs768-jb blocks.8.hook_resid_pre 8 768 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_1536
Load this SAE
standard gpt2-small/8-res_fs1536-jb blocks.8.hook_resid_pre 8 1536 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_3072
Load this SAE
standard gpt2-small/8-res_fs3072-jb blocks.8.hook_resid_pre 8 3072 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_6144
Load this SAE
standard gpt2-small/8-res_fs6144-jb blocks.8.hook_resid_pre 8 6144 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_12288
Load this SAE
standard gpt2-small/8-res_fs12288-jb blocks.8.hook_resid_pre 8 12288 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_24576
Load this SAE
standard gpt2-small/8-res_fs24576-jb blocks.8.hook_resid_pre 8 24576 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_49152
Load this SAE
standard gpt2-small/8-res_fs49152-jb blocks.8.hook_resid_pre 8 49152 128 Skylion007/openwebtext none
blocks.8.hook_resid_pre_98304
Load this SAE
standard gpt2-small/8-res_fs98304-jb blocks.8.hook_resid_pre 8 98304 128 Skylion007/openwebtext none

gpt2-small-resid-post-v5-32k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-resid-post-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_post
Load this SAE
standard gpt2-small/0-res_post_32k-oai blocks.0.hook_resid_post 0 32768 64 Skylion007/openwebtext layer_norm
blocks.1.hook_resid_post
Load this SAE
standard gpt2-small/1-res_post_32k-oai blocks.1.hook_resid_post 1 32768 64 Skylion007/openwebtext layer_norm
blocks.2.hook_resid_post
Load this SAE
standard gpt2-small/2-res_post_32k-oai blocks.2.hook_resid_post 2 32768 64 Skylion007/openwebtext layer_norm
blocks.3.hook_resid_post
Load this SAE
standard gpt2-small/3-res_post_32k-oai blocks.3.hook_resid_post 3 32768 64 Skylion007/openwebtext layer_norm
blocks.4.hook_resid_post
Load this SAE
standard gpt2-small/4-res_post_32k-oai blocks.4.hook_resid_post 4 32768 64 Skylion007/openwebtext layer_norm
blocks.5.hook_resid_post
Load this SAE
standard gpt2-small/5-res_post_32k-oai blocks.5.hook_resid_post 5 32768 64 Skylion007/openwebtext layer_norm
blocks.6.hook_resid_post
Load this SAE
standard gpt2-small/6-res_post_32k-oai blocks.6.hook_resid_post 6 32768 64 Skylion007/openwebtext layer_norm
blocks.7.hook_resid_post
Load this SAE
standard gpt2-small/7-res_post_32k-oai blocks.7.hook_resid_post 7 32768 64 Skylion007/openwebtext layer_norm
blocks.8.hook_resid_post
Load this SAE
standard gpt2-small/8-res_post_32k-oai blocks.8.hook_resid_post 8 32768 64 Skylion007/openwebtext layer_norm
blocks.9.hook_resid_post
Load this SAE
standard gpt2-small/9-res_post_32k-oai blocks.9.hook_resid_post 9 32768 64 Skylion007/openwebtext layer_norm
blocks.10.hook_resid_post
Load this SAE
standard gpt2-small/10-res_post_32k-oai blocks.10.hook_resid_post 10 32768 64 Skylion007/openwebtext layer_norm
blocks.11.hook_resid_post
Load this SAE
standard gpt2-small/11-res_post_32k-oai blocks.11.hook_resid_post 11 32768 64 Skylion007/openwebtext layer_norm

gpt2-small-resid-post-v5-128k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-resid-post-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_post
Load this SAE
standard gpt2-small/0-res_post_128k-oai blocks.0.hook_resid_post 0 131072 64 Skylion007/openwebtext layer_norm
blocks.1.hook_resid_post
Load this SAE
standard gpt2-small/1-res_post_128k-oai blocks.1.hook_resid_post 1 131072 64 Skylion007/openwebtext layer_norm
blocks.2.hook_resid_post
Load this SAE
standard gpt2-small/2-res_post_128k-oai blocks.2.hook_resid_post 2 131072 64 Skylion007/openwebtext layer_norm
blocks.3.hook_resid_post
Load this SAE
standard gpt2-small/3-res_post_128k-oai blocks.3.hook_resid_post 3 131072 64 Skylion007/openwebtext layer_norm
blocks.4.hook_resid_post
Load this SAE
standard gpt2-small/4-res_post_128k-oai blocks.4.hook_resid_post 4 131072 64 Skylion007/openwebtext layer_norm
blocks.5.hook_resid_post
Load this SAE
standard gpt2-small/5-res_post_128k-oai blocks.5.hook_resid_post 5 131072 64 Skylion007/openwebtext layer_norm
blocks.6.hook_resid_post
Load this SAE
standard gpt2-small/6-res_post_128k-oai blocks.6.hook_resid_post 6 131072 64 Skylion007/openwebtext layer_norm
blocks.7.hook_resid_post
Load this SAE
standard gpt2-small/7-res_post_128k-oai blocks.7.hook_resid_post 7 131072 64 Skylion007/openwebtext layer_norm
blocks.8.hook_resid_post
Load this SAE
standard gpt2-small/8-res_post_128k-oai blocks.8.hook_resid_post 8 131072 64 Skylion007/openwebtext layer_norm
blocks.9.hook_resid_post
Load this SAE
standard gpt2-small/9-res_post_128k-oai blocks.9.hook_resid_post 9 131072 64 Skylion007/openwebtext layer_norm
blocks.10.hook_resid_post
Load this SAE
standard gpt2-small/10-res_post_128k-oai blocks.10.hook_resid_post 10 131072 64 Skylion007/openwebtext layer_norm
blocks.11.hook_resid_post
Load this SAE
standard gpt2-small/11-res_post_128k-oai blocks.11.hook_resid_post 11 131072 64 Skylion007/openwebtext layer_norm

gemma-2b-res-jb

  • Huggingface Repo: jbloom/Gemma-2b-Residual-Stream-SAEs
  • model: gemma-2b
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_post
Load this SAE
standard gemma-2b/0-res-jb blocks.0.hook_resid_post 0 16384 1024 HuggingFaceFW/fineweb none
blocks.6.hook_resid_post
Load this SAE
standard gemma-2b/6-res-jb blocks.6.hook_resid_post 6 16384 1024 HuggingFaceFW/fineweb none
blocks.10.hook_resid_post
Load this SAE
standard gemma-2b/10-res-jb blocks.10.hook_resid_post 10 16384 1024 ctigges/openwebtext-gemma-1024-cl none
blocks.12.hook_resid_post
Load this SAE
standard gemma-2b/12-res-jb blocks.12.hook_resid_post 12 16384 1024 HuggingFaceFW/fineweb expected_average_only_in
blocks.17.hook_resid_post
Load this SAE
standard blocks.17.hook_resid_post 17 16384 1024 ctigges/openwebtext-gemma-1024-cl none

gemma-2b-it-res-jb

  • Huggingface Repo: jbloom/Gemma-2b-IT-Residual-Stream-SAEs
  • model: gemma-2b-it
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.12.hook_resid_post
Load this SAE
standard gemma-2b-it/12-res-jb blocks.12.hook_resid_post 12 16384 1024 Skylion007/openwebtext none

mistral-7b-res-wg

  • Huggingface Repo: JoshEngels/Mistral-7B-Residual-Stream-SAEs
  • model: mistral-7b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.8.hook_resid_pre
Load this SAE
standard blocks.8.hook_resid_pre 8 65536 256 monology/pile-uncopyrighted constant_norm_rescale
blocks.16.hook_resid_pre
Load this SAE
standard blocks.16.hook_resid_pre 16 65536 256 monology/pile-uncopyrighted constant_norm_rescale
blocks.24.hook_resid_pre
Load this SAE
standard blocks.24.hook_resid_pre 24 65536 256 monology/pile-uncopyrighted constant_norm_rescale

gpt2-small-resid-mid-v5-32k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-resid-mid-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_mid
Load this SAE
standard gpt2-small/0-res_mid_32k-oai blocks.0.hook_resid_mid 0 32768 64 Skylion007/openwebtext layer_norm
blocks.1.hook_resid_mid
Load this SAE
standard gpt2-small/1-res_mid_32k-oai blocks.1.hook_resid_mid 1 32768 64 Skylion007/openwebtext layer_norm
blocks.2.hook_resid_mid
Load this SAE
standard gpt2-small/2-res_mid_32k-oai blocks.2.hook_resid_mid 2 32768 64 Skylion007/openwebtext layer_norm
blocks.3.hook_resid_mid
Load this SAE
standard gpt2-small/3-res_mid_32k-oai blocks.3.hook_resid_mid 3 32768 64 Skylion007/openwebtext layer_norm
blocks.4.hook_resid_mid
Load this SAE
standard gpt2-small/4-res_mid_32k-oai blocks.4.hook_resid_mid 4 32768 64 Skylion007/openwebtext layer_norm
blocks.5.hook_resid_mid
Load this SAE
standard gpt2-small/5-res_mid_32k-oai blocks.5.hook_resid_mid 5 32768 64 Skylion007/openwebtext layer_norm
blocks.6.hook_resid_mid
Load this SAE
standard gpt2-small/6-res_mid_32k-oai blocks.6.hook_resid_mid 6 32768 64 Skylion007/openwebtext layer_norm
blocks.7.hook_resid_mid
Load this SAE
standard gpt2-small/7-res_mid_32k-oai blocks.7.hook_resid_mid 7 32768 64 Skylion007/openwebtext layer_norm
blocks.8.hook_resid_mid
Load this SAE
standard gpt2-small/8-res_mid_32k-oai blocks.8.hook_resid_mid 8 32768 64 Skylion007/openwebtext layer_norm
blocks.9.hook_resid_mid
Load this SAE
standard gpt2-small/9-res_mid_32k-oai blocks.9.hook_resid_mid 9 32768 64 Skylion007/openwebtext layer_norm
blocks.10.hook_resid_mid
Load this SAE
standard gpt2-small/10-res_mid_32k-oai blocks.10.hook_resid_mid 10 32768 64 Skylion007/openwebtext layer_norm
blocks.11.hook_resid_mid
Load this SAE
standard gpt2-small/11-res_mid_32k-oai blocks.11.hook_resid_mid 11 32768 64 Skylion007/openwebtext layer_norm

gpt2-small-resid-mid-v5-128k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-resid-mid-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_mid
Load this SAE
standard gpt2-small/0-res_mid_128k-oai blocks.0.hook_resid_mid 0 131072 64 Skylion007/openwebtext layer_norm
blocks.1.hook_resid_mid
Load this SAE
standard gpt2-small/1-res_mid_128k-oai blocks.1.hook_resid_mid 1 131072 64 Skylion007/openwebtext layer_norm
blocks.2.hook_resid_mid
Load this SAE
standard gpt2-small/2-res_mid_128k-oai blocks.2.hook_resid_mid 2 131072 64 Skylion007/openwebtext layer_norm
blocks.3.hook_resid_mid
Load this SAE
standard gpt2-small/3-res_mid_128k-oai blocks.3.hook_resid_mid 3 131072 64 Skylion007/openwebtext layer_norm
blocks.4.hook_resid_mid
Load this SAE
standard gpt2-small/4-res_mid_128k-oai blocks.4.hook_resid_mid 4 131072 64 Skylion007/openwebtext layer_norm
blocks.5.hook_resid_mid
Load this SAE
standard gpt2-small/5-res_mid_128k-oai blocks.5.hook_resid_mid 5 131072 64 Skylion007/openwebtext layer_norm
blocks.6.hook_resid_mid
Load this SAE
standard gpt2-small/6-res_mid_128k-oai blocks.6.hook_resid_mid 6 131072 64 Skylion007/openwebtext layer_norm
blocks.7.hook_resid_mid
Load this SAE
standard gpt2-small/7-res_mid_128k-oai blocks.7.hook_resid_mid 7 131072 64 Skylion007/openwebtext layer_norm
blocks.8.hook_resid_mid
Load this SAE
standard gpt2-small/8-res_mid_128k-oai blocks.8.hook_resid_mid 8 131072 64 Skylion007/openwebtext layer_norm
blocks.9.hook_resid_mid
Load this SAE
standard gpt2-small/9-res_mid_128k-oai blocks.9.hook_resid_mid 9 131072 64 Skylion007/openwebtext layer_norm
blocks.10.hook_resid_mid
Load this SAE
standard gpt2-small/10-res_mid_128k-oai blocks.10.hook_resid_mid 10 131072 64 Skylion007/openwebtext layer_norm
blocks.11.hook_resid_mid
Load this SAE
standard gpt2-small/11-res_mid_128k-oai blocks.11.hook_resid_mid 11 131072 64 Skylion007/openwebtext layer_norm

gpt2-small-mlp-out-v5-32k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-mlp-out-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_mlp_out
Load this SAE
standard gpt2-small/0-mlp_32k-oai blocks.0.hook_mlp_out 0 32768 64 Skylion007/openwebtext layer_norm
blocks.1.hook_mlp_out
Load this SAE
standard gpt2-small/1-mlp_32k-oai blocks.1.hook_mlp_out 1 32768 64 Skylion007/openwebtext layer_norm
blocks.2.hook_mlp_out
Load this SAE
standard gpt2-small/2-mlp_32k-oai blocks.2.hook_mlp_out 2 32768 64 Skylion007/openwebtext layer_norm
blocks.3.hook_mlp_out
Load this SAE
standard gpt2-small/3-mlp_32k-oai blocks.3.hook_mlp_out 3 32768 64 Skylion007/openwebtext layer_norm
blocks.4.hook_mlp_out
Load this SAE
standard gpt2-small/4-mlp_32k-oai blocks.4.hook_mlp_out 4 32768 64 Skylion007/openwebtext layer_norm
blocks.5.hook_mlp_out
Load this SAE
standard gpt2-small/5-mlp_32k-oai blocks.5.hook_mlp_out 5 32768 64 Skylion007/openwebtext layer_norm
blocks.6.hook_mlp_out
Load this SAE
standard gpt2-small/6-mlp_32k-oai blocks.6.hook_mlp_out 6 32768 64 Skylion007/openwebtext layer_norm
blocks.7.hook_mlp_out
Load this SAE
standard gpt2-small/7-mlp_32k-oai blocks.7.hook_mlp_out 7 32768 64 Skylion007/openwebtext layer_norm
blocks.8.hook_mlp_out
Load this SAE
standard gpt2-small/8-mlp_32k-oai blocks.8.hook_mlp_out 8 32768 64 Skylion007/openwebtext layer_norm
blocks.9.hook_mlp_out
Load this SAE
standard gpt2-small/9-mlp_32k-oai blocks.9.hook_mlp_out 9 32768 64 Skylion007/openwebtext layer_norm
blocks.10.hook_mlp_out
Load this SAE
standard gpt2-small/10-mlp_32k-oai blocks.10.hook_mlp_out 10 32768 64 Skylion007/openwebtext layer_norm
blocks.11.hook_mlp_out
Load this SAE
standard gpt2-small/11-mlp_32k-oai blocks.11.hook_mlp_out 11 32768 64 Skylion007/openwebtext layer_norm

gpt2-small-mlp-out-v5-128k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-mlp-out-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_mlp_out
Load this SAE
standard gpt2-small/0-mlp_128k-oai blocks.0.hook_mlp_out 0 131072 64 Skylion007/openwebtext layer_norm
blocks.1.hook_mlp_out
Load this SAE
standard gpt2-small/1-mlp_128k-oai blocks.1.hook_mlp_out 1 131072 64 Skylion007/openwebtext layer_norm
blocks.2.hook_mlp_out
Load this SAE
standard gpt2-small/2-mlp_128k-oai blocks.2.hook_mlp_out 2 131072 64 Skylion007/openwebtext layer_norm
blocks.3.hook_mlp_out
Load this SAE
standard gpt2-small/3-mlp_128k-oai blocks.3.hook_mlp_out 3 131072 64 Skylion007/openwebtext layer_norm
blocks.4.hook_mlp_out
Load this SAE
standard gpt2-small/4-mlp_128k-oai blocks.4.hook_mlp_out 4 131072 64 Skylion007/openwebtext layer_norm
blocks.5.hook_mlp_out
Load this SAE
standard gpt2-small/5-mlp_128k-oai blocks.5.hook_mlp_out 5 131072 64 Skylion007/openwebtext layer_norm
blocks.6.hook_mlp_out
Load this SAE
standard gpt2-small/6-mlp_128k-oai blocks.6.hook_mlp_out 6 131072 64 Skylion007/openwebtext layer_norm
blocks.7.hook_mlp_out
Load this SAE
standard gpt2-small/7-mlp_128k-oai blocks.7.hook_mlp_out 7 131072 64 Skylion007/openwebtext layer_norm
blocks.8.hook_mlp_out
Load this SAE
standard gpt2-small/8-mlp_128k-oai blocks.8.hook_mlp_out 8 131072 64 Skylion007/openwebtext layer_norm
blocks.9.hook_mlp_out
Load this SAE
standard gpt2-small/9-mlp_128k-oai blocks.9.hook_mlp_out 9 131072 64 Skylion007/openwebtext layer_norm
blocks.10.hook_mlp_out
Load this SAE
standard gpt2-small/10-mlp_128k-oai blocks.10.hook_mlp_out 10 131072 64 Skylion007/openwebtext layer_norm
blocks.11.hook_mlp_out
Load this SAE
standard gpt2-small/11-mlp_128k-oai blocks.11.hook_mlp_out 11 131072 64 Skylion007/openwebtext layer_norm

gpt2-small-attn-out-v5-32k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-32k-attn-out-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_attn_out
Load this SAE
standard gpt2-small/0-att_32k-oai blocks.0.hook_attn_out 0 32768 64 Skylion007/openwebtext layer_norm
blocks.1.hook_attn_out
Load this SAE
standard gpt2-small/1-att_32k-oai blocks.1.hook_attn_out 1 32768 64 Skylion007/openwebtext layer_norm
blocks.2.hook_attn_out
Load this SAE
standard gpt2-small/2-att_32k-oai blocks.2.hook_attn_out 2 32768 64 Skylion007/openwebtext layer_norm
blocks.3.hook_attn_out
Load this SAE
standard gpt2-small/3-att_32k-oai blocks.3.hook_attn_out 3 32768 64 Skylion007/openwebtext layer_norm
blocks.4.hook_attn_out
Load this SAE
standard gpt2-small/4-att_32k-oai blocks.4.hook_attn_out 4 32768 64 Skylion007/openwebtext layer_norm
blocks.5.hook_attn_out
Load this SAE
standard gpt2-small/5-att_32k-oai blocks.5.hook_attn_out 5 32768 64 Skylion007/openwebtext layer_norm
blocks.6.hook_attn_out
Load this SAE
standard gpt2-small/6-att_32k-oai blocks.6.hook_attn_out 6 32768 64 Skylion007/openwebtext layer_norm
blocks.7.hook_attn_out
Load this SAE
standard gpt2-small/7-att_32k-oai blocks.7.hook_attn_out 7 32768 64 Skylion007/openwebtext layer_norm
blocks.8.hook_attn_out
Load this SAE
standard gpt2-small/8-att_32k-oai blocks.8.hook_attn_out 8 32768 64 Skylion007/openwebtext layer_norm
blocks.9.hook_attn_out
Load this SAE
standard gpt2-small/9-att_32k-oai blocks.9.hook_attn_out 9 32768 64 Skylion007/openwebtext layer_norm
blocks.10.hook_attn_out
Load this SAE
standard gpt2-small/10-att_32k-oai blocks.10.hook_attn_out 10 32768 64 Skylion007/openwebtext layer_norm
blocks.11.hook_attn_out
Load this SAE
standard gpt2-small/11-att_32k-oai blocks.11.hook_attn_out 11 32768 64 Skylion007/openwebtext layer_norm

gpt2-small-attn-out-v5-128k

  • Huggingface Repo: jbloom/GPT2-Small-OAI-v5-128k-attn-out-SAEs
  • model: gpt2-small
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_attn_out
Load this SAE
standard gpt2-small/0-att_128k-oai blocks.0.hook_attn_out 0 131072 64 Skylion007/openwebtext layer_norm
blocks.1.hook_attn_out
Load this SAE
standard gpt2-small/1-att_128k-oai blocks.1.hook_attn_out 1 131072 64 Skylion007/openwebtext layer_norm
blocks.2.hook_attn_out
Load this SAE
standard gpt2-small/2-att_128k-oai blocks.2.hook_attn_out 2 131072 64 Skylion007/openwebtext layer_norm
blocks.3.hook_attn_out
Load this SAE
standard gpt2-small/3-att_128k-oai blocks.3.hook_attn_out 3 131072 64 Skylion007/openwebtext layer_norm
blocks.4.hook_attn_out
Load this SAE
standard gpt2-small/4-att_128k-oai blocks.4.hook_attn_out 4 131072 64 Skylion007/openwebtext layer_norm
blocks.5.hook_attn_out
Load this SAE
standard gpt2-small/5-att_128k-oai blocks.5.hook_attn_out 5 131072 64 Skylion007/openwebtext layer_norm
blocks.6.hook_attn_out
Load this SAE
standard gpt2-small/6-att_128k-oai blocks.6.hook_attn_out 6 131072 64 Skylion007/openwebtext layer_norm
blocks.7.hook_attn_out
Load this SAE
standard gpt2-small/7-att_128k-oai blocks.7.hook_attn_out 7 131072 64 Skylion007/openwebtext layer_norm
blocks.8.hook_attn_out
Load this SAE
standard gpt2-small/8-att_128k-oai blocks.8.hook_attn_out 8 131072 64 Skylion007/openwebtext layer_norm
blocks.9.hook_attn_out
Load this SAE
standard gpt2-small/9-att_128k-oai blocks.9.hook_attn_out 9 131072 64 Skylion007/openwebtext layer_norm
blocks.10.hook_attn_out
Load this SAE
standard gpt2-small/10-att_128k-oai blocks.10.hook_attn_out 10 131072 64 Skylion007/openwebtext layer_norm
blocks.11.hook_attn_out
Load this SAE
standard gpt2-small/11-att_128k-oai blocks.11.hook_attn_out 11 131072 64 Skylion007/openwebtext layer_norm

gemma-scope-2b-pt-res

  • Huggingface Repo: google/gemma-scope-2b-pt-res
  • model: gemma-2-2b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
embedding/width_4k/average_l0_6
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_44
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_21
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_111
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_105
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_13
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_226
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_25
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_46
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_10
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_102
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_20
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_250
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_40
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_13
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_141
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_142
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_24
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_304
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_53
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_14
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_142
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_28
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_315
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_59
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_124
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_125
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_17
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_281
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_31
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_60
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_143
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_18
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_309
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_34
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_68
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_144
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_19
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_301
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_36
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_70
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_137
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_20
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_285
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_36
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_69
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_142
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_20
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_301
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_37
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_71
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_151
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_21
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_340
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_37
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_73
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_166
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_21
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_39
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_395
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_77
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_168
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_22
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_393
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_41
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_80
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_176
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-16k__l0-176 blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_22
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-16k__l0-22 blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_41
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-16k__l0-41 blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_445
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-16k__l0-445 blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_82
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_173
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_23
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_403
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_43
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_83
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_84
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_173
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_23
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_388
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_43
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_83
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_84
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_150
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_23
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_308
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_41
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_78
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_154
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_23
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_335
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_42
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_78
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_150
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_23
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_304
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_42
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_77
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_138
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_23
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_280
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_40
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_74
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_137
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_23
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_279
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_40
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_73
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_139
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_22
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_294
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_38
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_71
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_139
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_22
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_301
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_38
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_70
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_147
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_21
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_349
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_38
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_72
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_157
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_21
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_38
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_404
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_74
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_75
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_158
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_20
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_38
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_457
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_73
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_116
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_16
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_28
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_285
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_55
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_114
Load this SAE
jumprelu blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_13
Load this SAE
jumprelu blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_21
Load this SAE
jumprelu blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_36
Load this SAE
jumprelu blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_63
Load this SAE
jumprelu blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_5/width_1m/average_l0_9
Load this SAE
jumprelu blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_107
Load this SAE
jumprelu blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_19
Load this SAE
jumprelu blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_207
Load this SAE
jumprelu blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_26
Load this SAE
jumprelu blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_58
Load this SAE
jumprelu blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/average_l0_73
Load this SAE
jumprelu blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_157
Load this SAE
jumprelu blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_16
Load this SAE
jumprelu blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_18
Load this SAE
jumprelu blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_29
Load this SAE
jumprelu blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_50
Load this SAE
jumprelu blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/average_l0_88
Load this SAE
jumprelu blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_11
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_121
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_21
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_243
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_36
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_262k/average_l0_67
Load this SAE
jumprelu blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_12
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_155
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_22
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_360
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_40
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_32k/average_l0_76
Load this SAE
jumprelu blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_115
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_22
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_227
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_29
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_46
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_12/width_524k/average_l0_65
Load this SAE
jumprelu blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_11
Load this SAE
jumprelu blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_17
Load this SAE
jumprelu blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_27
Load this SAE
jumprelu blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_43
Load this SAE
jumprelu blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_73
Load this SAE
jumprelu blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_121
Load this SAE
jumprelu blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_16
Load this SAE
jumprelu blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_30
Load this SAE
jumprelu blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_54
Load this SAE
jumprelu blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_9
Load this SAE
jumprelu blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_11
Load this SAE
jumprelu blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_169
Load this SAE
jumprelu blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_20
Load this SAE
jumprelu blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_37
Load this SAE
jumprelu blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_77
Load this SAE
jumprelu blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_13
Load this SAE
jumprelu blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_193
Load this SAE
jumprelu blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_23
Load this SAE
jumprelu blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_42
Load this SAE
jumprelu blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_89
Load this SAE
jumprelu blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_14
Load this SAE
jumprelu blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_177
Load this SAE
jumprelu blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_25
Load this SAE
jumprelu blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_46
Load this SAE
jumprelu blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_89
Load this SAE
jumprelu blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_105
Load this SAE
jumprelu blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_17
Load this SAE
jumprelu blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_211
Load this SAE
jumprelu blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_29
Load this SAE
jumprelu blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_53
Load this SAE
jumprelu blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_107
Load this SAE
jumprelu blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_17
Load this SAE
jumprelu blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_208
Load this SAE
jumprelu blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_30
Load this SAE
jumprelu blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_56
Load this SAE
jumprelu blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_107
Load this SAE
jumprelu blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_18
Load this SAE
jumprelu blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_203
Load this SAE
jumprelu blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_31
Load this SAE
jumprelu blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_57
Load this SAE
jumprelu blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_111
Load this SAE
jumprelu blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_19
Load this SAE
jumprelu blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_213
Load this SAE
jumprelu blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_33
Load this SAE
jumprelu blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_59
Load this SAE
jumprelu blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_118
Load this SAE
jumprelu blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_19
Load this SAE
jumprelu blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_240
Load this SAE
jumprelu blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_34
Load this SAE
jumprelu blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_61
Load this SAE
jumprelu blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_128
Load this SAE
jumprelu blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_20
Load this SAE
jumprelu blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_265
Load this SAE
jumprelu blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_36
Load this SAE
jumprelu blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_66
Load this SAE
jumprelu blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_134
Load this SAE
jumprelu blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_21
Load this SAE
jumprelu blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_273
Load this SAE
jumprelu blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_37
Load this SAE
jumprelu blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_70
Load this SAE
jumprelu blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_141
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-65k__l0-141 blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_21
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-65k__l0-21 blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_297
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-65k__l0-297 blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_38
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-65k__l0-38 blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_72
Load this SAE
jumprelu blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_142
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_22
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_288
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_40
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_74
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_75
Load this SAE
jumprelu blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_144
Load this SAE
jumprelu blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_21
Load this SAE
jumprelu blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_284
Load this SAE
jumprelu blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_40
Load this SAE
jumprelu blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_73
Load this SAE
jumprelu blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_127
Load this SAE
jumprelu blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_21
Load this SAE
jumprelu blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_240
Load this SAE
jumprelu blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_38
Load this SAE
jumprelu blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_68
Load this SAE
jumprelu blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_128
Load this SAE
jumprelu blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_21
Load this SAE
jumprelu blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_244
Load this SAE
jumprelu blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_38
Load this SAE
jumprelu blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_69
Load this SAE
jumprelu blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_125
Load this SAE
jumprelu blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_21
Load this SAE
jumprelu blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_233
Load this SAE
jumprelu blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_38
Load this SAE
jumprelu blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_68
Load this SAE
jumprelu blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_116
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_117
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_21
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_216
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_36
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_64
Load this SAE
jumprelu blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_115
Load this SAE
jumprelu blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_21
Load this SAE
jumprelu blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_216
Load this SAE
jumprelu blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_35
Load this SAE
jumprelu blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_63
Load this SAE
jumprelu blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_114
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_20
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_221
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_34
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_61
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_111
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_112
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_20
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_225
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_33
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_61
Load this SAE
jumprelu blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_116
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_117
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_20
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_248
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_33
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_62
Load this SAE
jumprelu blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_123
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_124
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_20
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_272
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_35
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_64
Load this SAE
jumprelu blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_124
Load this SAE
jumprelu blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_19
Load this SAE
jumprelu blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_273
Load this SAE
jumprelu blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_34
Load this SAE
jumprelu blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_63
Load this SAE
jumprelu blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_15
Load this SAE
jumprelu blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_197
Load this SAE
jumprelu blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_26
Load this SAE
jumprelu blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_48
Load this SAE
jumprelu blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_93
Load this SAE
jumprelu blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-2b-pt-res-canonical

id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-res-16k blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-res-16k blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-res-16k blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-res-16k blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-res-16k blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-16k blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-res-16k blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-res-16k blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-res-16k blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-res-16k blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-res-16k blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-res-16k blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-16k blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-res-16k blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-res-16k blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-res-16k blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-res-16k blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-res-16k blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-res-16k blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-16k blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-res-16k blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-res-16k blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-res-16k blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-res-16k blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-res-16k blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-res-16k blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_5/width_1m/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-1m blocks.5.hook_resid_post 5 1048576 1024 monology/pile-uncopyrighted
layer_12/width_1m/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-1m blocks.12.hook_resid_post 12 1048576 1024 monology/pile-uncopyrighted
layer_19/width_1m/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-1m blocks.19.hook_resid_post 19 1048576 1024 monology/pile-uncopyrighted
layer_12/width_262k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-262k blocks.12.hook_resid_post 12 262144 1024 monology/pile-uncopyrighted
layer_12/width_32k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-32k blocks.12.hook_resid_post 12 32768 1024 monology/pile-uncopyrighted
layer_12/width_524k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-524k blocks.12.hook_resid_post 12 524288 1024 monology/pile-uncopyrighted
layer_0/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-res-65k blocks.0.hook_resid_post 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-res-65k blocks.1.hook_resid_post 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-res-65k blocks.2.hook_resid_post 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-res-65k blocks.3.hook_resid_post 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-res-65k blocks.4.hook_resid_post 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-res-65k blocks.5.hook_resid_post 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-res-65k blocks.6.hook_resid_post 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-res-65k blocks.7.hook_resid_post 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-res-65k blocks.8.hook_resid_post 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-res-65k blocks.9.hook_resid_post 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-res-65k blocks.10.hook_resid_post 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-res-65k blocks.11.hook_resid_post 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-res-65k blocks.12.hook_resid_post 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-res-65k blocks.13.hook_resid_post 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-res-65k blocks.14.hook_resid_post 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-res-65k blocks.15.hook_resid_post 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-res-65k blocks.16.hook_resid_post 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-res-65k blocks.17.hook_resid_post 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-res-65k blocks.18.hook_resid_post 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-res-65k blocks.19.hook_resid_post 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-res-65k blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-res-65k blocks.21.hook_resid_post 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-res-65k blocks.22.hook_resid_post 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-res-65k blocks.23.hook_resid_post 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-res-65k blocks.24.hook_resid_post 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-res-65k blocks.25.hook_resid_post 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-2b-pt-mlp

  • Huggingface Repo: google/gemma-scope-2b-pt-mlp
  • model: gemma-2-2b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/average_l0_119
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_16
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_30
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_60
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_9
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_105
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_12
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_239
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_24
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_50
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_19
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_213
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_41
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_434
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_95
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_195
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_21
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_377
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_44
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_95
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_18
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_198
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_38
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_433
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_85
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_114
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_23
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_269
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_48
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_575
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_133
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_25
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_328
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_55
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_699
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_146
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_28
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_355
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_60
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_731
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_136
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_27
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_351
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_56
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_739
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_216
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_38
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_482
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_861
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_88
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_110
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_266
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_45
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_568
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_908
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_234
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_42
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_499
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_847
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_98
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_108
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_262
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_44
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_548
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_879
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_112
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_267
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_47
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_553
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_892
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_246
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_41
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_536
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_894
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_97
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_207
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_35
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_492
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_80
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_879
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_185
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_33
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_452
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_72
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_847
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_179
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_31
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_453
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_68
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_853
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_106
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_24
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_292
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_47
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_672
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_109
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_25
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_295
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_50
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_673
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_109
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_24
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_289
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_49
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_658
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_113
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_23
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_279
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_48
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_633
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_121
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_24
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_290
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_51
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_624
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_128
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_27
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_287
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_57
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_627
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_158
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_19
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_35
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_357
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_73
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_126
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_15
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_277
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_29
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_59
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_12
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_21
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_39
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_7
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_72
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_11
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_127
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_20
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_37
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_67
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_134
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_16
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_265
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_31
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_60
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_144
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_18
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_279
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_33
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_68
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_138
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_17
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_299
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_32
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_66
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_186
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_22
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_407
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_43
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_86
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_101
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_224
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_24
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_47
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_515
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_115
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_266
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_28
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_56
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_571
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_110
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_256
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_31
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_547
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_55
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_168
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_38
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_387
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_745
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_77
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_218
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_43
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_474
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_851
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_95
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_200
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_41
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_436
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_771
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_88
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_222
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_44
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_482
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_848
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_96
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_228
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_44
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_480
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_841
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_98
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_204
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_39
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_463
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_816
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_89
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_164
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_35
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_405
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_72
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_754
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_142
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_32
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_348
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_66
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_695
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_136
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_30
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_342
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_61
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_666
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_191
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_24
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_44
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_491
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_88
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_192
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_25
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_45
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_470
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_88
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_189
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_23
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_44
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_446
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_88
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_192
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_23
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_42
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_472
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_86
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_203
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_23
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_46
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_487
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_92
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_102
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_218
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_25
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_49
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_497
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_128
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_18
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_268
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_32
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_62
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_107
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_14
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_215
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_26
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_52
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-2b-pt-mlp-canonical

  • Huggingface Repo: google/gemma-scope-2b-pt-mlp
  • model: gemma-2-2b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-mlp-16k blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-mlp-16k blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-mlp-16k blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-mlp-16k blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-mlp-16k blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-mlp-16k blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-mlp-16k blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-mlp-16k blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-mlp-16k blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-mlp-16k blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-mlp-16k blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-mlp-16k blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-mlp-16k blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-mlp-16k blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-mlp-16k blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-mlp-16k blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-mlp-16k blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-mlp-16k blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-mlp-16k blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-mlp-16k blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-mlp-16k blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-mlp-16k blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-mlp-16k blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-mlp-16k blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-mlp-16k blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-mlp-16k blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_0/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-mlp-65k blocks.0.hook_mlp_out 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-mlp-65k blocks.1.hook_mlp_out 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-mlp-65k blocks.2.hook_mlp_out 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-mlp-65k blocks.3.hook_mlp_out 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-mlp-65k blocks.4.hook_mlp_out 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-mlp-65k blocks.5.hook_mlp_out 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-mlp-65k blocks.6.hook_mlp_out 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-mlp-65k blocks.7.hook_mlp_out 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-mlp-65k blocks.8.hook_mlp_out 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-mlp-65k blocks.9.hook_mlp_out 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-mlp-65k blocks.10.hook_mlp_out 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-mlp-65k blocks.11.hook_mlp_out 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-mlp-65k blocks.12.hook_mlp_out 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-mlp-65k blocks.13.hook_mlp_out 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-mlp-65k blocks.14.hook_mlp_out 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-mlp-65k blocks.15.hook_mlp_out 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-mlp-65k blocks.16.hook_mlp_out 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-mlp-65k blocks.17.hook_mlp_out 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-mlp-65k blocks.18.hook_mlp_out 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-mlp-65k blocks.19.hook_mlp_out 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-mlp-65k blocks.20.hook_mlp_out 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-mlp-65k blocks.21.hook_mlp_out 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-mlp-65k blocks.22.hook_mlp_out 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-mlp-65k blocks.23.hook_mlp_out 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-mlp-65k blocks.24.hook_mlp_out 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-mlp-65k blocks.25.hook_mlp_out 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-2b-pt-att

  • Huggingface Repo: google/gemma-scope-2b-pt-att
  • model: gemma-2-2b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/average_l0_104
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_12
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_18
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_30
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_57
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_146
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_20
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_251
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_40
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_79
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_174
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_19
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_297
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_43
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_93
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_117
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_219
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_24
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_386
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_55
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_116
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_249
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_26
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_454
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_53
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_135
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_268
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_30
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_449
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_59
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_143
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_292
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_30
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_479
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_61
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_184
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_331
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_46
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_537
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_99
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_129
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_282
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_32
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_482
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_64
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_127
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_270
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_34
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_499
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_64
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_148
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_307
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_36
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_541
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_70
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_170
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_350
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_41
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_593
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_80
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_184
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_328
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_41
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_514
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_85
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_203
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_372
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_43
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_570
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_92
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_161
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_298
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_37
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_468
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_71
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_195
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_342
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_44
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_535
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_98
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_144
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_293
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_37
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_527
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_71
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_176
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_316
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_38
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_509
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_79
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_144
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_292
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_34
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_491
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_72
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_122
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_249
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_28
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_423
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_56
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_141
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_274
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_31
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_446
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_62
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_142
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_301
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_32
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_505
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_65
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_106
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_215
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_22
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_373
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_47
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_161
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_30
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_300
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_474
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_73
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_212
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_372
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_39
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_558
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_96
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_177
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_313
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_35
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_492
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_77
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_10
Load this SAE
jumprelu blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_16
Load this SAE
jumprelu blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_24
Load this SAE
jumprelu blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_43
Load this SAE
jumprelu blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_0/width_65k/average_l0_75
Load this SAE
jumprelu blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_15
Load this SAE
jumprelu blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_181
Load this SAE
jumprelu blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_28
Load this SAE
jumprelu blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_55
Load this SAE
jumprelu blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/average_l0_98
Load this SAE
jumprelu blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_125
Load this SAE
jumprelu blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_14
Load this SAE
jumprelu blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_228
Load this SAE
jumprelu blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_28
Load this SAE
jumprelu blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/average_l0_59
Load this SAE
jumprelu blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_174
Load this SAE
jumprelu blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_19
Load this SAE
jumprelu blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_320
Load this SAE
jumprelu blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_39
Load this SAE
jumprelu blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/average_l0_83
Load this SAE
jumprelu blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_188
Load this SAE
jumprelu blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_22
Load this SAE
jumprelu blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_382
Load this SAE
jumprelu blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_43
Load this SAE
jumprelu blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/average_l0_87
Load this SAE
jumprelu blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_227
Load this SAE
jumprelu blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_28
Load this SAE
jumprelu blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_400
Load this SAE
jumprelu blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_51
Load this SAE
jumprelu blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/average_l0_99
Load this SAE
jumprelu blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_112
Load this SAE
jumprelu blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_261
Load this SAE
jumprelu blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_30
Load this SAE
jumprelu blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_449
Load this SAE
jumprelu blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/average_l0_55
Load this SAE
jumprelu blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_176
Load this SAE
jumprelu blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_311
Load this SAE
jumprelu blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_519
Load this SAE
jumprelu blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_52
Load this SAE
jumprelu blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/average_l0_96
Load this SAE
jumprelu blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_112
Load this SAE
jumprelu blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_246
Load this SAE
jumprelu blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_35
Load this SAE
jumprelu blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_454
Load this SAE
jumprelu blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/average_l0_56
Load this SAE
jumprelu blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_107
Load this SAE
jumprelu blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_231
Load this SAE
jumprelu blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_31
Load this SAE
jumprelu blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_454
Load this SAE
jumprelu blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/average_l0_57
Load this SAE
jumprelu blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_134
Load this SAE
jumprelu blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_292
Load this SAE
jumprelu blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_35
Load this SAE
jumprelu blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_521
Load this SAE
jumprelu blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/average_l0_67
Load this SAE
jumprelu blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_154
Load this SAE
jumprelu blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_330
Load this SAE
jumprelu blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_41
Load this SAE
jumprelu blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_576
Load this SAE
jumprelu blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/average_l0_75
Load this SAE
jumprelu blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_172
Load this SAE
jumprelu blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_320
Load this SAE
jumprelu blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_39
Load this SAE
jumprelu blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_503
Load this SAE
jumprelu blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/average_l0_79
Load this SAE
jumprelu blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_191
Load this SAE
jumprelu blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_363
Load this SAE
jumprelu blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_41
Load this SAE
jumprelu blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_556
Load this SAE
jumprelu blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/average_l0_87
Load this SAE
jumprelu blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_138
Load this SAE
jumprelu blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_283
Load this SAE
jumprelu blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_37
Load this SAE
jumprelu blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_453
Load this SAE
jumprelu blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/average_l0_66
Load this SAE
jumprelu blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_182
Load this SAE
jumprelu blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_327
Load this SAE
jumprelu blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_42
Load this SAE
jumprelu blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_517
Load this SAE
jumprelu blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/average_l0_90
Load this SAE
jumprelu blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_129
Load this SAE
jumprelu blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_260
Load this SAE
jumprelu blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_35
Load this SAE
jumprelu blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_502
Load this SAE
jumprelu blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/average_l0_64
Load this SAE
jumprelu blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_157
Load this SAE
jumprelu blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_293
Load this SAE
jumprelu blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_35
Load this SAE
jumprelu blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_489
Load this SAE
jumprelu blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/average_l0_70
Load this SAE
jumprelu blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_123
Load this SAE
jumprelu blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_255
Load this SAE
jumprelu blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_29
Load this SAE
jumprelu blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_466
Load this SAE
jumprelu blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/average_l0_58
Load this SAE
jumprelu blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_106
Load this SAE
jumprelu blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_220
Load this SAE
jumprelu blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_26
Load this SAE
jumprelu blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_411
Load this SAE
jumprelu blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/average_l0_49
Load this SAE
jumprelu blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_102
Load this SAE
jumprelu blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_242
Load this SAE
jumprelu blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_26
Load this SAE
jumprelu blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_419
Load this SAE
jumprelu blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_49
Load this SAE
jumprelu blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_118
Load this SAE
jumprelu blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_266
Load this SAE
jumprelu blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_29
Load this SAE
jumprelu blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_474
Load this SAE
jumprelu blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/average_l0_56
Load this SAE
jumprelu blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_112
Load this SAE
jumprelu blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_196
Load this SAE
jumprelu blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_20
Load this SAE
jumprelu blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_361
Load this SAE
jumprelu blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/average_l0_37
Load this SAE
jumprelu blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_140
Load this SAE
jumprelu blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_27
Load this SAE
jumprelu blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_276
Load this SAE
jumprelu blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_457
Load this SAE
jumprelu blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/average_l0_56
Load this SAE
jumprelu blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_186
Load this SAE
jumprelu blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_32
Load this SAE
jumprelu blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_347
Load this SAE
jumprelu blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_537
Load this SAE
jumprelu blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/average_l0_77
Load this SAE
jumprelu blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_153
Load this SAE
jumprelu blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_290
Load this SAE
jumprelu blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_30
Load this SAE
jumprelu blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_465
Load this SAE
jumprelu blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/average_l0_63
Load this SAE
jumprelu blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-2b-pt-att-canonical

  • Huggingface Repo: google/gemma-scope-2b-pt-att
  • model: gemma-2-2b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-att-16k blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-att-16k blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-att-16k blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-att-16k blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-att-16k blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-att-16k blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-att-16k blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-att-16k blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-att-16k blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-att-16k blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-att-16k blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-att-16k blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-att-16k blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-att-16k blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-att-16k blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-att-16k blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-att-16k blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-att-16k blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-att-16k blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-att-16k blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-att-16k blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-att-16k blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-att-16k blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-att-16k blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-att-16k blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-att-16k blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_0/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/0-gemmascope-att-65k blocks.0.attn.hook_z 0 65536 1024 monology/pile-uncopyrighted
layer_1/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/1-gemmascope-att-65k blocks.1.attn.hook_z 1 65536 1024 monology/pile-uncopyrighted
layer_2/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/2-gemmascope-att-65k blocks.2.attn.hook_z 2 65536 1024 monology/pile-uncopyrighted
layer_3/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/3-gemmascope-att-65k blocks.3.attn.hook_z 3 65536 1024 monology/pile-uncopyrighted
layer_4/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/4-gemmascope-att-65k blocks.4.attn.hook_z 4 65536 1024 monology/pile-uncopyrighted
layer_5/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/5-gemmascope-att-65k blocks.5.attn.hook_z 5 65536 1024 monology/pile-uncopyrighted
layer_6/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/6-gemmascope-att-65k blocks.6.attn.hook_z 6 65536 1024 monology/pile-uncopyrighted
layer_7/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/7-gemmascope-att-65k blocks.7.attn.hook_z 7 65536 1024 monology/pile-uncopyrighted
layer_8/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/8-gemmascope-att-65k blocks.8.attn.hook_z 8 65536 1024 monology/pile-uncopyrighted
layer_9/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/9-gemmascope-att-65k blocks.9.attn.hook_z 9 65536 1024 monology/pile-uncopyrighted
layer_10/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/10-gemmascope-att-65k blocks.10.attn.hook_z 10 65536 1024 monology/pile-uncopyrighted
layer_11/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/11-gemmascope-att-65k blocks.11.attn.hook_z 11 65536 1024 monology/pile-uncopyrighted
layer_12/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/12-gemmascope-att-65k blocks.12.attn.hook_z 12 65536 1024 monology/pile-uncopyrighted
layer_13/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/13-gemmascope-att-65k blocks.13.attn.hook_z 13 65536 1024 monology/pile-uncopyrighted
layer_14/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/14-gemmascope-att-65k blocks.14.attn.hook_z 14 65536 1024 monology/pile-uncopyrighted
layer_15/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/15-gemmascope-att-65k blocks.15.attn.hook_z 15 65536 1024 monology/pile-uncopyrighted
layer_16/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/16-gemmascope-att-65k blocks.16.attn.hook_z 16 65536 1024 monology/pile-uncopyrighted
layer_17/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/17-gemmascope-att-65k blocks.17.attn.hook_z 17 65536 1024 monology/pile-uncopyrighted
layer_18/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/18-gemmascope-att-65k blocks.18.attn.hook_z 18 65536 1024 monology/pile-uncopyrighted
layer_19/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/19-gemmascope-att-65k blocks.19.attn.hook_z 19 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/20-gemmascope-att-65k blocks.20.attn.hook_z 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/21-gemmascope-att-65k blocks.21.attn.hook_z 21 65536 1024 monology/pile-uncopyrighted
layer_22/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/22-gemmascope-att-65k blocks.22.attn.hook_z 22 65536 1024 monology/pile-uncopyrighted
layer_23/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/23-gemmascope-att-65k blocks.23.attn.hook_z 23 65536 1024 monology/pile-uncopyrighted
layer_24/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/24-gemmascope-att-65k blocks.24.attn.hook_z 24 65536 1024 monology/pile-uncopyrighted
layer_25/width_65k/canonical
Load this SAE
jumprelu gemma-2-2b/25-gemmascope-att-65k blocks.25.attn.hook_z 25 65536 1024 monology/pile-uncopyrighted

gemma-scope-9b-pt-res

  • Huggingface Repo: google/gemma-scope-9b-pt-res
  • model: gemma-2-9b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
embedding/width_4k/average_l0_14
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_22
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_7
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
embedding/width_4k/average_l0_80
Load this SAE
jumprelu hook_embed 0 4096 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_11
Load this SAE
jumprelu blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_15
Load this SAE
jumprelu blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_21
Load this SAE
jumprelu blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_30
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-res-131k-l0_32plus blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_41
Load this SAE
jumprelu blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_8
Load this SAE
jumprelu blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_11
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_129
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_17
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-res-16k-l0_32plus blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_68
Load this SAE
jumprelu blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_13
Load this SAE
jumprelu blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_20
Load this SAE
jumprelu blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-res-131k-l0_32plus blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_56
Load this SAE
jumprelu blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_6
Load this SAE
jumprelu blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_9
Load this SAE
jumprelu blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_15
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_175
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_31
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_69
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-res-16k-l0_32plus blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_9
Load this SAE
jumprelu blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_15
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_151
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_27
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_47
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-res-131k-l0_32plus blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_84
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_9
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_10
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_113
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_17
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_243
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_31
Load this SAE
jumprelu blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_57
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-res-16k-l0_32plus blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_16
Load this SAE
jumprelu blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_162
Load this SAE
jumprelu blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_27
Load this SAE
jumprelu blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_49
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-res-131k-l0_32plus blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_88
Load this SAE
jumprelu blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_9
Load this SAE
jumprelu blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_10
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_118
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_18
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_255
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-res-16k-l0_32plus blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_60
Load this SAE
jumprelu blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_10
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_17
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_183
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_29
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_52
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-res-131k-l0_32plus blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_96
Load this SAE
jumprelu blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_10
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_130
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_19
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_287
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-res-16k-l0_32plus blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_64
Load this SAE
jumprelu blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_10
Load this SAE
jumprelu blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_17
Load this SAE
jumprelu blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_189
Load this SAE
jumprelu blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_30
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-res-131k-l0_32plus blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_54
Load this SAE
jumprelu blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_99
Load this SAE
jumprelu blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_11
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_132
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_19
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_285
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-res-16k-l0_32plus blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_65
Load this SAE
jumprelu blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_10
Load this SAE
jumprelu blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_105
Load this SAE
jumprelu blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_18
Load this SAE
jumprelu blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_197
Load this SAE
jumprelu blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_31
Load this SAE
jumprelu blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_56
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-res-131k-l0_32plus blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_11
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_137
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_19
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_294
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-res-16k-l0_32plus blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_67
Load this SAE
jumprelu blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_10
Load this SAE
jumprelu blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_103
Load this SAE
jumprelu blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_17
Load this SAE
jumprelu blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_198
Load this SAE
jumprelu blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_30
Load this SAE
jumprelu blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_55
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-res-131k-l0_32plus blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_10
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_131
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_18
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_290
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-res-16k-l0_32plus blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_65
Load this SAE
jumprelu blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_11
Load this SAE
jumprelu blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_121
Load this SAE
jumprelu blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_20
Load this SAE
jumprelu blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_232
Load this SAE
jumprelu blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-res-131k-l0_32plus blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_65
Load this SAE
jumprelu blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_11
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_152
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_21
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_346
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_39
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-res-16k-l0_32plus blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_75
Load this SAE
jumprelu blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_11
Load this SAE
jumprelu blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_117
Load this SAE
jumprelu blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_19
Load this SAE
jumprelu blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_221
Load this SAE
jumprelu blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-res-131k-l0_32plus blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_64
Load this SAE
jumprelu blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_12
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_144
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_21
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_317
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_38
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-res-16k-l0_32plus blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_73
Load this SAE
jumprelu blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_11
Load this SAE
jumprelu blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_113
Load this SAE
jumprelu blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_19
Load this SAE
jumprelu blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_221
Load this SAE
jumprelu blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-res-131k-l0_32plus blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_62
Load this SAE
jumprelu blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_11
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_140
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_20
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_309
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-res-16k-l0_32plus blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_71
Load this SAE
jumprelu blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_10
Load this SAE
jumprelu blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_110
Load this SAE
jumprelu blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_18
Load this SAE
jumprelu blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_210
Load this SAE
jumprelu blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-res-131k-l0_32plus blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_60
Load this SAE
jumprelu blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_11
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_132
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_19
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_293
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-res-16k-l0_32plus blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_67
Load this SAE
jumprelu blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_12
Load this SAE
jumprelu blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_19
Load this SAE
jumprelu blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_36
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-res-131k-l0_32plus blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_5
Load this SAE
jumprelu blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_70
Load this SAE
jumprelu blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_8
Load this SAE
jumprelu blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_14
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_189
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_29
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_67
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-res-16k-l0_32plus blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_8
Load this SAE
jumprelu blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_10
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_11
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_114
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_12
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_19
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_221
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_269
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_276
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_288
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k-l0_32plus blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_51
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_53
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_54
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_62
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_11
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_138
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_20
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_310
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_36
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-16k-l0_32plus blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_393
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_408
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_427
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_57
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_58
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_68
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_101
Load this SAE
jumprelu blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_11
Load this SAE
jumprelu blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_19
Load this SAE
jumprelu blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_193
Load this SAE
jumprelu blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_34
Load this SAE
jumprelu blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/average_l0_57
Load this SAE
jumprelu blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_10
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_11
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_13
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_249
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_259
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_276
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_49
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_50
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_262k/average_l0_64
Load this SAE
jumprelu blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_32k/average_l0_11
Load this SAE
jumprelu blocks.20.hook_resid_post 20 32768 1024 monology/pile-uncopyrighted
layer_20/width_32k/average_l0_334
Load this SAE
jumprelu blocks.20.hook_resid_post 20 32768 1024 monology/pile-uncopyrighted
layer_20/width_32k/average_l0_344
Load this SAE
jumprelu blocks.20.hook_resid_post 20 32768 1024 monology/pile-uncopyrighted
layer_20/width_32k/average_l0_357
Load this SAE
jumprelu blocks.20.hook_resid_post 20 32768 1024 monology/pile-uncopyrighted
layer_20/width_32k/average_l0_55
Load this SAE
jumprelu blocks.20.hook_resid_post 20 32768 1024 monology/pile-uncopyrighted
layer_20/width_32k/average_l0_57
Load this SAE
jumprelu blocks.20.hook_resid_post 20 32768 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_10
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_229
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_24
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_241
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_298
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_46
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_48
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_524k/average_l0_78
Load this SAE
jumprelu blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_11
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_292
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_298
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_309
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_54
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_20/width_65k/average_l0_55
Load this SAE
jumprelu blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_109
Load this SAE
jumprelu blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_11
Load this SAE
jumprelu blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_19
Load this SAE
jumprelu blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_204
Load this SAE
jumprelu blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-res-131k-l0_32plus blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_58
Load this SAE
jumprelu blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_11
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_129
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_19
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_278
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_36
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-res-16k-l0_32plus blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_66
Load this SAE
jumprelu blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_10
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_105
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_18
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_197
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-res-131k-l0_32plus blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_58
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_11
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_123
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_19
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_268
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-res-16k-l0_32plus blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_65
Load this SAE
jumprelu blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_10
Load this SAE
jumprelu blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_101
Load this SAE
jumprelu blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_18
Load this SAE
jumprelu blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_187
Load this SAE
jumprelu blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-res-131k-l0_32plus blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_56
Load this SAE
jumprelu blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_11
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_120
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_19
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_248
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-res-16k-l0_32plus blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_63
Load this SAE
jumprelu blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_10
Load this SAE
jumprelu blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_17
Load this SAE
jumprelu blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_180
Load this SAE
jumprelu blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_30
Load this SAE
jumprelu blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_55
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-res-131k-l0_32plus blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_97
Load this SAE
jumprelu blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_10
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_114
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_19
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_234
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-res-16k-l0_32plus blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_61
Load this SAE
jumprelu blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_10
Load this SAE
jumprelu blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_177
Load this SAE
jumprelu blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_18
Load this SAE
jumprelu blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_31
Load this SAE
jumprelu blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_54
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-res-131k-l0_32plus blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_96
Load this SAE
jumprelu blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_11
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_114
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_19
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_231
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-res-16k-l0_32plus blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_61
Load this SAE
jumprelu blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_10
Load this SAE
jumprelu blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_176
Load this SAE
jumprelu blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_18
Load this SAE
jumprelu blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-res-131k-l0_32plus blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_55
Load this SAE
jumprelu blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_97
Load this SAE
jumprelu blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_11
Load this SAE
jumprelu blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_116
Load this SAE
jumprelu blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_20
Load this SAE
jumprelu blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_233
Load this SAE
jumprelu blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-res-16k-l0_32plus blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_63
Load this SAE
jumprelu blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_11
Load this SAE
jumprelu blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_171
Load this SAE
jumprelu blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_19
Load this SAE
jumprelu blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-res-131k-l0_32plus blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_56
Load this SAE
jumprelu blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_96
Load this SAE
jumprelu blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_118
Load this SAE
jumprelu blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_12
Load this SAE
jumprelu blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_21
Load this SAE
jumprelu blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_230
Load this SAE
jumprelu blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_36
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-res-16k-l0_32plus blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_65
Load this SAE
jumprelu blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_11
Load this SAE
jumprelu blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_171
Load this SAE
jumprelu blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_19
Load this SAE
jumprelu blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-res-131k-l0_32plus blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_57
Load this SAE
jumprelu blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_98
Load this SAE
jumprelu blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_119
Load this SAE
jumprelu blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_12
Load this SAE
jumprelu blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_21
Load this SAE
jumprelu blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_229
Load this SAE
jumprelu blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-res-16k-l0_32plus blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_65
Load this SAE
jumprelu blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_11
Load this SAE
jumprelu blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_171
Load this SAE
jumprelu blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_19
Load this SAE
jumprelu blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-res-131k-l0_32plus blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_56
Load this SAE
jumprelu blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_97
Load this SAE
jumprelu blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_119
Load this SAE
jumprelu blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_12
Load this SAE
jumprelu blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_21
Load this SAE
jumprelu blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_224
Load this SAE
jumprelu blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_38
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-res-16k-l0_32plus blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_66
Load this SAE
jumprelu blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_103
Load this SAE
jumprelu blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_14
Load this SAE
jumprelu blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_25
Load this SAE
jumprelu blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_46
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-res-131k-l0_32plus blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_6
Load this SAE
jumprelu blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_9
Load this SAE
jumprelu blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_10
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_17
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_229
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-res-16k-l0_32plus blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_90
Load this SAE
jumprelu blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_11
Load this SAE
jumprelu blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_170
Load this SAE
jumprelu blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_18
Load this SAE
jumprelu blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-res-131k-l0_32plus blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_56
Load this SAE
jumprelu blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_95
Load this SAE
jumprelu blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_12
Load this SAE
jumprelu blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_120
Load this SAE
jumprelu blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_21
Load this SAE
jumprelu blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_226
Load this SAE
jumprelu blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-res-16k-l0_32plus blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_66
Load this SAE
jumprelu blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_10
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_160
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_18
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_31
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_52
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-131k-l0_32plus blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_92
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_11
Load this SAE
jumprelu blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_114
Load this SAE
jumprelu blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_20
Load this SAE
jumprelu blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_218
Load this SAE
jumprelu blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_35
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-16k-l0_32plus blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_63
Load this SAE
jumprelu blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_11
Load this SAE
jumprelu blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_132
Load this SAE
jumprelu blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_25
Load this SAE
jumprelu blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_27
Load this SAE
jumprelu blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_45
Load this SAE
jumprelu blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/average_l0_77
Load this SAE
jumprelu blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_10
Load this SAE
jumprelu blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_158
Load this SAE
jumprelu blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_18
Load this SAE
jumprelu blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_30
Load this SAE
jumprelu blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-res-131k-l0_32plus blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_88
Load this SAE
jumprelu blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_11
Load this SAE
jumprelu blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_111
Load this SAE
jumprelu blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_20
Load this SAE
jumprelu blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_219
Load this SAE
jumprelu blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-res-16k-l0_32plus blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_61
Load this SAE
jumprelu blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_10
Load this SAE
jumprelu blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_165
Load this SAE
jumprelu blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_18
Load this SAE
jumprelu blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_30
Load this SAE
jumprelu blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-res-131k-l0_32plus blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_91
Load this SAE
jumprelu blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_11
Load this SAE
jumprelu blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_114
Load this SAE
jumprelu blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_20
Load this SAE
jumprelu blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_228
Load this SAE
jumprelu blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-res-16k-l0_32plus blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_63
Load this SAE
jumprelu blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_10
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_163
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_17
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_30
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-res-131k-l0_32plus blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_89
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_11
Load this SAE
jumprelu blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_114
Load this SAE
jumprelu blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_19
Load this SAE
jumprelu blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_229
Load this SAE
jumprelu blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-res-16k-l0_32plus blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_60
Load this SAE
jumprelu blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_10
Load this SAE
jumprelu blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_17
Load this SAE
jumprelu blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_171
Load this SAE
jumprelu blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_30
Load this SAE
jumprelu blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-res-131k-l0_32plus blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_94
Load this SAE
jumprelu blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_11
Load this SAE
jumprelu blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_120
Load this SAE
jumprelu blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_19
Load this SAE
jumprelu blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_246
Load this SAE
jumprelu blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-res-16k-l0_32plus blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_61
Load this SAE
jumprelu blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_10
Load this SAE
jumprelu blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_17
Load this SAE
jumprelu blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_180
Load this SAE
jumprelu blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_30
Load this SAE
jumprelu blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-res-131k-l0_32plus blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_93
Load this SAE
jumprelu blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_11
Load this SAE
jumprelu blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_120
Load this SAE
jumprelu blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_19
Load this SAE
jumprelu blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_252
Load this SAE
jumprelu blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-res-16k-l0_32plus blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_61
Load this SAE
jumprelu blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_10
Load this SAE
jumprelu blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_18
Load this SAE
jumprelu blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_184
Load this SAE
jumprelu blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_30
Load this SAE
jumprelu blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_53
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-res-131k-l0_32plus blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_96
Load this SAE
jumprelu blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_11
Load this SAE
jumprelu blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_124
Load this SAE
jumprelu blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_20
Load this SAE
jumprelu blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_266
Load this SAE
jumprelu blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-res-16k-l0_32plus blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_63
Load this SAE
jumprelu blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_10
Load this SAE
jumprelu blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_101
Load this SAE
jumprelu blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_18
Load this SAE
jumprelu blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_194
Load this SAE
jumprelu blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_30
Load this SAE
jumprelu blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_53
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-res-131k-l0_32plus blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_11
Load this SAE
jumprelu blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_128
Load this SAE
jumprelu blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_20
Load this SAE
jumprelu blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_286
Load this SAE
jumprelu blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-res-16k-l0_32plus blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_64
Load this SAE
jumprelu blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_10
Load this SAE
jumprelu blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_18
Load this SAE
jumprelu blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_199
Load this SAE
jumprelu blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_30
Load this SAE
jumprelu blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_54
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-res-131k-l0_32plus blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_99
Load this SAE
jumprelu blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_11
Load this SAE
jumprelu blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_131
Load this SAE
jumprelu blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_19
Load this SAE
jumprelu blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_298
Load this SAE
jumprelu blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-res-16k-l0_32plus blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_64
Load this SAE
jumprelu blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_101
Load this SAE
jumprelu blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_16
Load this SAE
jumprelu blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_28
Load this SAE
jumprelu blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-res-131k-l0_32plus blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_6
Load this SAE
jumprelu blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_9
Load this SAE
jumprelu blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_10
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_18
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_234
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-res-16k-l0_32plus blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_91
Load this SAE
jumprelu blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_10
Load this SAE
jumprelu blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_17
Load this SAE
jumprelu blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_193
Load this SAE
jumprelu blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_29
Load this SAE
jumprelu blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_49
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-res-131k-l0_32plus blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_94
Load this SAE
jumprelu blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_10
Load this SAE
jumprelu blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_125
Load this SAE
jumprelu blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_18
Load this SAE
jumprelu blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_292
Load this SAE
jumprelu blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-res-16k-l0_32plus blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_61
Load this SAE
jumprelu blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_10
Load this SAE
jumprelu blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_15
Load this SAE
jumprelu blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_175
Load this SAE
jumprelu blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_26
Load this SAE
jumprelu blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_45
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-res-131k-l0_32plus blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_84
Load this SAE
jumprelu blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_10
Load this SAE
jumprelu blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_113
Load this SAE
jumprelu blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_16
Load this SAE
jumprelu blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_270
Load this SAE
jumprelu blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_28
Load this SAE
jumprelu blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_52
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-res-16k-l0_32plus blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_10
Load this SAE
jumprelu blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_16
Load this SAE
jumprelu blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_29
Load this SAE
jumprelu blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-res-131k-l0_32plus blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_6
Load this SAE
jumprelu blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_94
Load this SAE
jumprelu blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_11
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_193
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_20
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-res-16k-l0_32plus blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_77
Load this SAE
jumprelu blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_12
Load this SAE
jumprelu blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_120
Load this SAE
jumprelu blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_21
Load this SAE
jumprelu blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_36
Load this SAE
jumprelu blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_66
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-res-131k-l0_32plus blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_7
Load this SAE
jumprelu blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_14
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_224
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_25
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_47
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-res-16k-l0_32plus blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_8
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_93
Load this SAE
jumprelu blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_119
Load this SAE
jumprelu blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_13
Load this SAE
jumprelu blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_21
Load this SAE
jumprelu blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_38
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-res-131k-l0_32plus blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_65
Load this SAE
jumprelu blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_8
Load this SAE
jumprelu blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_14
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_198
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_25
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_46
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-res-16k-l0_32plus blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_8
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_92
Load this SAE
jumprelu blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_129
Load this SAE
jumprelu blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_14
Load this SAE
jumprelu blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_24
Load this SAE
jumprelu blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_41
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-res-131k-l0_32plus blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_72
Load this SAE
jumprelu blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_8
Load this SAE
jumprelu blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_16
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_207
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_28
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-res-16k-l0_32plus blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_9
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_99
Load this SAE
jumprelu blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_134
Load this SAE
jumprelu blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_14
Load this SAE
jumprelu blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_25
Load this SAE
jumprelu blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_42
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-res-131k-l0_32plus blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_75
Load this SAE
jumprelu blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_8
Load this SAE
jumprelu blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_100
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_16
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_209
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_28
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-res-16k-l0_32plus blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_9
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_1m/average_l0_122
Load this SAE
jumprelu blocks.9.hook_resid_post 9 1048576 1024 monology/pile-uncopyrighted
layer_9/width_1m/average_l0_14
Load this SAE
jumprelu blocks.9.hook_resid_post 9 1048576 1024 monology/pile-uncopyrighted
layer_9/width_1m/average_l0_24
Load this SAE
jumprelu blocks.9.hook_resid_post 9 1048576 1024 monology/pile-uncopyrighted
layer_9/width_1m/average_l0_41
Load this SAE
jumprelu blocks.9.hook_resid_post 9 1048576 1024 monology/pile-uncopyrighted
layer_9/width_1m/average_l0_70
Load this SAE
jumprelu blocks.9.hook_resid_post 9 1048576 1024 monology/pile-uncopyrighted
layer_9/width_1m/average_l0_9
Load this SAE
jumprelu blocks.9.hook_resid_post 9 1048576 1024 monology/pile-uncopyrighted

gemma-scope-9b-pt-res-canonical

  • Huggingface Repo: google/gemma-scope-9b-pt-res
  • model: gemma-2-9b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-res-16k blocks.0.hook_resid_post 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-res-16k blocks.1.hook_resid_post 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-res-16k blocks.2.hook_resid_post 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-res-16k blocks.3.hook_resid_post 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-res-16k blocks.4.hook_resid_post 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-res-16k blocks.5.hook_resid_post 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-res-16k blocks.6.hook_resid_post 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-res-16k blocks.7.hook_resid_post 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-res-16k blocks.8.hook_resid_post 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-res-16k blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-res-16k blocks.10.hook_resid_post 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-res-16k blocks.11.hook_resid_post 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-res-16k blocks.12.hook_resid_post 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-res-16k blocks.13.hook_resid_post 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-res-16k blocks.14.hook_resid_post 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-res-16k blocks.15.hook_resid_post 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-res-16k blocks.16.hook_resid_post 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-res-16k blocks.17.hook_resid_post 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-res-16k blocks.18.hook_resid_post 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-res-16k blocks.19.hook_resid_post 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-16k blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-res-16k blocks.21.hook_resid_post 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-res-16k blocks.22.hook_resid_post 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-res-16k blocks.23.hook_resid_post 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-res-16k blocks.24.hook_resid_post 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-res-16k blocks.25.hook_resid_post 25 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-res-16k blocks.26.hook_resid_post 26 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-res-16k blocks.27.hook_resid_post 27 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-res-16k blocks.28.hook_resid_post 28 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-res-16k blocks.29.hook_resid_post 29 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-res-16k blocks.30.hook_resid_post 30 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-16k blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-res-16k blocks.32.hook_resid_post 32 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-res-16k blocks.33.hook_resid_post 33 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-res-16k blocks.34.hook_resid_post 34 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-res-16k blocks.35.hook_resid_post 35 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-res-16k blocks.36.hook_resid_post 36 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-res-16k blocks.37.hook_resid_post 37 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-res-16k blocks.38.hook_resid_post 38 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-res-16k blocks.39.hook_resid_post 39 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-res-16k blocks.40.hook_resid_post 40 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-res-16k blocks.41.hook_resid_post 41 16384 1024 monology/pile-uncopyrighted
layer_0/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-res-131k blocks.0.hook_resid_post 0 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-res-131k blocks.1.hook_resid_post 1 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-res-131k blocks.2.hook_resid_post 2 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-res-131k blocks.3.hook_resid_post 3 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-res-131k blocks.4.hook_resid_post 4 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-res-131k blocks.5.hook_resid_post 5 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-res-131k blocks.6.hook_resid_post 6 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-res-131k blocks.7.hook_resid_post 7 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-res-131k blocks.8.hook_resid_post 8 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-res-131k blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-res-131k blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-res-131k blocks.11.hook_resid_post 11 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-res-131k blocks.12.hook_resid_post 12 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-res-131k blocks.13.hook_resid_post 13 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-res-131k blocks.14.hook_resid_post 14 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-res-131k blocks.15.hook_resid_post 15 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-res-131k blocks.16.hook_resid_post 16 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-res-131k blocks.17.hook_resid_post 17 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-res-131k blocks.18.hook_resid_post 18 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-res-131k blocks.19.hook_resid_post 19 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-131k blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-res-131k blocks.21.hook_resid_post 21 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-res-131k blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-res-131k blocks.23.hook_resid_post 23 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-res-131k blocks.24.hook_resid_post 24 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-res-131k blocks.25.hook_resid_post 25 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-res-131k blocks.26.hook_resid_post 26 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-res-131k blocks.27.hook_resid_post 27 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-res-131k blocks.28.hook_resid_post 28 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-res-131k blocks.29.hook_resid_post 29 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-res-131k blocks.30.hook_resid_post 30 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-131k blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-res-131k blocks.32.hook_resid_post 32 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-res-131k blocks.33.hook_resid_post 33 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-res-131k blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-res-131k blocks.35.hook_resid_post 35 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-res-131k blocks.36.hook_resid_post 36 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-res-131k blocks.37.hook_resid_post 37 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-res-131k blocks.38.hook_resid_post 38 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-res-131k blocks.39.hook_resid_post 39 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-res-131k blocks.40.hook_resid_post 40 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-res-131k blocks.41.hook_resid_post 41 131072 1024 monology/pile-uncopyrighted
layer_9/width_1m/canonical
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-res-1m blocks.9.hook_resid_post 9 1048576 1024 monology/pile-uncopyrighted
layer_20/width_1m/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-1m blocks.20.hook_resid_post 20 1048576 1024 monology/pile-uncopyrighted
layer_31/width_1m/canonical
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-res-1m blocks.31.hook_resid_post 31 1048576 1024 monology/pile-uncopyrighted
layer_20/width_262k/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-262k blocks.20.hook_resid_post 20 262144 1024 monology/pile-uncopyrighted
layer_20/width_32k/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-32k blocks.20.hook_resid_post 20 32768 1024 monology/pile-uncopyrighted
layer_20/width_524k/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-524k blocks.20.hook_resid_post 20 524288 1024 monology/pile-uncopyrighted
layer_20/width_65k/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-res-65k blocks.20.hook_resid_post 20 65536 1024 monology/pile-uncopyrighted

gemma-scope-9b-pt-att

  • Huggingface Repo: google/gemma-scope-9b-pt-att
  • model: gemma-2-9b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/average_l0_12
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_16
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_25
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_38
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_61
Load this SAE
jumprelu blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_8
Load this SAE
jumprelu blocks.0.attn.hook_z 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_11
Load this SAE
jumprelu blocks.0.attn.hook_z 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_15
Load this SAE
jumprelu blocks.0.attn.hook_z 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_22
Load this SAE
jumprelu blocks.0.attn.hook_z 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_33
Load this SAE
jumprelu blocks.0.attn.hook_z 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_55
Load this SAE
jumprelu blocks.0.attn.hook_z 0 131072 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_17
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_34
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_77
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_147
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_266
Load this SAE
jumprelu blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_8
Load this SAE
jumprelu blocks.1.attn.hook_z 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_12
Load this SAE
jumprelu blocks.1.attn.hook_z 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_18
Load this SAE
jumprelu blocks.1.attn.hook_z 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_29
Load this SAE
jumprelu blocks.1.attn.hook_z 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_63
Load this SAE
jumprelu blocks.1.attn.hook_z 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_116
Load this SAE
jumprelu blocks.1.attn.hook_z 1 131072 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_18
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_33
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_63
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_132
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_301
Load this SAE
jumprelu blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_16
Load this SAE
jumprelu blocks.10.attn.hook_z 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_28
Load this SAE
jumprelu blocks.10.attn.hook_z 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_51
Load this SAE
jumprelu blocks.10.attn.hook_z 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_97
Load this SAE
jumprelu blocks.10.attn.hook_z 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_199
Load this SAE
jumprelu blocks.10.attn.hook_z 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_440
Load this SAE
jumprelu blocks.10.attn.hook_z 10 131072 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_18
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_34
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_67
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_153
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_366
Load this SAE
jumprelu blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_17
Load this SAE
jumprelu blocks.11.attn.hook_z 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_29
Load this SAE
jumprelu blocks.11.attn.hook_z 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_54
Load this SAE
jumprelu blocks.11.attn.hook_z 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_104
Load this SAE
jumprelu blocks.11.attn.hook_z 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_241
Load this SAE
jumprelu blocks.11.attn.hook_z 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_552
Load this SAE
jumprelu blocks.11.attn.hook_z 11 131072 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_19
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_35
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_68
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_149
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_337
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_654
Load this SAE
jumprelu blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_17
Load this SAE
jumprelu blocks.12.attn.hook_z 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_29
Load this SAE
jumprelu blocks.12.attn.hook_z 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_55
Load this SAE
jumprelu blocks.12.attn.hook_z 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_110
Load this SAE
jumprelu blocks.12.attn.hook_z 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_237
Load this SAE
jumprelu blocks.12.attn.hook_z 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_525
Load this SAE
jumprelu blocks.12.attn.hook_z 12 131072 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_20
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_38
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_77
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_170
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_380
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_675
Load this SAE
jumprelu blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_18
Load this SAE
jumprelu blocks.13.attn.hook_z 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_33
Load this SAE
jumprelu blocks.13.attn.hook_z 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_64
Load this SAE
jumprelu blocks.13.attn.hook_z 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_126
Load this SAE
jumprelu blocks.13.attn.hook_z 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_283
Load this SAE
jumprelu blocks.13.attn.hook_z 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_611
Load this SAE
jumprelu blocks.13.attn.hook_z 13 131072 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_21
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_40
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_81
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_179
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_411
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_767
Load this SAE
jumprelu blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_18
Load this SAE
jumprelu blocks.14.attn.hook_z 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_35
Load this SAE
jumprelu blocks.14.attn.hook_z 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_67
Load this SAE
jumprelu blocks.14.attn.hook_z 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_131
Load this SAE
jumprelu blocks.14.attn.hook_z 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_306
Load this SAE
jumprelu blocks.14.attn.hook_z 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_650
Load this SAE
jumprelu blocks.14.attn.hook_z 14 131072 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_21
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_40
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_79
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_168
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_344
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_638
Load this SAE
jumprelu blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_19
Load this SAE
jumprelu blocks.15.attn.hook_z 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_35
Load this SAE
jumprelu blocks.15.attn.hook_z 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_67
Load this SAE
jumprelu blocks.15.attn.hook_z 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_130
Load this SAE
jumprelu blocks.15.attn.hook_z 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_283
Load this SAE
jumprelu blocks.15.attn.hook_z 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_540
Load this SAE
jumprelu blocks.15.attn.hook_z 15 131072 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_21
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_40
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_81
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_172
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_376
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_705
Load this SAE
jumprelu blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_19
Load this SAE
jumprelu blocks.16.attn.hook_z 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_36
Load this SAE
jumprelu blocks.16.attn.hook_z 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_71
Load this SAE
jumprelu blocks.16.attn.hook_z 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_140
Load this SAE
jumprelu blocks.16.attn.hook_z 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_298
Load this SAE
jumprelu blocks.16.attn.hook_z 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_621
Load this SAE
jumprelu blocks.16.attn.hook_z 16 131072 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_24
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_50
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_110
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_227
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_435
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_719
Load this SAE
jumprelu blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_22
Load this SAE
jumprelu blocks.17.attn.hook_z 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_44
Load this SAE
jumprelu blocks.17.attn.hook_z 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_90
Load this SAE
jumprelu blocks.17.attn.hook_z 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_191
Load this SAE
jumprelu blocks.17.attn.hook_z 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_380
Load this SAE
jumprelu blocks.17.attn.hook_z 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_672
Load this SAE
jumprelu blocks.17.attn.hook_z 17 131072 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_21
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_40
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_80
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_171
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_352
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_646
Load this SAE
jumprelu blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_19
Load this SAE
jumprelu blocks.18.attn.hook_z 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_35
Load this SAE
jumprelu blocks.18.attn.hook_z 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_69
Load this SAE
jumprelu blocks.18.attn.hook_z 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_133
Load this SAE
jumprelu blocks.18.attn.hook_z 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_294
Load this SAE
jumprelu blocks.18.attn.hook_z 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_557
Load this SAE
jumprelu blocks.18.attn.hook_z 18 131072 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_21
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_41
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_86
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_186
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_360
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_661
Load this SAE
jumprelu blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_19
Load this SAE
jumprelu blocks.19.attn.hook_z 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_38
Load this SAE
jumprelu blocks.19.attn.hook_z 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_71
Load this SAE
jumprelu blocks.19.attn.hook_z 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_152
Load this SAE
jumprelu blocks.19.attn.hook_z 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_307
Load this SAE
jumprelu blocks.19.attn.hook_z 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_571
Load this SAE
jumprelu blocks.19.attn.hook_z 19 131072 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_15
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_30
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_69
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_180
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_384
Load this SAE
jumprelu blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_7
Load this SAE
jumprelu blocks.2.attn.hook_z 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_11
Load this SAE
jumprelu blocks.2.attn.hook_z 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_18
Load this SAE
jumprelu blocks.2.attn.hook_z 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_32
Load this SAE
jumprelu blocks.2.attn.hook_z 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_62
Load this SAE
jumprelu blocks.2.attn.hook_z 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_135
Load this SAE
jumprelu blocks.2.attn.hook_z 2 131072 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_20
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_39
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_76
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_158
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_342
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_674
Load this SAE
jumprelu blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_18
Load this SAE
jumprelu blocks.20.attn.hook_z 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_34
Load this SAE
jumprelu blocks.20.attn.hook_z 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_65
Load this SAE
jumprelu blocks.20.attn.hook_z 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_125
Load this SAE
jumprelu blocks.20.attn.hook_z 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_270
Load this SAE
jumprelu blocks.20.attn.hook_z 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_558
Load this SAE
jumprelu blocks.20.attn.hook_z 20 131072 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_21
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_41
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_86
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_195
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_420
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_792
Load this SAE
jumprelu blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_18
Load this SAE
jumprelu blocks.21.attn.hook_z 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_35
Load this SAE
jumprelu blocks.21.attn.hook_z 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_71
Load this SAE
jumprelu blocks.21.attn.hook_z 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_150
Load this SAE
jumprelu blocks.21.attn.hook_z 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_333
Load this SAE
jumprelu blocks.21.attn.hook_z 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_665
Load this SAE
jumprelu blocks.21.attn.hook_z 21 131072 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_20
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_36
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_70
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_141
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_289
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_569
Load this SAE
jumprelu blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_17
Load this SAE
jumprelu blocks.22.attn.hook_z 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_32
Load this SAE
jumprelu blocks.22.attn.hook_z 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_59
Load this SAE
jumprelu blocks.22.attn.hook_z 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_115
Load this SAE
jumprelu blocks.22.attn.hook_z 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_231
Load this SAE
jumprelu blocks.22.attn.hook_z 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_446
Load this SAE
jumprelu blocks.22.attn.hook_z 22 131072 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_21
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_41
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_80
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_173
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_356
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_649
Load this SAE
jumprelu blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_19
Load this SAE
jumprelu blocks.23.attn.hook_z 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_36
Load this SAE
jumprelu blocks.23.attn.hook_z 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_66
Load this SAE
jumprelu blocks.23.attn.hook_z 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_134
Load this SAE
jumprelu blocks.23.attn.hook_z 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_288
Load this SAE
jumprelu blocks.23.attn.hook_z 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_568
Load this SAE
jumprelu blocks.23.attn.hook_z 23 131072 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_21
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_40
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_79
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_167
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_348
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_615
Load this SAE
jumprelu blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_19
Load this SAE
jumprelu blocks.24.attn.hook_z 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_35
Load this SAE
jumprelu blocks.24.attn.hook_z 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_66
Load this SAE
jumprelu blocks.24.attn.hook_z 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_130
Load this SAE
jumprelu blocks.24.attn.hook_z 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_273
Load this SAE
jumprelu blocks.24.attn.hook_z 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_542
Load this SAE
jumprelu blocks.24.attn.hook_z 24 131072 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_19
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_36
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_73
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_156
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_371
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_686
Load this SAE
jumprelu blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_17
Load this SAE
jumprelu blocks.25.attn.hook_z 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_31
Load this SAE
jumprelu blocks.25.attn.hook_z 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_59
Load this SAE
jumprelu blocks.25.attn.hook_z 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_115
Load this SAE
jumprelu blocks.25.attn.hook_z 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_261
Load this SAE
jumprelu blocks.25.attn.hook_z 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_605
Load this SAE
jumprelu blocks.25.attn.hook_z 25 131072 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_20
Load this SAE
jumprelu blocks.26.attn.hook_z 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_38
Load this SAE
jumprelu blocks.26.attn.hook_z 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_75
Load this SAE
jumprelu blocks.26.attn.hook_z 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_159
Load this SAE
jumprelu blocks.26.attn.hook_z 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_336
Load this SAE
jumprelu blocks.26.attn.hook_z 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_634
Load this SAE
jumprelu blocks.26.attn.hook_z 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_18
Load this SAE
jumprelu blocks.26.attn.hook_z 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_32
Load this SAE
jumprelu blocks.26.attn.hook_z 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_62
Load this SAE
jumprelu blocks.26.attn.hook_z 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_120
Load this SAE
jumprelu blocks.26.attn.hook_z 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_267
Load this SAE
jumprelu blocks.26.attn.hook_z 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_525
Load this SAE
jumprelu blocks.26.attn.hook_z 26 131072 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_18
Load this SAE
jumprelu blocks.27.attn.hook_z 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_33
Load this SAE
jumprelu blocks.27.attn.hook_z 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_64
Load this SAE
jumprelu blocks.27.attn.hook_z 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_136
Load this SAE
jumprelu blocks.27.attn.hook_z 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_306
Load this SAE
jumprelu blocks.27.attn.hook_z 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_613
Load this SAE
jumprelu blocks.27.attn.hook_z 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_16
Load this SAE
jumprelu blocks.27.attn.hook_z 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_28
Load this SAE
jumprelu blocks.27.attn.hook_z 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_53
Load this SAE
jumprelu blocks.27.attn.hook_z 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_102
Load this SAE
jumprelu blocks.27.attn.hook_z 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_211
Load this SAE
jumprelu blocks.27.attn.hook_z 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_458
Load this SAE
jumprelu blocks.27.attn.hook_z 27 131072 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_20
Load this SAE
jumprelu blocks.28.attn.hook_z 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_37
Load this SAE
jumprelu blocks.28.attn.hook_z 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_71
Load this SAE
jumprelu blocks.28.attn.hook_z 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_143
Load this SAE
jumprelu blocks.28.attn.hook_z 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_279
Load this SAE
jumprelu blocks.28.attn.hook_z 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_498
Load this SAE
jumprelu blocks.28.attn.hook_z 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_19
Load this SAE
jumprelu blocks.28.attn.hook_z 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_32
Load this SAE
jumprelu blocks.28.attn.hook_z 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_59
Load this SAE
jumprelu blocks.28.attn.hook_z 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_115
Load this SAE
jumprelu blocks.28.attn.hook_z 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_230
Load this SAE
jumprelu blocks.28.attn.hook_z 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_452
Load this SAE
jumprelu blocks.28.attn.hook_z 28 131072 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_18
Load this SAE
jumprelu blocks.29.attn.hook_z 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_35
Load this SAE
jumprelu blocks.29.attn.hook_z 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_76
Load this SAE
jumprelu blocks.29.attn.hook_z 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_171
Load this SAE
jumprelu blocks.29.attn.hook_z 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_308
Load this SAE
jumprelu blocks.29.attn.hook_z 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_559
Load this SAE
jumprelu blocks.29.attn.hook_z 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_17
Load this SAE
jumprelu blocks.29.attn.hook_z 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_30
Load this SAE
jumprelu blocks.29.attn.hook_z 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_57
Load this SAE
jumprelu blocks.29.attn.hook_z 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_128
Load this SAE
jumprelu blocks.29.attn.hook_z 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_265
Load this SAE
jumprelu blocks.29.attn.hook_z 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_446
Load this SAE
jumprelu blocks.29.attn.hook_z 29 131072 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_23
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_44
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_102
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_221
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_435
Load this SAE
jumprelu blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_10
Load this SAE
jumprelu blocks.3.attn.hook_z 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_17
Load this SAE
jumprelu blocks.3.attn.hook_z 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_31
Load this SAE
jumprelu blocks.3.attn.hook_z 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_58
Load this SAE
jumprelu blocks.3.attn.hook_z 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_119
Load this SAE
jumprelu blocks.3.attn.hook_z 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_252
Load this SAE
jumprelu blocks.3.attn.hook_z 3 131072 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_19
Load this SAE
jumprelu blocks.30.attn.hook_z 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_36
Load this SAE
jumprelu blocks.30.attn.hook_z 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_73
Load this SAE
jumprelu blocks.30.attn.hook_z 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_157
Load this SAE
jumprelu blocks.30.attn.hook_z 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_313
Load this SAE
jumprelu blocks.30.attn.hook_z 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_558
Load this SAE
jumprelu blocks.30.attn.hook_z 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_17
Load this SAE
jumprelu blocks.30.attn.hook_z 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_29
Load this SAE
jumprelu blocks.30.attn.hook_z 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_55
Load this SAE
jumprelu blocks.30.attn.hook_z 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_109
Load this SAE
jumprelu blocks.30.attn.hook_z 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_236
Load this SAE
jumprelu blocks.30.attn.hook_z 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_491
Load this SAE
jumprelu blocks.30.attn.hook_z 30 131072 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_18
Load this SAE
jumprelu blocks.31.attn.hook_z 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_36
Load this SAE
jumprelu blocks.31.attn.hook_z 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_73
Load this SAE
jumprelu blocks.31.attn.hook_z 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_168
Load this SAE
jumprelu blocks.31.attn.hook_z 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_356
Load this SAE
jumprelu blocks.31.attn.hook_z 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_630
Load this SAE
jumprelu blocks.31.attn.hook_z 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_16
Load this SAE
jumprelu blocks.31.attn.hook_z 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_29
Load this SAE
jumprelu blocks.31.attn.hook_z 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_56
Load this SAE
jumprelu blocks.31.attn.hook_z 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_117
Load this SAE
jumprelu blocks.31.attn.hook_z 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_265
Load this SAE
jumprelu blocks.31.attn.hook_z 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_543
Load this SAE
jumprelu blocks.31.attn.hook_z 31 131072 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_18
Load this SAE
jumprelu blocks.32.attn.hook_z 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_35
Load this SAE
jumprelu blocks.32.attn.hook_z 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_74
Load this SAE
jumprelu blocks.32.attn.hook_z 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_158
Load this SAE
jumprelu blocks.32.attn.hook_z 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_306
Load this SAE
jumprelu blocks.32.attn.hook_z 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_534
Load this SAE
jumprelu blocks.32.attn.hook_z 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_16
Load this SAE
jumprelu blocks.32.attn.hook_z 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_31
Load this SAE
jumprelu blocks.32.attn.hook_z 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_56
Load this SAE
jumprelu blocks.32.attn.hook_z 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_117
Load this SAE
jumprelu blocks.32.attn.hook_z 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_248
Load this SAE
jumprelu blocks.32.attn.hook_z 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_464
Load this SAE
jumprelu blocks.32.attn.hook_z 32 131072 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_17
Load this SAE
jumprelu blocks.33.attn.hook_z 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_37
Load this SAE
jumprelu blocks.33.attn.hook_z 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_78
Load this SAE
jumprelu blocks.33.attn.hook_z 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_158
Load this SAE
jumprelu blocks.33.attn.hook_z 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_318
Load this SAE
jumprelu blocks.33.attn.hook_z 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_531
Load this SAE
jumprelu blocks.33.attn.hook_z 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_16
Load this SAE
jumprelu blocks.33.attn.hook_z 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_28
Load this SAE
jumprelu blocks.33.attn.hook_z 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_58
Load this SAE
jumprelu blocks.33.attn.hook_z 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_128
Load this SAE
jumprelu blocks.33.attn.hook_z 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_248
Load this SAE
jumprelu blocks.33.attn.hook_z 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_471
Load this SAE
jumprelu blocks.33.attn.hook_z 33 131072 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_17
Load this SAE
jumprelu blocks.34.attn.hook_z 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_38
Load this SAE
jumprelu blocks.34.attn.hook_z 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_91
Load this SAE
jumprelu blocks.34.attn.hook_z 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_192
Load this SAE
jumprelu blocks.34.attn.hook_z 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_339
Load this SAE
jumprelu blocks.34.attn.hook_z 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_527
Load this SAE
jumprelu blocks.34.attn.hook_z 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_15
Load this SAE
jumprelu blocks.34.attn.hook_z 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_29
Load this SAE
jumprelu blocks.34.attn.hook_z 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_63
Load this SAE
jumprelu blocks.34.attn.hook_z 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_199
Load this SAE
jumprelu blocks.34.attn.hook_z 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_291
Load this SAE
jumprelu blocks.34.attn.hook_z 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_483
Load this SAE
jumprelu blocks.34.attn.hook_z 34 131072 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_14
Load this SAE
jumprelu blocks.35.attn.hook_z 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_33
Load this SAE
jumprelu blocks.35.attn.hook_z 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_77
Load this SAE
jumprelu blocks.35.attn.hook_z 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_168
Load this SAE
jumprelu blocks.35.attn.hook_z 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_303
Load this SAE
jumprelu blocks.35.attn.hook_z 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_488
Load this SAE
jumprelu blocks.35.attn.hook_z 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_13
Load this SAE
jumprelu blocks.35.attn.hook_z 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_26
Load this SAE
jumprelu blocks.35.attn.hook_z 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_54
Load this SAE
jumprelu blocks.35.attn.hook_z 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_124
Load this SAE
jumprelu blocks.35.attn.hook_z 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_258
Load this SAE
jumprelu blocks.35.attn.hook_z 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_427
Load this SAE
jumprelu blocks.35.attn.hook_z 35 131072 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_15
Load this SAE
jumprelu blocks.36.attn.hook_z 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_32
Load this SAE
jumprelu blocks.36.attn.hook_z 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_69
Load this SAE
jumprelu blocks.36.attn.hook_z 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_144
Load this SAE
jumprelu blocks.36.attn.hook_z 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_293
Load this SAE
jumprelu blocks.36.attn.hook_z 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_544
Load this SAE
jumprelu blocks.36.attn.hook_z 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_16
Load this SAE
jumprelu blocks.36.attn.hook_z 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_26
Load this SAE
jumprelu blocks.36.attn.hook_z 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_51
Load this SAE
jumprelu blocks.36.attn.hook_z 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_105
Load this SAE
jumprelu blocks.36.attn.hook_z 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_229
Load this SAE
jumprelu blocks.36.attn.hook_z 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_455
Load this SAE
jumprelu blocks.36.attn.hook_z 36 131072 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_17
Load this SAE
jumprelu blocks.37.attn.hook_z 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_34
Load this SAE
jumprelu blocks.37.attn.hook_z 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_82
Load this SAE
jumprelu blocks.37.attn.hook_z 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_172
Load this SAE
jumprelu blocks.37.attn.hook_z 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_309
Load this SAE
jumprelu blocks.37.attn.hook_z 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_519
Load this SAE
jumprelu blocks.37.attn.hook_z 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_15
Load this SAE
jumprelu blocks.37.attn.hook_z 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_28
Load this SAE
jumprelu blocks.37.attn.hook_z 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_55
Load this SAE
jumprelu blocks.37.attn.hook_z 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_124
Load this SAE
jumprelu blocks.37.attn.hook_z 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_248
Load this SAE
jumprelu blocks.37.attn.hook_z 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_450
Load this SAE
jumprelu blocks.37.attn.hook_z 37 131072 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_18
Load this SAE
jumprelu blocks.38.attn.hook_z 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_36
Load this SAE
jumprelu blocks.38.attn.hook_z 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_81
Load this SAE
jumprelu blocks.38.attn.hook_z 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_175
Load this SAE
jumprelu blocks.38.attn.hook_z 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_334
Load this SAE
jumprelu blocks.38.attn.hook_z 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_547
Load this SAE
jumprelu blocks.38.attn.hook_z 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_17
Load this SAE
jumprelu blocks.38.attn.hook_z 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_30
Load this SAE
jumprelu blocks.38.attn.hook_z 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_60
Load this SAE
jumprelu blocks.38.attn.hook_z 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_135
Load this SAE
jumprelu blocks.38.attn.hook_z 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_284
Load this SAE
jumprelu blocks.38.attn.hook_z 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_489
Load this SAE
jumprelu blocks.38.attn.hook_z 38 131072 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_15
Load this SAE
jumprelu blocks.39.attn.hook_z 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_33
Load this SAE
jumprelu blocks.39.attn.hook_z 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_77
Load this SAE
jumprelu blocks.39.attn.hook_z 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_176
Load this SAE
jumprelu blocks.39.attn.hook_z 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_391
Load this SAE
jumprelu blocks.39.attn.hook_z 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_694
Load this SAE
jumprelu blocks.39.attn.hook_z 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_17
Load this SAE
jumprelu blocks.39.attn.hook_z 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_27
Load this SAE
jumprelu blocks.39.attn.hook_z 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_54
Load this SAE
jumprelu blocks.39.attn.hook_z 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_120
Load this SAE
jumprelu blocks.39.attn.hook_z 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_273
Load this SAE
jumprelu blocks.39.attn.hook_z 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_604
Load this SAE
jumprelu blocks.39.attn.hook_z 39 131072 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_26
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_54
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_126
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_274
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_524
Load this SAE
jumprelu blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_12
Load this SAE
jumprelu blocks.4.attn.hook_z 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_21
Load this SAE
jumprelu blocks.4.attn.hook_z 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_38
Load this SAE
jumprelu blocks.4.attn.hook_z 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_75
Load this SAE
jumprelu blocks.4.attn.hook_z 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_163
Load this SAE
jumprelu blocks.4.attn.hook_z 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_330
Load this SAE
jumprelu blocks.4.attn.hook_z 4 131072 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_18
Load this SAE
jumprelu blocks.40.attn.hook_z 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_38
Load this SAE
jumprelu blocks.40.attn.hook_z 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_91
Load this SAE
jumprelu blocks.40.attn.hook_z 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_189
Load this SAE
jumprelu blocks.40.attn.hook_z 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_341
Load this SAE
jumprelu blocks.40.attn.hook_z 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_603
Load this SAE
jumprelu blocks.40.attn.hook_z 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_16
Load this SAE
jumprelu blocks.40.attn.hook_z 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_30
Load this SAE
jumprelu blocks.40.attn.hook_z 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_64
Load this SAE
jumprelu blocks.40.attn.hook_z 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_144
Load this SAE
jumprelu blocks.40.attn.hook_z 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_269
Load this SAE
jumprelu blocks.40.attn.hook_z 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_493
Load this SAE
jumprelu blocks.40.attn.hook_z 40 131072 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_13
Load this SAE
jumprelu blocks.41.attn.hook_z 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_25
Load this SAE
jumprelu blocks.41.attn.hook_z 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_56
Load this SAE
jumprelu blocks.41.attn.hook_z 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_129
Load this SAE
jumprelu blocks.41.attn.hook_z 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_254
Load this SAE
jumprelu blocks.41.attn.hook_z 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_450
Load this SAE
jumprelu blocks.41.attn.hook_z 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_13
Load this SAE
jumprelu blocks.41.attn.hook_z 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_22
Load this SAE
jumprelu blocks.41.attn.hook_z 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_43
Load this SAE
jumprelu blocks.41.attn.hook_z 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_92
Load this SAE
jumprelu blocks.41.attn.hook_z 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_202
Load this SAE
jumprelu blocks.41.attn.hook_z 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_370
Load this SAE
jumprelu blocks.41.attn.hook_z 41 131072 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_25
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_53
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_125
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_270
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_529
Load this SAE
jumprelu blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_12
Load this SAE
jumprelu blocks.5.attn.hook_z 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_21
Load this SAE
jumprelu blocks.5.attn.hook_z 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_39
Load this SAE
jumprelu blocks.5.attn.hook_z 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_78
Load this SAE
jumprelu blocks.5.attn.hook_z 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_160
Load this SAE
jumprelu blocks.5.attn.hook_z 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_351
Load this SAE
jumprelu blocks.5.attn.hook_z 5 131072 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_16
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_28
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_51
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_108
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_258
Load this SAE
jumprelu blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_14
Load this SAE
jumprelu blocks.6.attn.hook_z 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_24
Load this SAE
jumprelu blocks.6.attn.hook_z 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_41
Load this SAE
jumprelu blocks.6.attn.hook_z 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_73
Load this SAE
jumprelu blocks.6.attn.hook_z 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_148
Load this SAE
jumprelu blocks.6.attn.hook_z 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_353
Load this SAE
jumprelu blocks.6.attn.hook_z 6 131072 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_18
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_33
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_70
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_160
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_335
Load this SAE
jumprelu blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_16
Load this SAE
jumprelu blocks.7.attn.hook_z 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_28
Load this SAE
jumprelu blocks.7.attn.hook_z 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_52
Load this SAE
jumprelu blocks.7.attn.hook_z 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_106
Load this SAE
jumprelu blocks.7.attn.hook_z 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_229
Load this SAE
jumprelu blocks.7.attn.hook_z 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_473
Load this SAE
jumprelu blocks.7.attn.hook_z 7 131072 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_17
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_32
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_65
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_150
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_362
Load this SAE
jumprelu blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_16
Load this SAE
jumprelu blocks.8.attn.hook_z 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_27
Load this SAE
jumprelu blocks.8.attn.hook_z 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_51
Load this SAE
jumprelu blocks.8.attn.hook_z 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_98
Load this SAE
jumprelu blocks.8.attn.hook_z 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_222
Load this SAE
jumprelu blocks.8.attn.hook_z 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_531
Load this SAE
jumprelu blocks.8.attn.hook_z 8 131072 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_18
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_34
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_71
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_172
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_349
Load this SAE
jumprelu blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_16
Load this SAE
jumprelu blocks.9.attn.hook_z 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_30
Load this SAE
jumprelu blocks.9.attn.hook_z 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_54
Load this SAE
jumprelu blocks.9.attn.hook_z 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_111
Load this SAE
jumprelu blocks.9.attn.hook_z 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_263
Load this SAE
jumprelu blocks.9.attn.hook_z 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_511
Load this SAE
jumprelu blocks.9.attn.hook_z 9 131072 1024 monology/pile-uncopyrighted

gemma-scope-9b-pt-att-canonical

  • Huggingface Repo: google/gemma-scope-9b-pt-att
  • model: gemma-2-9b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-att-16k blocks.0.attn.hook_z 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-att-16k blocks.1.attn.hook_z 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-att-16k blocks.2.attn.hook_z 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-att-16k blocks.3.attn.hook_z 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-att-16k blocks.4.attn.hook_z 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-att-16k blocks.5.attn.hook_z 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-att-16k blocks.6.attn.hook_z 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-att-16k blocks.7.attn.hook_z 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-att-16k blocks.8.attn.hook_z 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-att-16k blocks.9.attn.hook_z 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-att-16k blocks.10.attn.hook_z 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-att-16k blocks.11.attn.hook_z 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-att-16k blocks.12.attn.hook_z 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-att-16k blocks.13.attn.hook_z 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-att-16k blocks.14.attn.hook_z 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-att-16k blocks.15.attn.hook_z 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-att-16k blocks.16.attn.hook_z 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-att-16k blocks.17.attn.hook_z 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-att-16k blocks.18.attn.hook_z 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-att-16k blocks.19.attn.hook_z 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-att-16k blocks.20.attn.hook_z 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-att-16k blocks.21.attn.hook_z 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-att-16k blocks.22.attn.hook_z 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-att-16k blocks.23.attn.hook_z 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-att-16k blocks.24.attn.hook_z 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-att-16k blocks.25.attn.hook_z 25 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-att-16k blocks.26.attn.hook_z 26 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-att-16k blocks.27.attn.hook_z 27 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-att-16k blocks.28.attn.hook_z 28 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-att-16k blocks.29.attn.hook_z 29 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-att-16k blocks.30.attn.hook_z 30 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-att-16k blocks.31.attn.hook_z 31 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-att-16k blocks.32.attn.hook_z 32 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-att-16k blocks.33.attn.hook_z 33 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-att-16k blocks.34.attn.hook_z 34 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-att-16k blocks.35.attn.hook_z 35 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-att-16k blocks.36.attn.hook_z 36 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-att-16k blocks.37.attn.hook_z 37 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-att-16k blocks.38.attn.hook_z 38 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-att-16k blocks.39.attn.hook_z 39 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-att-16k blocks.40.attn.hook_z 40 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-att-16k blocks.41.attn.hook_z 41 16384 1024 monology/pile-uncopyrighted
layer_0/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-att-131k blocks.0.attn.hook_z 0 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-att-131k blocks.1.attn.hook_z 1 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-att-131k blocks.2.attn.hook_z 2 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-att-131k blocks.3.attn.hook_z 3 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-att-131k blocks.4.attn.hook_z 4 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-att-131k blocks.5.attn.hook_z 5 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-att-131k blocks.6.attn.hook_z 6 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-att-131k blocks.7.attn.hook_z 7 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-att-131k blocks.8.attn.hook_z 8 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-att-131k blocks.9.attn.hook_z 9 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-att-131k blocks.10.attn.hook_z 10 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-att-131k blocks.11.attn.hook_z 11 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-att-131k blocks.12.attn.hook_z 12 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-att-131k blocks.13.attn.hook_z 13 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-att-131k blocks.14.attn.hook_z 14 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-att-131k blocks.15.attn.hook_z 15 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-att-131k blocks.16.attn.hook_z 16 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-att-131k blocks.17.attn.hook_z 17 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-att-131k blocks.18.attn.hook_z 18 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-att-131k blocks.19.attn.hook_z 19 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-att-131k blocks.20.attn.hook_z 20 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-att-131k blocks.21.attn.hook_z 21 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-att-131k blocks.22.attn.hook_z 22 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-att-131k blocks.23.attn.hook_z 23 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-att-131k blocks.24.attn.hook_z 24 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-att-131k blocks.25.attn.hook_z 25 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-att-131k blocks.26.attn.hook_z 26 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-att-131k blocks.27.attn.hook_z 27 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-att-131k blocks.28.attn.hook_z 28 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-att-131k blocks.29.attn.hook_z 29 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-att-131k blocks.30.attn.hook_z 30 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-att-131k blocks.31.attn.hook_z 31 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-att-131k blocks.32.attn.hook_z 32 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-att-131k blocks.33.attn.hook_z 33 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-att-131k blocks.34.attn.hook_z 34 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-att-131k blocks.35.attn.hook_z 35 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-att-131k blocks.36.attn.hook_z 36 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-att-131k blocks.37.attn.hook_z 37 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-att-131k blocks.38.attn.hook_z 38 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-att-131k blocks.39.attn.hook_z 39 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-att-131k blocks.40.attn.hook_z 40 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-att-131k blocks.41.attn.hook_z 41 131072 1024 monology/pile-uncopyrighted

gemma-scope-9b-pt-mlp

  • Huggingface Repo: google/gemma-scope-9b-pt-mlp
  • model: gemma-2-9b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/average_l0_6
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_10
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_16
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_28
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_16k/average_l0_50
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-mlp-16k-l0_32plus blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_3
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_5
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_7
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_11
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_18
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 131072 1024 monology/pile-uncopyrighted
layer_0/width_131k/average_l0_30
Load this SAE
jumprelu blocks.0.hook_mlp_out 0 131072 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_12
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_26
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_56
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-mlp-16k-l0_32plus blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_128
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/average_l0_278
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_6
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_10
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_18
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_32
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_59
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/average_l0_106
Load this SAE
jumprelu blocks.1.hook_mlp_out 1 131072 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_13
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_24
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_49
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-mlp-16k-l0_32plus blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_114
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/average_l0_276
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_12
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_22
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_42
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_83
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_167
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_362
Load this SAE
jumprelu blocks.10.hook_mlp_out 10 131072 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_17
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-mlp-16k-l0_32plus blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_76
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_180
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/average_l0_421
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_17
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_31
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_60
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_120
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_259
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/average_l0_569
Load this SAE
jumprelu blocks.11.hook_mlp_out 11 131072 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_20
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_42
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-mlp-16k-l0_32plus blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_96
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_237
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_543
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/average_l0_1033
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_19
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_38
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_77
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_159
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_338
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/average_l0_745
Load this SAE
jumprelu blocks.12.hook_mlp_out 12 131072 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_19
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_40
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-mlp-16k-l0_32plus blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_94
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_225
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_512
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/average_l0_992
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_20
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_38
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_75
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_160
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_351
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/average_l0_703
Load this SAE
jumprelu blocks.13.hook_mlp_out 13 131072 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_19
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_41
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-mlp-16k-l0_32plus blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_97
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_236
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_538
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/average_l0_1023
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_20
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_40
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_80
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_174
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_374
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/average_l0_743
Load this SAE
jumprelu blocks.14.hook_mlp_out 14 131072 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_20
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_45
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-mlp-16k-l0_32plus blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_107
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_260
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_572
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/average_l0_1053
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_21
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_43
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_89
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_194
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_421
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/average_l0_828
Load this SAE
jumprelu blocks.15.hook_mlp_out 15 131072 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_16
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-mlp-16k-l0_32plus blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_91
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_221
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_489
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/average_l0_916
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_17
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_38
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_81
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_175
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_384
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/average_l0_744
Load this SAE
jumprelu blocks.16.hook_mlp_out 16 131072 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_18
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_41
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-mlp-16k-l0_32plus blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_104
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_274
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_624
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/average_l0_1137
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_22
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_43
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_91
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_207
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_483
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/average_l0_950
Load this SAE
jumprelu blocks.17.hook_mlp_out 17 131072 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_16
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_36
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-mlp-16k-l0_32plus blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_89
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_235
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_564
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/average_l0_1052
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_19
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_37
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_82
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_174
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_420
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/average_l0_865
Load this SAE
jumprelu blocks.18.hook_mlp_out 18 131072 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_16
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_38
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-mlp-16k-l0_32plus blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_98
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_255
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_599
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/average_l0_1097
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_19
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_40
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_85
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_189
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_440
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/average_l0_899
Load this SAE
jumprelu blocks.19.hook_mlp_out 19 131072 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_8
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_16
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_33
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-mlp-16k-l0_32plus blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_81
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/average_l0_163
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_4
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_7
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_12
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_20
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_35
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/average_l0_61
Load this SAE
jumprelu blocks.2.hook_mlp_out 2 131072 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_17
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_41
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-mlp-16k-l0_32plus blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_108
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_284
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_643
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_1127
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_20
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_41
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_93
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_212
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_477
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_992
Load this SAE
jumprelu blocks.20.hook_mlp_out 20 131072 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_15
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-mlp-16k-l0_32plus blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_88
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_241
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_571
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/average_l0_1063
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_16
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_35
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_79
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_179
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_417
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/average_l0_884
Load this SAE
jumprelu blocks.21.hook_mlp_out 21 131072 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_15
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_34
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-mlp-16k-l0_32plus blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_85
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_226
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_566
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/average_l0_1065
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_17
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_35
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_77
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_172
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_404
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_861
Load this SAE
jumprelu blocks.22.hook_mlp_out 22 131072 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_15
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_31
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_73
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-mlp-16k-l0_32plus blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_190
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_492
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/average_l0_990
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_17
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_32
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_67
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_146
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_354
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/average_l0_754
Load this SAE
jumprelu blocks.23.hook_mlp_out 23 131072 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_15
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_32
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-mlp-16k-l0_32plus blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_73
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_192
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_494
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/average_l0_999
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_17
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_33
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_67
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_147
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_351
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/average_l0_709
Load this SAE
jumprelu blocks.24.hook_mlp_out 24 131072 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_15
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_31
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_72
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-mlp-16k-l0_32plus blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_184
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_494
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/average_l0_1013
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_16
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_32
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_65
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_139
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_326
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/average_l0_691
Load this SAE
jumprelu blocks.25.hook_mlp_out 25 131072 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_14
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_26
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_57
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-mlp-16k-l0_32plus blocks.26.hook_mlp_out 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_142
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_394
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/average_l0_887
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 16384 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_14
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_27
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_53
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_110
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_249
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/average_l0_568
Load this SAE
jumprelu blocks.26.hook_mlp_out 26 131072 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_14
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_25
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_52
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-mlp-16k-l0_32plus blocks.27.hook_mlp_out 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_126
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_352
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/average_l0_813
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 16384 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_14
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_26
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_49
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_99
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_211
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/average_l0_487
Load this SAE
jumprelu blocks.27.hook_mlp_out 27 131072 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_14
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_26
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_50
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-mlp-16k-l0_32plus blocks.28.hook_mlp_out 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_115
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_324
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/average_l0_773
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 16384 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_15
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_26
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_47
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_91
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_189
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/average_l0_425
Load this SAE
jumprelu blocks.28.hook_mlp_out 28 131072 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_15
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_26
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_49
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-mlp-16k-l0_32plus blocks.29.hook_mlp_out 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_111
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_311
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/average_l0_725
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 16384 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_15
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_26
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_47
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_87
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_174
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/average_l0_386
Load this SAE
jumprelu blocks.29.hook_mlp_out 29 131072 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_13
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_25
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_55
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-mlp-16k-l0_32plus blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_126
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/average_l0_234
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_6
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_11
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_19
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_33
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_58
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/average_l0_109
Load this SAE
jumprelu blocks.3.hook_mlp_out 3 131072 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_14
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_26
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_51
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-mlp-16k-l0_32plus blocks.30.hook_mlp_out 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_116
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_333
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/average_l0_806
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 16384 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_14
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_26
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_47
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_89
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_179
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/average_l0_391
Load this SAE
jumprelu blocks.30.hook_mlp_out 30 131072 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_12
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_22
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_43
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-mlp-16k-l0_32plus blocks.31.hook_mlp_out 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_94
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_263
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_671
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_12
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_22
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_40
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_77
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_153
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_326
Load this SAE
jumprelu blocks.31.hook_mlp_out 31 131072 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_11
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_21
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_44
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-mlp-16k-l0_32plus blocks.32.hook_mlp_out 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_98
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_267
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/average_l0_623
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 16384 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_12
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_21
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_40
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_76
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_155
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/average_l0_336
Load this SAE
jumprelu blocks.32.hook_mlp_out 32 131072 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_12
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_23
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_48
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-mlp-16k-l0_32plus blocks.33.hook_mlp_out 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_107
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_282
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/average_l0_628
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 16384 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_12
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_22
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_42
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_83
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_168
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/average_l0_394
Load this SAE
jumprelu blocks.33.hook_mlp_out 33 131072 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_11
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_22
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_47
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-mlp-16k-l0_32plus blocks.34.hook_mlp_out 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_107
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_268
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/average_l0_559
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 16384 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_10
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_20
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_40
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_82
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_167
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_390
Load this SAE
jumprelu blocks.34.hook_mlp_out 34 131072 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_10
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_21
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_46
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-mlp-16k-l0_32plus blocks.35.hook_mlp_out 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_108
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_254
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/average_l0_538
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 16384 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_10
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_19
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_39
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_80
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_176
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/average_l0_389
Load this SAE
jumprelu blocks.35.hook_mlp_out 35 131072 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_11
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_22
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_47
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-mlp-16k-l0_32plus blocks.36.hook_mlp_out 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_109
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_256
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/average_l0_523
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 16384 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_11
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_20
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_40
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_81
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_174
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/average_l0_389
Load this SAE
jumprelu blocks.36.hook_mlp_out 36 131072 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_12
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_24
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_53
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-mlp-16k-l0_32plus blocks.37.hook_mlp_out 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_119
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_267
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/average_l0_549
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 16384 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_12
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_23
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_44
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_90
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_203
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/average_l0_403
Load this SAE
jumprelu blocks.37.hook_mlp_out 37 131072 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_11
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_22
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_45
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-mlp-16k-l0_32plus blocks.38.hook_mlp_out 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_98
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_225
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/average_l0_491
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 16384 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_11
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_21
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_40
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_79
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_161
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/average_l0_347
Load this SAE
jumprelu blocks.38.hook_mlp_out 38 131072 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_12
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_22
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_43
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-mlp-16k-l0_32plus blocks.39.hook_mlp_out 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_90
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_207
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/average_l0_458
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 16384 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_11
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_21
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_38
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_75
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_150
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/average_l0_319
Load this SAE
jumprelu blocks.39.hook_mlp_out 39 131072 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_15
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_30
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_66
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-mlp-16k-l0_32plus blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_151
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/average_l0_343
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_8
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_14
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_24
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_45
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_84
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/average_l0_157
Load this SAE
jumprelu blocks.4.hook_mlp_out 4 131072 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_11
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_19
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_37
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-mlp-16k-l0_32plus blocks.40.hook_mlp_out 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_74
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_162
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/average_l0_371
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 16384 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_11
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_18
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_33
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_63
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_125
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/average_l0_267
Load this SAE
jumprelu blocks.40.hook_mlp_out 40 131072 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_8
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_15
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_28
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_58
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-mlp-16k-l0_32plus blocks.41.hook_mlp_out 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_126
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/average_l0_288
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 16384 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_8
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_14
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_25
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_49
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_99
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/average_l0_208
Load this SAE
jumprelu blocks.41.hook_mlp_out 41 131072 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_14
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_24
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_46
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-mlp-16k-l0_32plus blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_93
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/average_l0_194
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_7
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_12
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_21
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_37
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_68
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/average_l0_131
Load this SAE
jumprelu blocks.5.hook_mlp_out 5 131072 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_12
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_23
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_46
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-mlp-16k-l0_32plus blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_96
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/average_l0_206
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_12
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_22
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_40
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_72
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_135
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/average_l0_271
Load this SAE
jumprelu blocks.6.hook_mlp_out 6 131072 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_14
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_25
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_47
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-mlp-16k-l0_32plus blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_101
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/average_l0_231
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_13
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_23
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_41
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_75
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_143
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/average_l0_309
Load this SAE
jumprelu blocks.7.hook_mlp_out 7 131072 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_15
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_27
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_55
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-mlp-16k-l0_32plus blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_124
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/average_l0_309
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_15
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_26
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_48
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_89
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_184
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/average_l0_423
Load this SAE
jumprelu blocks.8.hook_mlp_out 8 131072 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_12
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_21
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_40
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_83
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-mlp-16k-l0_32plus blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_200
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_12
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_21
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_38
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_67
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_129
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_269
Load this SAE
jumprelu blocks.9.hook_mlp_out 9 131072 1024 monology/pile-uncopyrighted

gemma-scope-9b-pt-mlp-canonical

  • Huggingface Repo: google/gemma-scope-9b-pt-mlp
  • model: gemma-2-9b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_0/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-mlp-16k blocks.0.hook_mlp_out 0 16384 1024 monology/pile-uncopyrighted
layer_1/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-mlp-16k blocks.1.hook_mlp_out 1 16384 1024 monology/pile-uncopyrighted
layer_2/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-mlp-16k blocks.2.hook_mlp_out 2 16384 1024 monology/pile-uncopyrighted
layer_3/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-mlp-16k blocks.3.hook_mlp_out 3 16384 1024 monology/pile-uncopyrighted
layer_4/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-mlp-16k blocks.4.hook_mlp_out 4 16384 1024 monology/pile-uncopyrighted
layer_5/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-mlp-16k blocks.5.hook_mlp_out 5 16384 1024 monology/pile-uncopyrighted
layer_6/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-mlp-16k blocks.6.hook_mlp_out 6 16384 1024 monology/pile-uncopyrighted
layer_7/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-mlp-16k blocks.7.hook_mlp_out 7 16384 1024 monology/pile-uncopyrighted
layer_8/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-mlp-16k blocks.8.hook_mlp_out 8 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-mlp-16k blocks.9.hook_mlp_out 9 16384 1024 monology/pile-uncopyrighted
layer_10/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-mlp-16k blocks.10.hook_mlp_out 10 16384 1024 monology/pile-uncopyrighted
layer_11/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-mlp-16k blocks.11.hook_mlp_out 11 16384 1024 monology/pile-uncopyrighted
layer_12/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-mlp-16k blocks.12.hook_mlp_out 12 16384 1024 monology/pile-uncopyrighted
layer_13/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-mlp-16k blocks.13.hook_mlp_out 13 16384 1024 monology/pile-uncopyrighted
layer_14/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-mlp-16k blocks.14.hook_mlp_out 14 16384 1024 monology/pile-uncopyrighted
layer_15/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-mlp-16k blocks.15.hook_mlp_out 15 16384 1024 monology/pile-uncopyrighted
layer_16/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-mlp-16k blocks.16.hook_mlp_out 16 16384 1024 monology/pile-uncopyrighted
layer_17/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-mlp-16k blocks.17.hook_mlp_out 17 16384 1024 monology/pile-uncopyrighted
layer_18/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-mlp-16k blocks.18.hook_mlp_out 18 16384 1024 monology/pile-uncopyrighted
layer_19/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-mlp-16k blocks.19.hook_mlp_out 19 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-mlp-16k blocks.20.hook_mlp_out 20 16384 1024 monology/pile-uncopyrighted
layer_21/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-mlp-16k blocks.21.hook_mlp_out 21 16384 1024 monology/pile-uncopyrighted
layer_22/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-mlp-16k blocks.22.hook_mlp_out 22 16384 1024 monology/pile-uncopyrighted
layer_23/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-mlp-16k blocks.23.hook_mlp_out 23 16384 1024 monology/pile-uncopyrighted
layer_24/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-mlp-16k blocks.24.hook_mlp_out 24 16384 1024 monology/pile-uncopyrighted
layer_25/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-mlp-16k blocks.25.hook_mlp_out 25 16384 1024 monology/pile-uncopyrighted
layer_26/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-mlp-16k blocks.26.hook_mlp_out 26 16384 1024 monology/pile-uncopyrighted
layer_27/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-mlp-16k blocks.27.hook_mlp_out 27 16384 1024 monology/pile-uncopyrighted
layer_28/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-mlp-16k blocks.28.hook_mlp_out 28 16384 1024 monology/pile-uncopyrighted
layer_29/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-mlp-16k blocks.29.hook_mlp_out 29 16384 1024 monology/pile-uncopyrighted
layer_30/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-mlp-16k blocks.30.hook_mlp_out 30 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-mlp-16k blocks.31.hook_mlp_out 31 16384 1024 monology/pile-uncopyrighted
layer_32/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-mlp-16k blocks.32.hook_mlp_out 32 16384 1024 monology/pile-uncopyrighted
layer_33/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-mlp-16k blocks.33.hook_mlp_out 33 16384 1024 monology/pile-uncopyrighted
layer_34/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-mlp-16k blocks.34.hook_mlp_out 34 16384 1024 monology/pile-uncopyrighted
layer_35/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-mlp-16k blocks.35.hook_mlp_out 35 16384 1024 monology/pile-uncopyrighted
layer_36/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-mlp-16k blocks.36.hook_mlp_out 36 16384 1024 monology/pile-uncopyrighted
layer_37/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-mlp-16k blocks.37.hook_mlp_out 37 16384 1024 monology/pile-uncopyrighted
layer_38/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-mlp-16k blocks.38.hook_mlp_out 38 16384 1024 monology/pile-uncopyrighted
layer_39/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-mlp-16k blocks.39.hook_mlp_out 39 16384 1024 monology/pile-uncopyrighted
layer_40/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-mlp-16k blocks.40.hook_mlp_out 40 16384 1024 monology/pile-uncopyrighted
layer_41/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-mlp-16k blocks.41.hook_mlp_out 41 16384 1024 monology/pile-uncopyrighted
layer_0/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/0-gemmascope-mlp-131k blocks.0.hook_mlp_out 0 131072 1024 monology/pile-uncopyrighted
layer_1/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/1-gemmascope-mlp-131k blocks.1.hook_mlp_out 1 131072 1024 monology/pile-uncopyrighted
layer_2/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/2-gemmascope-mlp-131k blocks.2.hook_mlp_out 2 131072 1024 monology/pile-uncopyrighted
layer_3/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/3-gemmascope-mlp-131k blocks.3.hook_mlp_out 3 131072 1024 monology/pile-uncopyrighted
layer_4/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/4-gemmascope-mlp-131k blocks.4.hook_mlp_out 4 131072 1024 monology/pile-uncopyrighted
layer_5/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/5-gemmascope-mlp-131k blocks.5.hook_mlp_out 5 131072 1024 monology/pile-uncopyrighted
layer_6/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/6-gemmascope-mlp-131k blocks.6.hook_mlp_out 6 131072 1024 monology/pile-uncopyrighted
layer_7/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/7-gemmascope-mlp-131k blocks.7.hook_mlp_out 7 131072 1024 monology/pile-uncopyrighted
layer_8/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/8-gemmascope-mlp-131k blocks.8.hook_mlp_out 8 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/9-gemmascope-mlp-131k blocks.9.hook_mlp_out 9 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/10-gemmascope-mlp-131k blocks.10.hook_mlp_out 10 131072 1024 monology/pile-uncopyrighted
layer_11/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/11-gemmascope-mlp-131k blocks.11.hook_mlp_out 11 131072 1024 monology/pile-uncopyrighted
layer_12/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/12-gemmascope-mlp-131k blocks.12.hook_mlp_out 12 131072 1024 monology/pile-uncopyrighted
layer_13/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/13-gemmascope-mlp-131k blocks.13.hook_mlp_out 13 131072 1024 monology/pile-uncopyrighted
layer_14/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/14-gemmascope-mlp-131k blocks.14.hook_mlp_out 14 131072 1024 monology/pile-uncopyrighted
layer_15/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/15-gemmascope-mlp-131k blocks.15.hook_mlp_out 15 131072 1024 monology/pile-uncopyrighted
layer_16/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/16-gemmascope-mlp-131k blocks.16.hook_mlp_out 16 131072 1024 monology/pile-uncopyrighted
layer_17/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/17-gemmascope-mlp-131k blocks.17.hook_mlp_out 17 131072 1024 monology/pile-uncopyrighted
layer_18/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/18-gemmascope-mlp-131k blocks.18.hook_mlp_out 18 131072 1024 monology/pile-uncopyrighted
layer_19/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/19-gemmascope-mlp-131k blocks.19.hook_mlp_out 19 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/20-gemmascope-mlp-131k blocks.20.hook_mlp_out 20 131072 1024 monology/pile-uncopyrighted
layer_21/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/21-gemmascope-mlp-131k blocks.21.hook_mlp_out 21 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/22-gemmascope-mlp-131k blocks.22.hook_mlp_out 22 131072 1024 monology/pile-uncopyrighted
layer_23/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/23-gemmascope-mlp-131k blocks.23.hook_mlp_out 23 131072 1024 monology/pile-uncopyrighted
layer_24/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/24-gemmascope-mlp-131k blocks.24.hook_mlp_out 24 131072 1024 monology/pile-uncopyrighted
layer_25/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/25-gemmascope-mlp-131k blocks.25.hook_mlp_out 25 131072 1024 monology/pile-uncopyrighted
layer_26/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/26-gemmascope-mlp-131k blocks.26.hook_mlp_out 26 131072 1024 monology/pile-uncopyrighted
layer_27/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/27-gemmascope-mlp-131k blocks.27.hook_mlp_out 27 131072 1024 monology/pile-uncopyrighted
layer_28/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/28-gemmascope-mlp-131k blocks.28.hook_mlp_out 28 131072 1024 monology/pile-uncopyrighted
layer_29/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/29-gemmascope-mlp-131k blocks.29.hook_mlp_out 29 131072 1024 monology/pile-uncopyrighted
layer_30/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/30-gemmascope-mlp-131k blocks.30.hook_mlp_out 30 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/31-gemmascope-mlp-131k blocks.31.hook_mlp_out 31 131072 1024 monology/pile-uncopyrighted
layer_32/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/32-gemmascope-mlp-131k blocks.32.hook_mlp_out 32 131072 1024 monology/pile-uncopyrighted
layer_33/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/33-gemmascope-mlp-131k blocks.33.hook_mlp_out 33 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/34-gemmascope-mlp-131k blocks.34.hook_mlp_out 34 131072 1024 monology/pile-uncopyrighted
layer_35/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/35-gemmascope-mlp-131k blocks.35.hook_mlp_out 35 131072 1024 monology/pile-uncopyrighted
layer_36/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/36-gemmascope-mlp-131k blocks.36.hook_mlp_out 36 131072 1024 monology/pile-uncopyrighted
layer_37/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/37-gemmascope-mlp-131k blocks.37.hook_mlp_out 37 131072 1024 monology/pile-uncopyrighted
layer_38/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/38-gemmascope-mlp-131k blocks.38.hook_mlp_out 38 131072 1024 monology/pile-uncopyrighted
layer_39/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/39-gemmascope-mlp-131k blocks.39.hook_mlp_out 39 131072 1024 monology/pile-uncopyrighted
layer_40/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/40-gemmascope-mlp-131k blocks.40.hook_mlp_out 40 131072 1024 monology/pile-uncopyrighted
layer_41/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b/41-gemmascope-mlp-131k blocks.41.hook_mlp_out 41 131072 1024 monology/pile-uncopyrighted

gemma-scope-9b-it-res

  • Huggingface Repo: google/gemma-scope-9b-it-res
  • model: gemma-2-9b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_20/width_131k/average_l0_13
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_153
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_24
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_43
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/average_l0_81
Load this SAE
jumprelu blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_14
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_189
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_25
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_47
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/average_l0_91
Load this SAE
jumprelu blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_109
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_13
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_22
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_37
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/average_l0_63
Load this SAE
jumprelu blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_14
Load this SAE
jumprelu blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_142
Load this SAE
jumprelu blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_24
Load this SAE
jumprelu blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_43
Load this SAE
jumprelu blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/average_l0_76
Load this SAE
jumprelu blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_121
Load this SAE
jumprelu blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_13
Load this SAE
jumprelu blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_22
Load this SAE
jumprelu blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_39
Load this SAE
jumprelu blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_131k/average_l0_67
Load this SAE
jumprelu blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_14
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_186
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_26
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_47
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_9/width_16k/average_l0_88
Load this SAE
jumprelu blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted

gemma-scope-9b-it-res-canonical

  • Huggingface Repo: google/gemma-scope-9b-it-res
  • model: gemma-2-9b-it
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_9/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b-it/9-gemmascope-res-16k blocks.9.hook_resid_post 9 16384 1024 monology/pile-uncopyrighted
layer_20/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b-it/20-gemmascope-res-16k blocks.20.hook_resid_post 20 16384 1024 monology/pile-uncopyrighted
layer_31/width_16k/canonical
Load this SAE
jumprelu gemma-2-9b-it/31-gemmascope-res-16k blocks.31.hook_resid_post 31 16384 1024 monology/pile-uncopyrighted
layer_9/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b-it/9-gemmascope-res-131k blocks.9.hook_resid_post 9 131072 1024 monology/pile-uncopyrighted
layer_20/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b-it/20-gemmascope-res-131k blocks.20.hook_resid_post 20 131072 1024 monology/pile-uncopyrighted
layer_31/width_131k/canonical
Load this SAE
jumprelu gemma-2-9b-it/31-gemmascope-res-131k blocks.31.hook_resid_post 31 131072 1024 monology/pile-uncopyrighted

gemma-scope-27b-pt-res

  • Huggingface Repo: google/gemma-scope-27b-pt-res
  • model: gemma-2-27b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_10/width_131k/average_l0_106
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_15
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_200
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_24
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_37
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_10/width_131k/average_l0_64
Load this SAE
jumprelu blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_150
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_20
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_290
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_31
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_48
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/average_l0_82
Load this SAE
jumprelu blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_155
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_21
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_333
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_38
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_72
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/average_l0_785
Load this SAE
jumprelu blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted

gemma-scope-27b-pt-res-canonical

  • Huggingface Repo: google/gemma-scope-27b-pt-res
  • model: gemma-2-27b
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
layer_10/width_131k/canonical
Load this SAE
jumprelu gemma-2-27b/10-gemmascope-res-131k blocks.10.hook_resid_post 10 131072 1024 monology/pile-uncopyrighted
layer_22/width_131k/canonical
Load this SAE
jumprelu gemma-2-27b/22-gemmascope-res-131k blocks.22.hook_resid_post 22 131072 1024 monology/pile-uncopyrighted
layer_34/width_131k/canonical
Load this SAE
jumprelu gemma-2-27b/34-gemmascope-res-131k blocks.34.hook_resid_post 34 131072 1024 monology/pile-uncopyrighted

pythia-70m-deduped-res-sm

  • Huggingface Repo: ctigges/pythia-70m-deduped__res-sm_processed
  • model: pythia-70m-deduped
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_resid_pre
Load this SAE
standard pythia-70m-deduped/e-att-sm blocks.0.hook_resid_pre 0 32768 128 EleutherAI/the_pile_deduplicated none
blocks.0.hook_resid_post
Load this SAE
standard pythia-70m-deduped/0-res-sm blocks.0.hook_resid_post 0 32768 128 EleutherAI/the_pile_deduplicated none
blocks.1.hook_resid_post
Load this SAE
standard pythia-70m-deduped/1-res-sm blocks.1.hook_resid_post 1 32768 128 EleutherAI/the_pile_deduplicated none
blocks.2.hook_resid_post
Load this SAE
standard pythia-70m-deduped/2-res-sm blocks.2.hook_resid_post 2 32768 128 EleutherAI/the_pile_deduplicated none
blocks.3.hook_resid_post
Load this SAE
standard pythia-70m-deduped/3-res-sm blocks.3.hook_resid_post 3 32768 128 EleutherAI/the_pile_deduplicated none
blocks.4.hook_resid_post
Load this SAE
standard pythia-70m-deduped/4-res-sm blocks.4.hook_resid_post 4 32768 128 EleutherAI/the_pile_deduplicated none
blocks.5.hook_resid_post
Load this SAE
standard pythia-70m-deduped/5-res-sm blocks.5.hook_resid_post 5 32768 128 EleutherAI/the_pile_deduplicated none

pythia-70m-deduped-mlp-sm

  • Huggingface Repo: ctigges/pythia-70m-deduped__mlp-sm_processed
  • model: pythia-70m-deduped
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_mlp_out
Load this SAE
standard pythia-70m-deduped/0-mlp-sm blocks.0.hook_mlp_out 0 32768 128 EleutherAI/the_pile_deduplicated none
blocks.1.hook_mlp_out
Load this SAE
standard pythia-70m-deduped/1-mlp-sm blocks.1.hook_mlp_out 1 32768 128 EleutherAI/the_pile_deduplicated none
blocks.2.hook_mlp_out
Load this SAE
standard pythia-70m-deduped/2-mlp-sm blocks.2.hook_mlp_out 2 32768 128 EleutherAI/the_pile_deduplicated none
blocks.3.hook_mlp_out
Load this SAE
standard pythia-70m-deduped/3-mlp-sm blocks.3.hook_mlp_out 3 32768 128 EleutherAI/the_pile_deduplicated none
blocks.4.hook_mlp_out
Load this SAE
standard pythia-70m-deduped/4-mlp-sm blocks.4.hook_mlp_out 4 32768 128 EleutherAI/the_pile_deduplicated none
blocks.5.hook_mlp_out
Load this SAE
standard pythia-70m-deduped/5-mlp-sm blocks.5.hook_mlp_out 5 32768 128 EleutherAI/the_pile_deduplicated none

pythia-70m-deduped-att-sm

  • Huggingface Repo: ctigges/pythia-70m-deduped__att-sm_processed
  • model: pythia-70m-deduped
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.0.hook_attn_out
Load this SAE
standard pythia-70m-deduped/0-att-sm blocks.0.hook_attn_out 0 32768 128 EleutherAI/the_pile_deduplicated none
blocks.1.hook_attn_out
Load this SAE
standard pythia-70m-deduped/1-att-sm blocks.1.hook_attn_out 1 32768 128 EleutherAI/the_pile_deduplicated none
blocks.2.hook_attn_out
Load this SAE
standard pythia-70m-deduped/2-att-sm blocks.2.hook_attn_out 2 32768 128 EleutherAI/the_pile_deduplicated none
blocks.3.hook_attn_out
Load this SAE
standard pythia-70m-deduped/3-att-sm blocks.3.hook_attn_out 3 32768 128 EleutherAI/the_pile_deduplicated none
blocks.4.hook_attn_out
Load this SAE
standard pythia-70m-deduped/4-att-sm blocks.4.hook_attn_out 4 32768 128 EleutherAI/the_pile_deduplicated none
blocks.5.hook_attn_out
Load this SAE
standard pythia-70m-deduped/5-att-sm blocks.5.hook_attn_out 5 32768 128 EleutherAI/the_pile_deduplicated none

gpt2-small-res_sll-ajt

  • Huggingface Repo: neuronpedia/gpt2-small__res_sll-ajt
  • model: gpt2-small
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.2.hook_resid_pre
Load this SAE
standard gpt2-small/2-res_sll-ajt blocks.2.hook_resid_pre 2 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.6.hook_resid_pre
Load this SAE
standard gpt2-small/6-res_sll-ajt blocks.6.hook_resid_pre 6 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.10.hook_resid_pre
Load this SAE
standard gpt2-small/10-res_sll-ajt blocks.10.hook_resid_pre 10 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none

gpt2-small-res_slefr-ajt

  • Huggingface Repo: neuronpedia/gpt2-small__res_slefr-ajt
  • model: gpt2-small
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.2.hook_resid_pre
Load this SAE
standard gpt2-small/2-res_slefr-ajt blocks.2.hook_resid_pre 2 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.6.hook_resid_pre
Load this SAE
standard gpt2-small/6-res_slefr-ajt blocks.6.hook_resid_pre 6 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.10.hook_resid_pre
Load this SAE
standard gpt2-small/10-res_slefr-ajt blocks.10.hook_resid_pre 10 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none

gpt2-small-res_scl-ajt

  • Huggingface Repo: neuronpedia/gpt2-small__res_scl-ajt
  • model: gpt2-small
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.2.hook_resid_pre
Load this SAE
standard gpt2-small/2-res_scl-ajt blocks.2.hook_resid_pre 2 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.6.hook_resid_pre
Load this SAE
standard gpt2-small/6-res_scl-ajt blocks.6.hook_resid_pre 6 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.10.hook_resid_pre
Load this SAE
standard gpt2-small/10-res_scl-ajt blocks.10.hook_resid_pre 10 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none

gpt2-small-res_sle-ajt

  • Huggingface Repo: neuronpedia/gpt2-small__res_sle-ajt
  • model: gpt2-small
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.2.hook_resid_pre
Load this SAE
standard gpt2-small/2-res_sle-ajt blocks.2.hook_resid_pre 2 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.6.hook_resid_pre
Load this SAE
standard gpt2-small/6-res_sle-ajt blocks.6.hook_resid_pre 6 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.10.hook_resid_pre
Load this SAE
standard gpt2-small/10-res_sle-ajt blocks.10.hook_resid_pre 10 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none

gpt2-small-res_sce-ajt

  • Huggingface Repo: neuronpedia/gpt2-small__res_sce-ajt
  • model: gpt2-small
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.2.hook_resid_pre
Load this SAE
standard gpt2-small/2-res_sce-ajt blocks.2.hook_resid_pre 2 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.6.hook_resid_pre
Load this SAE
standard gpt2-small/6-res_sce-ajt blocks.6.hook_resid_pre 6 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.10.hook_resid_pre
Load this SAE
standard gpt2-small/10-res_sce-ajt blocks.10.hook_resid_pre 10 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none

gpt2-small-res_scefr-ajt

  • Huggingface Repo: neuronpedia/gpt2-small__res_scefr-ajt
  • model: gpt2-small
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.2.hook_resid_pre
Load this SAE
standard gpt2-small/2-res_scefr-ajt blocks.2.hook_resid_pre 2 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.6.hook_resid_pre
Load this SAE
standard gpt2-small/6-res_scefr-ajt blocks.6.hook_resid_pre 6 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none
blocks.10.hook_resid_pre
Load this SAE
standard gpt2-small/10-res_scefr-ajt blocks.10.hook_resid_pre 10 46080 128 apollo-research/Skylion007-openwebtext-tokenizer-gpt2 none

sae_bench_gemma-2-2b_sweep_standard_ctx128_ef2_0824

  • Huggingface Repo: canrager/lm_sae
  • model: gemma-2-2b
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.3.hook_resid_post__trainer_1_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_1_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_1_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_1_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_0_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_0_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_0_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_0_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_0_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_5_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_4_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_3_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_2_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_1_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_0_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_1_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_1_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_2_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_2_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_3_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_3_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_3_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_3_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_3_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_4_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_4_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_4_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_4_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_4_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_5_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_5_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_5_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_5_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_5_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_2_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_2_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-4k__trainer_2_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_4_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_4_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_4_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_4_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_4_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_5_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_5_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_5_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_3_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_5_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_5_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_3_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_2_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_3_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_0_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_0_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_0_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_1_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_1_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_3_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_1_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_1_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_2_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_2_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_2_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_2_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_3_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_1_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_5_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_0_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_0_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_4_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_3_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_2_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_1_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-4k__trainer_0_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_0_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_4_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_4_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_4_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_4_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_3_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_3_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_3_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_3_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_3_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_2_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_2_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_2_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_2_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_2_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_1_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_1_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_1_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_1_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_1_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_0_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_0_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_0_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_0_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_0_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_5_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_4_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_3_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_2_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_1_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_4_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_5_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_5_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_5_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_5_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-4k__trainer_5_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_2_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_5_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_5_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_5_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_5_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_4_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_4_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_4_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_2_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_4_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_3_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_3_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_3_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_3_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_3_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_2_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_2_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_1_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_2_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_4_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_1_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_1_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_5_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_1_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_0_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_1_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_1_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_2_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_3_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_4_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_5_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_0_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_0_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_0_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_0_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-4k__trainer_0_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_5_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_4_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_3_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_1_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_0_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-4k__trainer_2_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none

sae_bench_gemma-2-2b_sweep_standard_ctx128_ef8_0824

  • Huggingface Repo: canrager/lm_sae
  • model: gemma-2-2b
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.3.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_5_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_5_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_5_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_5_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_5_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_5_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_1_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_1_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_1_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_1_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_1_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_1_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_0_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_0_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_0_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_0_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_0_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_0_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_0_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_5_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_4_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_3_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_2_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_1_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_0_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_1_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_2_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_2_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_5_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_4_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_4_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_4_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_4_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_4_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_4_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_4_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_3_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_3_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_3_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_3_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_3_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_3_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_3_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_2_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_2_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_2_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_2_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-standard-res-18k__trainer_2_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_0_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_1_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_2_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_3_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_4_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_5_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_0_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_0_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_0_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_0_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_0_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_0_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_1_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_1_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_0_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_1_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_1_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_1_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_1_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_5_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_5_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_5_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_5_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_5_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_5_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_4_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_4_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_1_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_2_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_2_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_2_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_2_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_2_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_2_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_2_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_3_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_3_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_3_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_3_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_3_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_3_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_3_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_4_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_4_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_4_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_4_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_4_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-standard-res-18k__trainer_5_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_5_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_5_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_5_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_5_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_5_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_5_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_5_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_4_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_4_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_4_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_4_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_4_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_4_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_4_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_3_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_3_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_3_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_3_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_3_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_3_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_3_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_2_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_2_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_2_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_2_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_2_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_2_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_2_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_1_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_1_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_1_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_1_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_1_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_1_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_1_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_0_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_0_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_0_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_0_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_0_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_0_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_0_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_5_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_4_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_3_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_2_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_1_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/11-sae_bench-standard-res-18k__trainer_0_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_5_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_5_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_5_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_5_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_5_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_1_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_5_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_5_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_4_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_4_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_2_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_2_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_2_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_2_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_2_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_1_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_1_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_1_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_1_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_1_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_1_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_1_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_0_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_0_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_0_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_0_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_0_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_0_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_0_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_5_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_4_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_3_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_2_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_2_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_4_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_2_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_3_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_4_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_4_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_4_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_4_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_3_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_3_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_3_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_3_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_3_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_3_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/15-sae_bench-standard-res-18k__trainer_0_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_5_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_5_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_5_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_5_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_5_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_5_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_5_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_4_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_4_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_4_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_2_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_2_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_2_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_2_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_2_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_3_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_3_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_3_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_3_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_3_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_3_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_4_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_4_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_4_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_4_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_3_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_2_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_2_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_1_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_1_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_2_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_3_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_4_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_5_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_0_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_0_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_0_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_1_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_0_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_0_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_0_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_1_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_1_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_1_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_1_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_0_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_0_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-standard-res-18k__trainer_1_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none

sae_bench_gemma-2-2b_sweep_topk_ctx128_ef2_0824

  • Huggingface Repo: canrager/lm_sae
  • model: gemma-2-2b
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.3.hook_resid_post__trainer_2_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_2_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_3_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_3_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_3_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_3_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_3_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_4_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_4_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_2_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_4_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_4_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_5_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_5_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_5_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_5_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_5_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_4_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_2_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_2_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_2_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_0_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_1_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_2_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_3_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_4_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_5_step_final blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_0_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_0_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_0_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_0_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_0_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_1_step_0 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_19528
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_1_step_19528 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_29292
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_1_step_29292 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_1_step_4882 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_9764
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-4k__trainer_1_step_9764 blocks.3.hook_resid_post 3 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_0_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_1_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_4_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_3_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_4_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_4_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_4_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_4_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_3_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_3_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_3_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_3_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_3_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_2_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_2_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_2_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_5_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_2_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_5_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_5_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_5_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_5_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_2_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_1_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_1_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_1_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_1_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_1_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_9764
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_0_step_9764 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_0_step_4882 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_29292
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_0_step_29292 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_19528
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_0_step_19528 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_0_step_0 blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_5_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_4_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-4k__trainer_2_step_final blocks.7.hook_resid_post 7 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_0_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_0_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_0_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_0_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_0_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_5_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_4_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_3_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_2_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_1_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_0_step_final blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_1_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_1_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_1_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_5_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_5_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_5_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_5_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_5_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_4_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_4_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_4_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_4_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_4_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_3_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_3_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_3_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_3_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_3_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_2_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_2_step_4882 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_2_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_19528
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_2_step_19528 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_2_step_0 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_9764
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_1_step_9764 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_29292
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-4k__trainer_1_step_29292 blocks.11.hook_resid_post 11 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_5_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_5_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_5_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_5_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_5_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_4_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_4_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_4_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_4_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_3_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_3_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_3_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_3_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_3_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_2_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_2_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_4_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_2_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_0_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_0_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_0_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_0_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_0_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_5_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_4_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_3_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_2_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_1_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_0_step_final blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_1_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_2_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_2_step_0 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_9764
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_1_step_9764 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_1_step_4882 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_29292
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_1_step_29292 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_19528
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-4k__trainer_1_step_19528 blocks.15.hook_resid_post 15 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_3_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_4_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_5_step_final blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_19528
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_19528 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_29292
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_29292 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_9764
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_1_step_9764 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_2_step_0 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-4k__trainer_0_step_4882 blocks.19.hook_resid_post 19 4608 128 monology/pile-uncopyrighted none

sae_bench_gemma-2-2b_sweep_topk_ctx128_ef8_0824

  • Huggingface Repo: canrager/lm_sae
  • model: gemma-2-2b
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.3.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_3_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_1_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_1_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_1_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_1_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_1_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_0_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_0_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_0_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_1_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_0_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_0_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_0_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_5_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_4_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_2_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_1_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_0_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_1_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_2_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_2_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_4_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_4_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_4_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_4_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_4_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_4_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_4_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_3_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_3_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_3_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_3_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_3_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_3_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_3_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_2_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_2_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_2_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_2_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_2_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_5_step_0 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_154
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_5_step_154 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_1544
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_5_step_1544 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_0_step_final blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_488
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_5_step_488 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_48
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_5_step_48 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_15440
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_5_step_15440 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/3-sae_bench-topk-res-18k__trainer_5_step_4882 blocks.3.hook_resid_post 3 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_0_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_0_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_5_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_4_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_3_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_1_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_2_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_0_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_0_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_5_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_0_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_0_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_1_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_1_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_1_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_1_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_1_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_3_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_2_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_2_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_2_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_2_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_2_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_2_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_1_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_1_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_1_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_2_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_2_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_0_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_3_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_3_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_5_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_5_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_5_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_5_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_5_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_5_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_4_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_3_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_4_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_15440
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_4_step_15440 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_1544
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_4_step_1544 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_154
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_4_step_154 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_4_step_0 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_3_step_4882 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_488
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_3_step_488 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_3_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_3_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_4_step_48
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_4_step_48 blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.7.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/7-sae_bench-topk-res-18k__trainer_0_step_final blocks.7.hook_resid_post 7 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_5_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_5_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_5_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_0_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_0_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_0_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_5_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_3_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_2_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_1_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_0_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_0_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_0_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_4_step_final blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_0_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_4_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_4_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_4_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_4_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_4_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_3_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_3_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_3_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_4_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_3_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_3_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_2_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_2_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_2_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_0_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_0_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_2_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_2_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_2_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_3_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_4_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_3_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_3_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_5_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_1_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_5_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_1_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_1_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_48
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_1_step_48 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_488
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_1_step_488 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_1_step_4882 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_2_step_0 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_1_step_154
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_1_step_154 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_15440
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_5_step_15440 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.11.hook_resid_post__trainer_5_step_1544
Load this SAE
standard gemma-2-2b/11-sae_bench-topk-res-18k__trainer_5_step_1544 blocks.11.hook_resid_post 11 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_4_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_4_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_4_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_4_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_4_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_4_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_5_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_5_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_5_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_5_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_5_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_5_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_5_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_3_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_3_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_3_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_3_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_3_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_3_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_4_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_3_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_2_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_2_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_2_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_0_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_1_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_2_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_3_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_4_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_5_step_final blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_0_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_0_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_0_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_0_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_0_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_0_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_1_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_1_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_1_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_1_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_48
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_1_step_48 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_488
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_1_step_488 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_1_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_2_step_0 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_154
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_2_step_154 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_1544
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_2_step_1544 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_2_step_15440
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_2_step_15440 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.15.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/15-sae_bench-topk-res-18k__trainer_0_step_4882 blocks.15.hook_resid_post 15 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_4_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_3_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_3_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_3_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_3_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_3_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_3_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_3_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_0_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_0_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_5_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_4_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_3
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_3_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_2_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_1_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_0_step_final blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_0_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_0_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_0_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_2_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_2_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_2_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_2_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_2_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_2_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_2_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_2_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_1_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_1_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_1_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_1_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_1_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_0_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_0_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_0_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_1_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_1_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_1_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_4_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_4_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_4_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_4_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_4_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_0
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_5_step_0 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_5_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_1544
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_5_step_1544 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_15440
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_5_step_15440 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_48
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_5_step_48 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_488
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_5_step_488 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_5_step_4882
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_5_step_4882 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none
blocks.19.hook_resid_post__trainer_4_step_154
Load this SAE
standard gemma-2-2b/19-sae_bench-topk-res-18k__trainer_4_step_154 blocks.19.hook_resid_post 19 18432 128 monology/pile-uncopyrighted none

sae_bench_pythia70m_sweep_gated_ctx128_0730

  • Huggingface Repo: canrager/lm_sae
  • model: pythia-70m-deduped
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.3.hook_resid_post__trainer_0
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_0_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_1_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_10
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_10_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_12
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_12_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_13
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_13_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_14
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_14_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_15
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_15_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_16
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_16_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_17
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_17_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_18
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_18_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_19
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_19_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_2_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_3_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_4_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_5_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_6
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_6_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_7
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_7_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_8
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_8_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_9
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-4k__trainer_9_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_11
Load this SAE
gated pythia-70m-deduped/3-sae_bench-gated-res-16k__trainer_11_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_0
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_0_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_1
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_1_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_10
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_10_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_11
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_11_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_12
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_12_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_13
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_13_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_14
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_14_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_15
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_15_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_16
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_16_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_17
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_17_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_18
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_18_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_19
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_19_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_2
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_2_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_3
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_3_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_4
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_4_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_5
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_5_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_6
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_6_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_9
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_9_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_8
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-4k__trainer_8_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_7
Load this SAE
gated pythia-70m-deduped/4-sae_bench-gated-res-16k__trainer_7_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none

sae_bench_pythia70m_sweep_panneal_ctx128_0730

  • Huggingface Repo: canrager/lm_sae
  • model: pythia-70m-deduped
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.3.hook_resid_post__trainer_16
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_16_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_17
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_17_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_18
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_18_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_19
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_19_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_2_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_20
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_20_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_21
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_21_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_22
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_22_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_15
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_15_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_23
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_23_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_25
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_25_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_26
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_26_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_27
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_27_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_3_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_4_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_5_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_6
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_6_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_7
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_7_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_24
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_24_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_14
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_14_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_13
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_13_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_12
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_12_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_0_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_1_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_10
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_10_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_11
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-16k__trainer_11_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_8
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_8_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_9
Load this SAE
standard pythia-70m-deduped/3-sae_bench-panneal-res-4k__trainer_9_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_17
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_17_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_18
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_18_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_19
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_19_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_16
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_16_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_15
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_15_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_14
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_14_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_13
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_13_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_12
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_12_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_11
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_11_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_10
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_10_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_1
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_1_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_0
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_0_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_2
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_2_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_20
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_20_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_22
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_22_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_9
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_9_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_8
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_8_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_7
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_7_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_6
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_6_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_5
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_5_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_4
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_4_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_27
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_27_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_26
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_26_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_25
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_25_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_3
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_3_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_24
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_24_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_21
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-4k__trainer_21_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_23
Load this SAE
standard pythia-70m-deduped/4-sae_bench-panneal-res-16k__trainer_23_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none

sae_bench_pythia70m_sweep_standard_ctx128_0712

  • Huggingface Repo: canrager/lm_sae
  • model: pythia-70m-deduped
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.3.hook_resid_post__trainer_10
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_10_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_11
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_11_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_8
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_8_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_7
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_7_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_6
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_6_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_5_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_4_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_3_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_2_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_19
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_19_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_18
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_18_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_17
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_17_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_16
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_16_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_15
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_15_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_14
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-16k__trainer_14_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_0
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_0_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_1_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_13
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_13_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_12
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_12_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_9
Load this SAE
standard pythia-70m-deduped/3-sae_bench-standard-res-4k__trainer_9_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_0
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_0_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_11
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_11_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_10
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_10_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_1
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_1_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_13
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_13_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_14
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_14_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_16
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_16_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_17
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_17_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_18
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_18_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_2
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_2_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_20
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_20_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_21
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_21_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_12
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_12_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_22
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_22_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_3
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_3_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_4
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_4_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_5
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_5_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_6
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_6_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_7
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_7_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_8
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_8_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_9
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-4k__trainer_9_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_23
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_23_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_15
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_15_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_19
Load this SAE
standard pythia-70m-deduped/4-sae_bench-standard-res-16k__trainer_19_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none

sae_bench_pythia70m_sweep_topk_ctx128_0730

  • Huggingface Repo: canrager/lm_sae
  • model: pythia-70m-deduped
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.3.hook_resid_post__trainer_0
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_0_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_1
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_1_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_10
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_10_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_11
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_11_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_12
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_12_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_13
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_13_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_14
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_14_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_22
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_22_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_19
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_19_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_2
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_2_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_20
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_20_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_21
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_21_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_16
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_16_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_23
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_23_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_18
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_18_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_3
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_3_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_5
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_5_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_6
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_6_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_7
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_7_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_8
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_8_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_9
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_9_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_15
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-16k__trainer_15_step_final blocks.3.hook_resid_post 3 16384 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_4
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_4_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.3.hook_resid_post__trainer_17
Load this SAE
standard pythia-70m-deduped/3-sae_bench-topk-res-4k__trainer_17_step_final blocks.3.hook_resid_post 3 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_13
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_13_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_14
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_14_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_15
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_15_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_16
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_16_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_17
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_17_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_18
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_18_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_19
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_19_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_2
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_2_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_20
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_20_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_21
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_21_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_22
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_22_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_23
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_23_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_3
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_3_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_4
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_4_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_5
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_5_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_6
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_6_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_7
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_7_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_12
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_12_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_11
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_11_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_10
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-16k__trainer_10_step_final blocks.4.hook_resid_post 4 16384 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_1
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_1_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_0
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_0_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_9
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_9_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none
blocks.4.hook_resid_post__trainer_8
Load this SAE
standard pythia-70m-deduped/4-sae_bench-topk-res-4k__trainer_8_step_final blocks.4.hook_resid_post 4 4096 128 monology/pile-uncopyrighted none

llama-3-8b-it-res-jh

  • Huggingface Repo: Juliushanhanhan/llama-3-8b-it-res
  • model: meta-llama/Meta-Llama-3-8B-Instruct
  • Additional Links:
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
blocks.25.hook_resid_post
Load this SAE
gated llama3-8b-it/25-res-jh blocks.25.hook_resid_post 25 65536 1024 Juliushanhanhan/openwebtext-1b-llama3-tokenized-cxt-1024 expected_average_only_in

llama_scope_lxa_32x

  • Huggingface Repo: fnlp/Llama3_1-8B-Base-LXA-32x
  • model: meta-llama/Llama-3.1-8B
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
l0a_32x
Load this SAE
jumprelu llama3.1-8b/0-llamascope-att-128k blocks.0.hook_attn_out 0 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l1a_32x
Load this SAE
jumprelu llama3.1-8b/1-llamascope-att-128k blocks.1.hook_attn_out 1 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l2a_32x
Load this SAE
jumprelu llama3.1-8b/2-llamascope-att-128k blocks.2.hook_attn_out 2 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l3a_32x
Load this SAE
jumprelu llama3.1-8b/3-llamascope-att-128k blocks.3.hook_attn_out 3 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l4a_32x
Load this SAE
jumprelu llama3.1-8b/4-llamascope-att-128k blocks.4.hook_attn_out 4 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l5a_32x
Load this SAE
jumprelu llama3.1-8b/5-llamascope-att-128k blocks.5.hook_attn_out 5 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l6a_32x
Load this SAE
jumprelu llama3.1-8b/6-llamascope-att-128k blocks.6.hook_attn_out 6 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l7a_32x
Load this SAE
jumprelu llama3.1-8b/7-llamascope-att-128k blocks.7.hook_attn_out 7 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l8a_32x
Load this SAE
jumprelu llama3.1-8b/8-llamascope-att-128k blocks.8.hook_attn_out 8 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l9a_32x
Load this SAE
jumprelu llama3.1-8b/9-llamascope-att-128k blocks.9.hook_attn_out 9 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l10a_32x
Load this SAE
jumprelu llama3.1-8b/10-llamascope-att-128k blocks.10.hook_attn_out 10 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l11a_32x
Load this SAE
jumprelu llama3.1-8b/11-llamascope-att-128k blocks.11.hook_attn_out 11 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l12a_32x
Load this SAE
jumprelu llama3.1-8b/12-llamascope-att-128k blocks.12.hook_attn_out 12 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l13a_32x
Load this SAE
jumprelu llama3.1-8b/13-llamascope-att-128k blocks.13.hook_attn_out 13 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l14a_32x
Load this SAE
jumprelu llama3.1-8b/14-llamascope-att-128k blocks.14.hook_attn_out 14 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l15a_32x
Load this SAE
jumprelu llama3.1-8b/15-llamascope-att-128k blocks.15.hook_attn_out 15 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l16a_32x
Load this SAE
jumprelu llama3.1-8b/16-llamascope-att-128k blocks.16.hook_attn_out 16 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l17a_32x
Load this SAE
jumprelu llama3.1-8b/17-llamascope-att-128k blocks.17.hook_attn_out 17 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l18a_32x
Load this SAE
jumprelu llama3.1-8b/18-llamascope-att-128k blocks.18.hook_attn_out 18 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l19a_32x
Load this SAE
jumprelu llama3.1-8b/19-llamascope-att-128k blocks.19.hook_attn_out 19 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l20a_32x
Load this SAE
jumprelu llama3.1-8b/20-llamascope-att-128k blocks.20.hook_attn_out 20 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l21a_32x
Load this SAE
jumprelu llama3.1-8b/21-llamascope-att-128k blocks.21.hook_attn_out 21 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l22a_32x
Load this SAE
jumprelu llama3.1-8b/22-llamascope-att-128k blocks.22.hook_attn_out 22 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l23a_32x
Load this SAE
jumprelu llama3.1-8b/23-llamascope-att-128k blocks.23.hook_attn_out 23 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l24a_32x
Load this SAE
jumprelu llama3.1-8b/24-llamascope-att-128k blocks.24.hook_attn_out 24 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l25a_32x
Load this SAE
jumprelu llama3.1-8b/25-llamascope-att-128k blocks.25.hook_attn_out 25 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l26a_32x
Load this SAE
jumprelu llama3.1-8b/26-llamascope-att-128k blocks.26.hook_attn_out 26 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l27a_32x
Load this SAE
jumprelu llama3.1-8b/27-llamascope-att-128k blocks.27.hook_attn_out 27 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l28a_32x
Load this SAE
jumprelu llama3.1-8b/28-llamascope-att-128k blocks.28.hook_attn_out 28 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l29a_32x
Load this SAE
jumprelu llama3.1-8b/29-llamascope-att-128k blocks.29.hook_attn_out 29 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l30a_32x
Load this SAE
jumprelu llama3.1-8b/30-llamascope-att-128k blocks.30.hook_attn_out 30 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l31a_32x
Load this SAE
jumprelu llama3.1-8b/31-llamascope-att-128k blocks.31.hook_attn_out 31 131072 1024 cerebras/SlimPajama-627B expected_average_only_in

llama_scope_lxa_8x

  • Huggingface Repo: fnlp/Llama3_1-8B-Base-LXA-8x
  • model: meta-llama/Llama-3.1-8B
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
l0a_8x
Load this SAE
jumprelu llama3.1-8b/0-llamascope-att-32k blocks.0.hook_attn_out 0 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l1a_8x
Load this SAE
jumprelu llama3.1-8b/1-llamascope-att-32k blocks.1.hook_attn_out 1 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l2a_8x
Load this SAE
jumprelu llama3.1-8b/2-llamascope-att-32k blocks.2.hook_attn_out 2 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l3a_8x
Load this SAE
jumprelu llama3.1-8b/3-llamascope-att-32k blocks.3.hook_attn_out 3 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l4a_8x
Load this SAE
jumprelu llama3.1-8b/4-llamascope-att-32k blocks.4.hook_attn_out 4 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l5a_8x
Load this SAE
jumprelu llama3.1-8b/5-llamascope-att-32k blocks.5.hook_attn_out 5 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l6a_8x
Load this SAE
jumprelu llama3.1-8b/6-llamascope-att-32k blocks.6.hook_attn_out 6 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l7a_8x
Load this SAE
jumprelu llama3.1-8b/7-llamascope-att-32k blocks.7.hook_attn_out 7 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l8a_8x
Load this SAE
jumprelu llama3.1-8b/8-llamascope-att-32k blocks.8.hook_attn_out 8 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l9a_8x
Load this SAE
jumprelu llama3.1-8b/9-llamascope-att-32k blocks.9.hook_attn_out 9 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l10a_8x
Load this SAE
jumprelu llama3.1-8b/10-llamascope-att-32k blocks.10.hook_attn_out 10 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l11a_8x
Load this SAE
jumprelu llama3.1-8b/11-llamascope-att-32k blocks.11.hook_attn_out 11 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l12a_8x
Load this SAE
jumprelu llama3.1-8b/12-llamascope-att-32k blocks.12.hook_attn_out 12 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l13a_8x
Load this SAE
jumprelu llama3.1-8b/13-llamascope-att-32k blocks.13.hook_attn_out 13 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l14a_8x
Load this SAE
jumprelu llama3.1-8b/14-llamascope-att-32k blocks.14.hook_attn_out 14 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l15a_8x
Load this SAE
jumprelu llama3.1-8b/15-llamascope-att-32k blocks.15.hook_attn_out 15 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l16a_8x
Load this SAE
jumprelu llama3.1-8b/16-llamascope-att-32k blocks.16.hook_attn_out 16 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l17a_8x
Load this SAE
jumprelu llama3.1-8b/17-llamascope-att-32k blocks.17.hook_attn_out 17 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l18a_8x
Load this SAE
jumprelu llama3.1-8b/18-llamascope-att-32k blocks.18.hook_attn_out 18 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l19a_8x
Load this SAE
jumprelu llama3.1-8b/19-llamascope-att-32k blocks.19.hook_attn_out 19 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l20a_8x
Load this SAE
jumprelu llama3.1-8b/20-llamascope-att-32k blocks.20.hook_attn_out 20 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l21a_8x
Load this SAE
jumprelu llama3.1-8b/21-llamascope-att-32k blocks.21.hook_attn_out 21 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l22a_8x
Load this SAE
jumprelu llama3.1-8b/22-llamascope-att-32k blocks.22.hook_attn_out 22 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l23a_8x
Load this SAE
jumprelu llama3.1-8b/23-llamascope-att-32k blocks.23.hook_attn_out 23 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l24a_8x
Load this SAE
jumprelu llama3.1-8b/24-llamascope-att-32k blocks.24.hook_attn_out 24 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l25a_8x
Load this SAE
jumprelu llama3.1-8b/25-llamascope-att-32k blocks.25.hook_attn_out 25 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l26a_8x
Load this SAE
jumprelu llama3.1-8b/26-llamascope-att-32k blocks.26.hook_attn_out 26 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l27a_8x
Load this SAE
jumprelu llama3.1-8b/27-llamascope-att-32k blocks.27.hook_attn_out 27 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l28a_8x
Load this SAE
jumprelu llama3.1-8b/28-llamascope-att-32k blocks.28.hook_attn_out 28 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l29a_8x
Load this SAE
jumprelu llama3.1-8b/29-llamascope-att-32k blocks.29.hook_attn_out 29 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l30a_8x
Load this SAE
jumprelu llama3.1-8b/30-llamascope-att-32k blocks.30.hook_attn_out 30 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l31a_8x
Load this SAE
jumprelu llama3.1-8b/31-llamascope-att-32k blocks.31.hook_attn_out 31 32768 1024 cerebras/SlimPajama-627B expected_average_only_in

llama_scope_lxm_32x

  • Huggingface Repo: fnlp/Llama3_1-8B-Base-LXM-32x
  • model: meta-llama/Llama-3.1-8B
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
l0m_32x
Load this SAE
jumprelu llama3.1-8b/0-llamascope-mlp-128k blocks.0.hook_mlp_out 0 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l1m_32x
Load this SAE
jumprelu llama3.1-8b/1-llamascope-mlp-128k blocks.1.hook_mlp_out 1 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l2m_32x
Load this SAE
jumprelu llama3.1-8b/2-llamascope-mlp-128k blocks.2.hook_mlp_out 2 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l3m_32x
Load this SAE
jumprelu llama3.1-8b/3-llamascope-mlp-128k blocks.3.hook_mlp_out 3 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l4m_32x
Load this SAE
jumprelu llama3.1-8b/4-llamascope-mlp-128k blocks.4.hook_mlp_out 4 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l5m_32x
Load this SAE
jumprelu llama3.1-8b/5-llamascope-mlp-128k blocks.5.hook_mlp_out 5 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l6m_32x
Load this SAE
jumprelu llama3.1-8b/6-llamascope-mlp-128k blocks.6.hook_mlp_out 6 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l7m_32x
Load this SAE
jumprelu llama3.1-8b/7-llamascope-mlp-128k blocks.7.hook_mlp_out 7 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l8m_32x
Load this SAE
jumprelu llama3.1-8b/8-llamascope-mlp-128k blocks.8.hook_mlp_out 8 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l9m_32x
Load this SAE
jumprelu llama3.1-8b/9-llamascope-mlp-128k blocks.9.hook_mlp_out 9 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l10m_32x
Load this SAE
jumprelu llama3.1-8b/10-llamascope-mlp-128k blocks.10.hook_mlp_out 10 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l11m_32x
Load this SAE
jumprelu llama3.1-8b/11-llamascope-mlp-128k blocks.11.hook_mlp_out 11 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l12m_32x
Load this SAE
jumprelu llama3.1-8b/12-llamascope-mlp-128k blocks.12.hook_mlp_out 12 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l13m_32x
Load this SAE
jumprelu llama3.1-8b/13-llamascope-mlp-128k blocks.13.hook_mlp_out 13 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l14m_32x
Load this SAE
jumprelu llama3.1-8b/14-llamascope-mlp-128k blocks.14.hook_mlp_out 14 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l15m_32x
Load this SAE
jumprelu llama3.1-8b/15-llamascope-mlp-128k blocks.15.hook_mlp_out 15 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l16m_32x
Load this SAE
jumprelu llama3.1-8b/16-llamascope-mlp-128k blocks.16.hook_mlp_out 16 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l17m_32x
Load this SAE
jumprelu llama3.1-8b/17-llamascope-mlp-128k blocks.17.hook_mlp_out 17 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l18m_32x
Load this SAE
jumprelu llama3.1-8b/18-llamascope-mlp-128k blocks.18.hook_mlp_out 18 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l19m_32x
Load this SAE
jumprelu llama3.1-8b/19-llamascope-mlp-128k blocks.19.hook_mlp_out 19 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l20m_32x
Load this SAE
jumprelu llama3.1-8b/20-llamascope-mlp-128k blocks.20.hook_mlp_out 20 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l21m_32x
Load this SAE
jumprelu llama3.1-8b/21-llamascope-mlp-128k blocks.21.hook_mlp_out 21 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l22m_32x
Load this SAE
jumprelu llama3.1-8b/22-llamascope-mlp-128k blocks.22.hook_mlp_out 22 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l23m_32x
Load this SAE
jumprelu llama3.1-8b/23-llamascope-mlp-128k blocks.23.hook_mlp_out 23 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l24m_32x
Load this SAE
jumprelu llama3.1-8b/24-llamascope-mlp-128k blocks.24.hook_mlp_out 24 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l25m_32x
Load this SAE
jumprelu llama3.1-8b/25-llamascope-mlp-128k blocks.25.hook_mlp_out 25 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l26m_32x
Load this SAE
jumprelu llama3.1-8b/26-llamascope-mlp-128k blocks.26.hook_mlp_out 26 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l27m_32x
Load this SAE
jumprelu llama3.1-8b/27-llamascope-mlp-128k blocks.27.hook_mlp_out 27 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l28m_32x
Load this SAE
jumprelu llama3.1-8b/28-llamascope-mlp-128k blocks.28.hook_mlp_out 28 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l29m_32x
Load this SAE
jumprelu llama3.1-8b/29-llamascope-mlp-128k blocks.29.hook_mlp_out 29 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l30m_32x
Load this SAE
jumprelu llama3.1-8b/30-llamascope-mlp-128k blocks.30.hook_mlp_out 30 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l31m_32x
Load this SAE
jumprelu llama3.1-8b/31-llamascope-mlp-128k blocks.31.hook_mlp_out 31 131072 1024 cerebras/SlimPajama-627B expected_average_only_in

llama_scope_lxm_8x

  • Huggingface Repo: fnlp/Llama3_1-8B-Base-LXM-8x
  • model: meta-llama/Llama-3.1-8B
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
l0m_8x
Load this SAE
jumprelu llama3.1-8b/0-llamascope-mlp-32k blocks.0.hook_mlp_out 0 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l1m_8x
Load this SAE
jumprelu llama3.1-8b/1-llamascope-mlp-32k blocks.1.hook_mlp_out 1 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l2m_8x
Load this SAE
jumprelu llama3.1-8b/2-llamascope-mlp-32k blocks.2.hook_mlp_out 2 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l3m_8x
Load this SAE
jumprelu llama3.1-8b/3-llamascope-mlp-32k blocks.3.hook_mlp_out 3 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l4m_8x
Load this SAE
jumprelu llama3.1-8b/4-llamascope-mlp-32k blocks.4.hook_mlp_out 4 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l5m_8x
Load this SAE
jumprelu llama3.1-8b/5-llamascope-mlp-32k blocks.5.hook_mlp_out 5 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l6m_8x
Load this SAE
jumprelu llama3.1-8b/6-llamascope-mlp-32k blocks.6.hook_mlp_out 6 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l7m_8x
Load this SAE
jumprelu llama3.1-8b/7-llamascope-mlp-32k blocks.7.hook_mlp_out 7 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l8m_8x
Load this SAE
jumprelu llama3.1-8b/8-llamascope-mlp-32k blocks.8.hook_mlp_out 8 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l9m_8x
Load this SAE
jumprelu llama3.1-8b/9-llamascope-mlp-32k blocks.9.hook_mlp_out 9 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l10m_8x
Load this SAE
jumprelu llama3.1-8b/10-llamascope-mlp-32k blocks.10.hook_mlp_out 10 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l11m_8x
Load this SAE
jumprelu llama3.1-8b/11-llamascope-mlp-32k blocks.11.hook_mlp_out 11 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l12m_8x
Load this SAE
jumprelu llama3.1-8b/12-llamascope-mlp-32k blocks.12.hook_mlp_out 12 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l13m_8x
Load this SAE
jumprelu llama3.1-8b/13-llamascope-mlp-32k blocks.13.hook_mlp_out 13 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l14m_8x
Load this SAE
jumprelu llama3.1-8b/14-llamascope-mlp-32k blocks.14.hook_mlp_out 14 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l15m_8x
Load this SAE
jumprelu llama3.1-8b/15-llamascope-mlp-32k blocks.15.hook_mlp_out 15 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l16m_8x
Load this SAE
jumprelu llama3.1-8b/16-llamascope-mlp-32k blocks.16.hook_mlp_out 16 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l17m_8x
Load this SAE
jumprelu llama3.1-8b/17-llamascope-mlp-32k blocks.17.hook_mlp_out 17 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l18m_8x
Load this SAE
jumprelu llama3.1-8b/18-llamascope-mlp-32k blocks.18.hook_mlp_out 18 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l19m_8x
Load this SAE
jumprelu llama3.1-8b/19-llamascope-mlp-32k blocks.19.hook_mlp_out 19 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l20m_8x
Load this SAE
jumprelu llama3.1-8b/20-llamascope-mlp-32k blocks.20.hook_mlp_out 20 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l21m_8x
Load this SAE
jumprelu llama3.1-8b/21-llamascope-mlp-32k blocks.21.hook_mlp_out 21 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l22m_8x
Load this SAE
jumprelu llama3.1-8b/22-llamascope-mlp-32k blocks.22.hook_mlp_out 22 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l23m_8x
Load this SAE
jumprelu llama3.1-8b/23-llamascope-mlp-32k blocks.23.hook_mlp_out 23 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l24m_8x
Load this SAE
jumprelu llama3.1-8b/24-llamascope-mlp-32k blocks.24.hook_mlp_out 24 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l25m_8x
Load this SAE
jumprelu llama3.1-8b/25-llamascope-mlp-32k blocks.25.hook_mlp_out 25 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l26m_8x
Load this SAE
jumprelu llama3.1-8b/26-llamascope-mlp-32k blocks.26.hook_mlp_out 26 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l27m_8x
Load this SAE
jumprelu llama3.1-8b/27-llamascope-mlp-32k blocks.27.hook_mlp_out 27 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l28m_8x
Load this SAE
jumprelu llama3.1-8b/28-llamascope-mlp-32k blocks.28.hook_mlp_out 28 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l29m_8x
Load this SAE
jumprelu llama3.1-8b/29-llamascope-mlp-32k blocks.29.hook_mlp_out 29 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l30m_8x
Load this SAE
jumprelu llama3.1-8b/30-llamascope-mlp-32k blocks.30.hook_mlp_out 30 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l31m_8x
Load this SAE
jumprelu llama3.1-8b/31-llamascope-mlp-32k blocks.31.hook_mlp_out 31 32768 1024 cerebras/SlimPajama-627B expected_average_only_in

llama_scope_lxr_32x

  • Huggingface Repo: fnlp/Llama3_1-8B-Base-LXR-32x
  • model: meta-llama/Llama-3.1-8B
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
l0r_32x
Load this SAE
jumprelu llama3.1-8b/0-llamascope-res-128k blocks.0.hook_resid_post 0 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l1r_32x
Load this SAE
jumprelu llama3.1-8b/1-llamascope-res-128k blocks.1.hook_resid_post 1 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l2r_32x
Load this SAE
jumprelu llama3.1-8b/2-llamascope-res-128k blocks.2.hook_resid_post 2 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l3r_32x
Load this SAE
jumprelu llama3.1-8b/3-llamascope-res-128k blocks.3.hook_resid_post 3 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l4r_32x
Load this SAE
jumprelu llama3.1-8b/4-llamascope-res-128k blocks.4.hook_resid_post 4 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l5r_32x
Load this SAE
jumprelu llama3.1-8b/5-llamascope-res-128k blocks.5.hook_resid_post 5 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l6r_32x
Load this SAE
jumprelu llama3.1-8b/6-llamascope-res-128k blocks.6.hook_resid_post 6 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l7r_32x
Load this SAE
jumprelu llama3.1-8b/7-llamascope-res-128k blocks.7.hook_resid_post 7 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l8r_32x
Load this SAE
jumprelu llama3.1-8b/8-llamascope-res-128k blocks.8.hook_resid_post 8 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l9r_32x
Load this SAE
jumprelu llama3.1-8b/9-llamascope-res-128k blocks.9.hook_resid_post 9 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l10r_32x
Load this SAE
jumprelu llama3.1-8b/10-llamascope-res-128k blocks.10.hook_resid_post 10 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l11r_32x
Load this SAE
jumprelu llama3.1-8b/11-llamascope-res-128k blocks.11.hook_resid_post 11 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l12r_32x
Load this SAE
jumprelu llama3.1-8b/12-llamascope-res-128k blocks.12.hook_resid_post 12 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l13r_32x
Load this SAE
jumprelu llama3.1-8b/13-llamascope-res-128k blocks.13.hook_resid_post 13 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l14r_32x
Load this SAE
jumprelu llama3.1-8b/14-llamascope-res-128k blocks.14.hook_resid_post 14 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l15r_32x
Load this SAE
jumprelu llama3.1-8b/15-llamascope-res-128k blocks.15.hook_resid_post 15 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l16r_32x
Load this SAE
jumprelu llama3.1-8b/16-llamascope-res-128k blocks.16.hook_resid_post 16 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l17r_32x
Load this SAE
jumprelu llama3.1-8b/17-llamascope-res-128k blocks.17.hook_resid_post 17 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l18r_32x
Load this SAE
jumprelu llama3.1-8b/18-llamascope-res-128k blocks.18.hook_resid_post 18 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l19r_32x
Load this SAE
jumprelu llama3.1-8b/19-llamascope-res-128k blocks.19.hook_resid_post 19 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l20r_32x
Load this SAE
jumprelu llama3.1-8b/20-llamascope-res-128k blocks.20.hook_resid_post 20 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l21r_32x
Load this SAE
jumprelu llama3.1-8b/21-llamascope-res-128k blocks.21.hook_resid_post 21 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l22r_32x
Load this SAE
jumprelu llama3.1-8b/22-llamascope-res-128k blocks.22.hook_resid_post 22 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l23r_32x
Load this SAE
jumprelu llama3.1-8b/23-llamascope-res-128k blocks.23.hook_resid_post 23 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l24r_32x
Load this SAE
jumprelu llama3.1-8b/24-llamascope-res-128k blocks.24.hook_resid_post 24 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l25r_32x
Load this SAE
jumprelu llama3.1-8b/25-llamascope-res-128k blocks.25.hook_resid_post 25 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l26r_32x
Load this SAE
jumprelu llama3.1-8b/26-llamascope-res-128k blocks.26.hook_resid_post 26 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l27r_32x
Load this SAE
jumprelu llama3.1-8b/27-llamascope-res-128k blocks.27.hook_resid_post 27 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l28r_32x
Load this SAE
jumprelu llama3.1-8b/28-llamascope-res-128k blocks.28.hook_resid_post 28 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l29r_32x
Load this SAE
jumprelu llama3.1-8b/29-llamascope-res-128k blocks.29.hook_resid_post 29 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l30r_32x
Load this SAE
jumprelu llama3.1-8b/30-llamascope-res-128k blocks.30.hook_resid_post 30 131072 1024 cerebras/SlimPajama-627B expected_average_only_in
l31r_32x
Load this SAE
jumprelu llama3.1-8b/31-llamascope-res-128k blocks.31.hook_resid_post 31 131072 1024 cerebras/SlimPajama-627B expected_average_only_in

llama_scope_lxr_8x

  • Huggingface Repo: fnlp/Llama3_1-8B-Base-LXR-8x
  • model: meta-llama/Llama-3.1-8B
id architecture neuronpedia hook_name hook_layer d_sae context_size dataset_path normalize_activations
l0r_8x
Load this SAE
jumprelu llama3.1-8b/0-llamascope-res-32k blocks.0.hook_resid_post 0 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l1r_8x
Load this SAE
jumprelu llama3.1-8b/1-llamascope-res-32k blocks.1.hook_resid_post 1 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l2r_8x
Load this SAE
jumprelu llama3.1-8b/2-llamascope-res-32k blocks.2.hook_resid_post 2 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l3r_8x
Load this SAE
jumprelu llama3.1-8b/3-llamascope-res-32k blocks.3.hook_resid_post 3 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l4r_8x
Load this SAE
jumprelu llama3.1-8b/4-llamascope-res-32k blocks.4.hook_resid_post 4 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l5r_8x
Load this SAE
jumprelu llama3.1-8b/5-llamascope-res-32k blocks.5.hook_resid_post 5 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l6r_8x
Load this SAE
jumprelu llama3.1-8b/6-llamascope-res-32k blocks.6.hook_resid_post 6 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l7r_8x
Load this SAE
jumprelu llama3.1-8b/7-llamascope-res-32k blocks.7.hook_resid_post 7 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l8r_8x
Load this SAE
jumprelu llama3.1-8b/8-llamascope-res-32k blocks.8.hook_resid_post 8 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l9r_8x
Load this SAE
jumprelu llama3.1-8b/9-llamascope-res-32k blocks.9.hook_resid_post 9 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l10r_8x
Load this SAE
jumprelu llama3.1-8b/10-llamascope-res-32k blocks.10.hook_resid_post 10 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l11r_8x
Load this SAE
jumprelu llama3.1-8b/11-llamascope-res-32k blocks.11.hook_resid_post 11 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l12r_8x
Load this SAE
jumprelu llama3.1-8b/12-llamascope-res-32k blocks.12.hook_resid_post 12 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l13r_8x
Load this SAE
jumprelu llama3.1-8b/13-llamascope-res-32k blocks.13.hook_resid_post 13 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l14r_8x
Load this SAE
jumprelu llama3.1-8b/14-llamascope-res-32k blocks.14.hook_resid_post 14 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l15r_8x
Load this SAE
jumprelu llama3.1-8b/15-llamascope-res-32k blocks.15.hook_resid_post 15 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l16r_8x
Load this SAE
jumprelu llama3.1-8b/16-llamascope-res-32k blocks.16.hook_resid_post 16 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l17r_8x
Load this SAE
jumprelu llama3.1-8b/17-llamascope-res-32k blocks.17.hook_resid_post 17 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l18r_8x
Load this SAE
jumprelu llama3.1-8b/18-llamascope-res-32k blocks.18.hook_resid_post 18 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l19r_8x
Load this SAE
jumprelu llama3.1-8b/19-llamascope-res-32k blocks.19.hook_resid_post 19 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l20r_8x
Load this SAE
jumprelu llama3.1-8b/20-llamascope-res-32k blocks.20.hook_resid_post 20 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l21r_8x
Load this SAE
jumprelu llama3.1-8b/21-llamascope-res-32k blocks.21.hook_resid_post 21 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l22r_8x
Load this SAE
jumprelu llama3.1-8b/22-llamascope-res-32k blocks.22.hook_resid_post 22 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l23r_8x
Load this SAE
jumprelu llama3.1-8b/23-llamascope-res-32k blocks.23.hook_resid_post 23 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l24r_8x
Load this SAE
jumprelu llama3.1-8b/24-llamascope-res-32k blocks.24.hook_resid_post 24 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l25r_8x
Load this SAE
jumprelu llama3.1-8b/25-llamascope-res-32k blocks.25.hook_resid_post 25 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l26r_8x
Load this SAE
jumprelu llama3.1-8b/26-llamascope-res-32k blocks.26.hook_resid_post 26 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l27r_8x
Load this SAE
jumprelu llama3.1-8b/27-llamascope-res-32k blocks.27.hook_resid_post 27 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l28r_8x
Load this SAE
jumprelu llama3.1-8b/28-llamascope-res-32k blocks.28.hook_resid_post 28 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l29r_8x
Load this SAE
jumprelu llama3.1-8b/29-llamascope-res-32k blocks.29.hook_resid_post 29 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l30r_8x
Load this SAE
jumprelu llama3.1-8b/30-llamascope-res-32k blocks.30.hook_resid_post 30 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
l31r_8x
Load this SAE
jumprelu llama3.1-8b/31-llamascope-res-32k blocks.31.hook_resid_post 31 32768 1024 cerebras/SlimPajama-627B expected_average_only_in
×