peal.sparse_dictionaries.msae_decomposition¶
Wrapper around the MSAE (Matryoshka Sparse Autoencoder) release for PEAL.
Provides the pretrained CLIP ViT-L/14 MSAE from the WolodjaZ/MSAE Hugging
Face repository, together with its concept-interpreter vocabulary, as a PEAL
SparseDictionary; alternatively a plain or Matryoshka autoencoder from
the vendored peal/dependencies/MSAE code can be trained from scratch on
cached activations. The module also isolates MSAE’s bare top-level imports
(sae, utils, …) so they do not collide with RAEv2’s utils.
Classes
Sparse dictionary wrapper around MSAE (Matryoshka Sparse Autoencoder). |
|
Configuration for MSAE (Matryoshka Sparse Autoencoder) decomposition. |