Introduction to Training The Sparse Autoencoder
Let's dive into the details surrounding Training The Sparse Autoencoder. This has been my favorite video so far to make! I think interpretability is so important both in terms of ensuring safe AI and also ...
Training The Sparse Autoencoder Comprehensive Overview
Warning: This is an ad-libbed talk, and I'm sure I got some facts wrong. This is a talk I gave to my MATS 9.0 Sparse Autoencoders Slides: https://jinen.setpal.net/slides/sae.pdf.
A BatchTopK SAE
Summary & Highlights for Training The Sparse Autoencoder
- I hope you enjoy :) ===Summary=== "Applying
- Implemented following this exercise: http://deeplearning.stanford.edu/wiki/index.php/Exercise:Sparse_Autoencoder
- Stanford CS294A
- ... transformer with sparse auto encoders * https://arxiv.org/abs/2504.08729 Negative Results *
- Sparse Autoencoders
That wraps up our extensive overview of Training The Sparse Autoencoder.