pip package that includes common pytorch modules and algorithms. as well as tokenizer, training and testing functions, and scripts to download latest models. also include mech interp paper implementations.
rl algos, other language algos, CNN for vision, basic algos like decision trees
redo training step. make it not skip so many batches before starting. and make it take a specific forward function. not too specific to transformers.