Ai2 makes Stage 1 byte-level checkpoints available with unchanged base weights
Ai2 has released Stage 1 checkpoints for its byte-level language models, keeping original model weights unchanged while providing pre-trained byte components. The release allows researchers to experiment with new architectures and train systems without re-running the initial stage.