Ai2 makes Stage 1 byte-level checkpoints available with unchanged base weights

Ai2 is making new Stage 1 checkpoints available with byte-level components already trained and the original model weights left unchanged. These intermediate checkpoints stem from its recipe for retrofitting existing language models to operate over bytes.

By providing checkpoints from the end of Stage 1, Ai2 enables researchers to test new architectures and train the full system directly without repeating the initial adaptation phase.