What AI says about LLEMMA

EleutherAI/math-lm is an open-source project that hosts data, training code, and submodules for developing mathematics-focused language models. It centers on Llemma, an open language model for mathematics, with model variants (7b, 34b) and associated datasets like Proof-Pile-2 and AlgebraicStack. The repository includes submodules for related experiments (overlap, fine-tuning, theorem proving) and evaluation tools, enabling researchers to train, evaluate, and deploy math-oriented language models.