Olmo by Ai2

About Olmo by Ai2

Olmo is a fully open language model developed by Ai2 that provides complete access to its model flow. Its variants, namely 32B-Base, 32B-Think, 32B-Instruct, 7B-Base, 7B-Think, and 7B-Instruct, deliver different levels of efficacy in areas such as programming, reading comprehension, mathematical problem-solving, and complex reasoning. The various iterations of the model cater to different use-cases, including multi-turn dialogues, tool usage, and RL research. Emphasizing transparency in AI development, Olmo's model flow describes the life cycle of the language model from data sourcing to final application. This includes the details of its preprocessing data, mid-training data, and post-training data. Additionally, its development asserts the usage of open-source tools such as OlmoCore for training framework, Duplodocus for de-duplication, and Datamap-rs for large-scale data cleaning. The model also provides a utility for reproducible evaluations in the form of OLMES. In terms of performance, Olmo has proved to be a significant resource with its outputs being used in areas like clinical text analysis and studies into learning dynamics and scaling behaviors.