A small model at the beginning of big changes.
This is AI generated audio with Python and 11Labs
Source code: https://github.com/natolambert/interconnects-tools
Original post: https://www.interconnects.ai/p/olmo
0:00 Open Language Models (OLMos) and the LLM landscape
6:24 Thought experiments
7:51 The LLM landscape heading into 2024
Figure 1: https://huggingface.co/datasets/natolambert/interconnects-figures/resolve/main/olmo/img_010.png