Language models in Ruby
Language models in Ruby
Talk by Gavin Morrice
ScotRUG, October 9th, 2025
- Talk slides
- https://slides.com/gavinmorrice/language-models-with-ruby/
Sources and references
- Source code
- https://github.com/bodacious/RubyLM
- Attention is all you need
- https://en.wikipedia.org/wiki/Attention_Is_All_You_Need
- Let’s build GPT: from scratch, in code, spelled out
- https://www.youtube.com/watch?v=kCc8FmEb1nY
- Attention visualised
- https://www.youtube.com/watch?v=RNF0FvRjGZk
- Tiktoken
- https://github.com/openai/tiktoken
Work with me (at Cleo)
Cleo is currently hiring, and we have remote roles available to BE (Ruby on Rails), and FE (React Native) engineers based in various countries.
Follow me
- Follow me on X
- https://x.com/morriceGavin
- Follow me on Bluesky
- https://bsky.app/profile/morricegavin.bsky.social
- Follow me on Github
- https://github.com/bodacious
- Connect on LinkedIn
- https://linkedin.com/in/gavinmorrice