Language models in Ruby
Language models in Ruby
Talk by Gavin Morrice
ScotRUG, October 9th, 2025
- Talk slides
- https://slides.com/gavinmorrice/language-models-with-ruby/
Sources and references
- Source code
- https://github.com/bodacious/RubyLM
The Hundred-Page Language Models Book https://amzn.to/3IPA0qH (Affiliate link)
The Hundred-Page Machine Learning Book https://amzn.to/4pUXA5U (Affiliate link)
- Attention is all you need
- https://en.wikipedia.org/wiki/Attention_Is_All_You_Need (Wiki)
- Let’s build GPT: from scratch, in code, spelled out
- https://www.youtube.com/watch?v=kCc8FmEb1nY (YouTube video)
- Attention visualised
- https://www.youtube.com/watch?v=RNF0FvRjGZk (YouTube video)
- Tiktoken
- https://github.com/openai/tiktoken (GitHub)
Work with me (at Cleo)
Cleo is currently hiring, and we have remote roles available to BE (Ruby on Rails), and FE (React Native) engineers based in various countries.
Follow me
- Follow me on X
- https://x.com/morriceGavin
- Follow me on Bluesky
- https://bsky.app/profile/morricegavin.bsky.social
- Follow me on Github
- https://github.com/bodacious
- Connect on LinkedIn
- https://linkedin.com/in/gavinmorrice