Handy Rails Tips

Language models in Ruby

Language models in Ruby

Talk by Gavin Morrice

ScotRUG, October 9th, 2025

Talk slides
https://slides.com/gavinmorrice/language-models-with-ruby/

Sources and references

Source code
https://github.com/bodacious/RubyLM

The Hundred-Page Language Models Book https://amzn.to/3IPA0qH (Affiliate link)

The Hundred-Page Machine Learning Book https://amzn.to/4pUXA5U (Affiliate link)

Attention is all you need
https://en.wikipedia.org/wiki/Attention_Is_All_You_Need (Wiki)
Let’s build GPT: from scratch, in code, spelled out
https://www.youtube.com/watch?v=kCc8FmEb1nY (YouTube video)
Attention visualised
https://www.youtube.com/watch?v=RNF0FvRjGZk (YouTube video)
Tiktoken
https://github.com/openai/tiktoken (GitHub)

Work with me (at Cleo)

Cleo is currently hiring, and we have remote roles available to BE (Ruby on Rails), and FE (React Native) engineers based in various countries.

/assets/images/cleo-logo.png

Follow me

Follow me on X
https://x.com/morriceGavin
Follow me on Bluesky
https://bsky.app/profile/morricegavin.bsky.social
Follow me on Github
https://github.com/bodacious
Connect on LinkedIn
https://linkedin.com/in/gavinmorrice