Handy Rails Tips

Language models in Ruby

Language models in Ruby

Talk by Gavin Morrice

ScotRUG, October 9th, 2025

Talk slides
https://slides.com/gavinmorrice/language-models-with-ruby/

Sources and references

Source code
https://github.com/bodacious/RubyLM
Attention is all you need
https://en.wikipedia.org/wiki/Attention_Is_All_You_Need
Let’s build GPT: from scratch, in code, spelled out
https://www.youtube.com/watch?v=kCc8FmEb1nY
Attention visualised
https://www.youtube.com/watch?v=RNF0FvRjGZk
Tiktoken
https://github.com/openai/tiktoken

Work with me (at Cleo)

Cleo is currently hiring, and we have remote roles available to BE (Ruby on Rails), and FE (React Native) engineers based in various countries.

/assets/images/cleo-logo.png

Follow me

Follow me on X
https://x.com/morriceGavin
Follow me on Bluesky
https://bsky.app/profile/morricegavin.bsky.social
Follow me on Github
https://github.com/bodacious
Connect on LinkedIn
https://linkedin.com/in/gavinmorrice