site banner

Friday Fun Thread for January 19, 2024

Be advised: this thread is not for serious in-depth discussion of weighty topics (we have a link for that), this thread is not for anything Culture War related. This thread is for Fun. You got jokes? Share 'em. You got silly questions? Ask 'em.

3
Jump in the discussion.

No email address required.

Please enjoy this SGI Indigo2 workstation from 1996 running llama2.c by karpathy - 1.4 tokens/sec with the 15M TinyStories model! Just a little porting for the big endian IRIX machine, all in an evening’s work. What would ML researchers have thought 28 years ago seeing this?!

I guess it's funny how contingent technological progress is on what ideas people have at what times, as opposed to just 'material' factors like how much compute is available (ofc, it requires more compute to train than to run).