@thasero's banner p

thasero


				

				

				
0 followers   follows 0 users  
joined 2022 September 05 00:40:56 UTC

				

User ID: 310

thasero


				
				
				

				
0 followers   follows 0 users   joined 2022 September 05 00:40:56 UTC

					

No bio...


					

User ID: 310

I've been experimenting with LLMs (as one does, these days) and trying to solve a particular problem: Prepping to run a game of Starfinder 2E. It's working quite well!

The problem with asking an AI about any RPG is that it will confuse the details with every other RPG, and easily hallucinate answers that don't belong to any game at all. The solution: Have the AI extract the content of the Starfinder books (as their digital PDF versions) into Markdown files, i.e. text with annotation. Then give the AI specific rules that it must refer to the extracts for any rules question.

This required some testing to refine - a set of evals that determine whether the AI is getting confused, and why. It's one of the places where an AI can effectively bootstrap itself; I could bring up the common problems with getting an AI to understand a specific RPG, have it write the skill files and evaluations, get advice on which kind of evaluations are useful, have it run the tests and determine if the answers were satisfactory, etc.

But the end result is a project where I can pose a question like, "My level X party is going through an adventure where they fight an enemy necromancer; how much treasure should they get during this part, and can you suggest some treasure that's specifically necromancer-themed but still useful to the party's soldier?" Some follow-up work got me a skill where I can give a brief on a kind of creature I want to homebrew, and it will draft out a couple of options. It saves a huge amount of time and bookkeeping to have approximately-correct stats and abilities, and I can then edit the results up to my standards before inflicting it on my players. Although the average enemy it brainstorms isn't very exciting, sometimes it will borrow an ability I hadn't considered or pick a theme from the book that I can work with. The AI doesn't have taste, but I do, so I can read several proposed monsters and say, "Actually, creature 2 has a cool ability - let's make it acid instead of lightning, and splice it onto creature 4, because that one fits in the adventure better..."

For next week: Formatted handouts for my players in their first starship combat; the book that includes rules for starship combat just came out, and they'll be blasting off. I plan to have handouts for the ship itself and each battle station, so a player whose character sits at the pilot's console can get the handout just for piloting actions, and the players can trade sheets when their characters switch stations.