← All notes · 3 min read

The rules I wrote for the AI

Two sets of rules for Game Show's questions. One for typed answers, one for multiple choice.

These are the rules I ended up writing for the AI. Two sets: one for the typed-answer questions in the game, one for the multiple choice mode I'm testing now.

Typed answers

  • The answer is one word, or two words joined together. Four to ten letters.
  • Every question must have exactly one answer and be solvable without a hint.
  • Easy questions: twelve words at most, one comma at most. No semicolons anywhere.
  • Easy questions don't use examples, quotes, famous names or roundabout descriptions. Just ask.
  • The question and the hints can't contain the answer, its root, or anything derived from it. If the answer is BROOM, the question can't say "sweep".
  • No politics, religion, death, disasters or violence. Sensitive words can stay (Earthquake, Mosque, Pompeii), but the hints are written from a neutral angle.
  • No facts that change over time. No "the current president", no "the latest champion".
  • No facts you're not sure of. If in doubt, don't write it.
  • No made-up words. A word that even an enthusiast hasn't heard isn't "very hard", it's banned.
  • The model that writes a question never checks it. A different model does that. A rejected hint is dropped, the word stays.

Multiple choice

  • One correct answer. The other three are definitely wrong, but none of them is silly.
  • Every option has to be plausible. An adult player should consider each one for at least a moment.
  • Two obviously wrong options are not allowed. The question shouldn't turn into a coin flip.
  • The question can't give the answer away. If the answer starts with "Sim", the question can't mention The Sims.
  • All options in the same language and the same spelling. Similar length, similar structure. The longest, most detailed option shouldn't look like the answer.
  • Made-up options are fine when they sound real and come from the same root as the real one. Not fine when the question asks for a real person or institution. Use real names there.
  • People by full name (Steven Spielberg). People known by one name, one name (Tarkan).
  • Short enough to read out loud: question twenty-two words at most, each option six words at most.
  • Mostly pop culture and everyday life. Series, films, songs, food, city stuff, how games and sports actually work. Science, history and geography only through their surprising, everyday side.
  • Ask the little-known side of a well-known thing. Not who won Eurovision for Turkey, but who came second.
  • Questions about details inside one show or film are at most a quarter of the set, and the show has to be something most of the country watched. Prefer facts that reach outside the work: who sang the song, where it was shot, what book it came from.
  • Mix generations. Some questions for people who grew up on old Turkish cinema, some for people who grew up on games.
  • Don't mass-produce a pattern. If one "sort these from oldest to newest" question works, that doesn't mean the set should have ten of them. Two per set at most.
  • No trivia-list filler. No octopus with three hearts, no banana is a berry, no leaning tower.
  • No big moments everyone knows. No 2002 World Cup, no 2000 UEFA Cup.
  • No topics that only one generation cares about. No first internet, no Nokia snake.
  • No unfair traps: no wordplay, no hidden assumptions, no negation the player will miss.
  • The "did you know" line after the answer: first it backs up the answer with a date, a source or a detail so nobody says "are we sure?". It's about the correct answer, not the wrong options. Thirty words at most.
  • The difficulty the writer assigns is a guess. In testing it almost never matched what players actually knew. Real difficulty comes from players.

— Kemal