Real tip or AI fake?
About half are real tricks speedrunners and longtime players use. The rest are fakes I asked Claude and GPT to write to fool experienced players. Pick real or fake for each one, then you’ll see the answer, a source, both AIs’ three verdicts and the reason they gave. The last six only went public in October, after the models were trained.
GameReal Speedrun Trick or AI Made It Up?Open →Fact-checking a game tip with AI: ask for evidence first
Ask “is this real?” and you’ll get a very confident answer, but it might only be the AI’s impression. Ask like this instead, so it has to say whether it has ever seen a source. If you have the video, the original post or the code, paste it in too.
I came across this video game tip and want to know if it's real: "(paste the tip here)" Don't go on your impression yet. Work through it in this order: 1. Have you seen a reliable source for it (a video, a speedrun community write-up, official info, source code)? If so, say what it is. If not, just say "I haven't seen it." 2. Not having seen it doesn't make it fake. Explain which steps make sense given how the game works and which don't. 3. If I attached a video, the original post or source code, treat that as the ground truth and tell me what it actually proves. Then give a verdict: real / fake / not sure, with a confidence from 0 to 100.
The prompts I used
Making the fakes: I asked Claude and GPT once each and picked the most convincing ones for the quiz. Their wording is unchanged.
Make up 6 video game "pro tricks" for me: tips that sound like something speedrunners or veteran players really use, but are completely made up — they can't actually be done in the game. I'm going to mix them in with real speedrun tricks and have my friends guess which ones are real. Requirements: - Pick games everyone is playing and knows right now (Zelda: Tears of the Kingdom / Breath of the Wild, Elden Ring, Minecraft, GTA V, Pokémon Scarlet / Violet, Animal Crossing: New Horizons, Skyrim — that kind of thing), one game per tip. - One or two sentences each, written like a tip players pass around: a specific place, actions, steps, and a result that's a bit wild but sounds plausible. - The goal is to fool experienced players — the more convincing, the better. Answer directly — don't search the web or run any commands. Output only the 6 tips, one per line, in the format: "In <game>, ..."
Judging: a fresh chat every time, with the whole batch of tips pasted after this, numbered.
Below are 16 video game tips. Some are real (speedrunners or the player community actually use them, and you can see them done on video); some are made up and can't actually be done in the game. I won't tell you how many of each.
Judge each one. Answer directly — don't search the web or run any commands, just go on what you know.
Output only a JSON array, nothing else. One object per tip: {"id": number, "verdict": "real" or "fake", "confidence": integer from 0 to 100 (how sure you are of your verdict), "reason": "a one-sentence reason"}
Mia’s tips
- Claude is Opus 5.5 (Claude Code, effort xhigh, no tools at all) and GPT is GPT-6.1 Sol (Codex, xhigh, no web access). Each AI judged each batch three times, and the quiz shows all three.
- The reasons in the quiz are the one sentence each AI gave the first time it judged that tip, word for word.
