New ask Hacker News story: Super Simple "Hallucination Traps" to detect interview cheaters
Super Simple "Hallucination Traps" to detect interview cheaters
4 by EliotHerbst | 0 comments on Hacker News.
After testing out Cluely with my team, we suspect that the easiest way to detect interview cheaters is to set simple "hallucination traps" where you ask a question that sounds plausible, but any knowledgeable person would instantly identify as a joke, fake, or just simply say they don't know. Vibe coded a simple app demonstrating the concept - https://beatcluely.com/ Here are some examples of this class of prompts which currently work on Cluely and even cause strong models like o4-mini-high to hallucinate, even when they can search the web: https://ift.tt/FISnpQA https://ift.tt/Vh01Z3G https://ift.tt/d0lk9i8 https://ift.tt/piWzte9 https://ift.tt/UET6nuR Link to the vibe-coded code for the site: https://ift.tt/VIBGq1o
4 by EliotHerbst | 0 comments on Hacker News.
After testing out Cluely with my team, we suspect that the easiest way to detect interview cheaters is to set simple "hallucination traps" where you ask a question that sounds plausible, but any knowledgeable person would instantly identify as a joke, fake, or just simply say they don't know. Vibe coded a simple app demonstrating the concept - https://beatcluely.com/ Here are some examples of this class of prompts which currently work on Cluely and even cause strong models like o4-mini-high to hallucinate, even when they can search the web: https://ift.tt/FISnpQA https://ift.tt/Vh01Z3G https://ift.tt/d0lk9i8 https://ift.tt/piWzte9 https://ift.tt/UET6nuR Link to the vibe-coded code for the site: https://ift.tt/VIBGq1o
Comments
Post a Comment