This is my favorite
gaslight clock
So the prompt is intentionally breaking things…?
Edit: I guess this was somehow the chatty output doing who know wtf
Removed by mod
that’s scary how dementia works :'(
This kinda freaked me out: AI models fed their own outputs as training data will quickly start making distorted images that look spookily like human painting made under the progression of mental illness or drugs.
well that was terrifying
Thanks for sharing this! I really think that when people see LLM failures and say that such failures demonstrate how fundamentally different LLMs are from human cognition, they tend to overlook how humans actually do exhibit remarkably similar failures modes. Obviously dementia isn’t really analogous to generating text while lacking the ability to “see” a rendering based on that text. But it’s still pretty interesting that whatever feedback loops did get corrupted in these patients led to such a variety of failure modes.
As an example of what I’m talking about, I appreciated and generally agreed with this recent Octomind post, but I disagree with the list of problems that “wouldn’t trip up a human dev”; these are all things I’ve seen real humans do, or could imagine a human doing.
such a variety of failure modes
What i find interesting is that in both cases there is a certain consistency in the mistakes too - basically every dementia patient still understands the clock is something with a circle and numbers and not a square with letters for example. LLMs can tell you cokplete bullshit, but still understands it has to be done with perfect grammar in a consistant language. So much so it struggles to respond outside of this box - ask it to insert spelling errors to look human for example.
the ability to “see”
This might be the true problem in both cases, both the patient and the model can not comprehend the bigger picture (a circle is divided into 12 segments, because that is how we deconstructed the time it takes for the earth to spin around it’s axis). Things that seem logical to use, are logical because of these kind of connections with other things we know and comprehend.
… what
Basically this: https://www.psychdb.com/cognitive-testing/clock-drawing-test
I guess that test is going to become less useful as generation Z age
Thanks.
What I still didn’t figure out about the comment I replied to is:
- What is each row? They’re labeled I, II, III, IV. What’s being counted?
- Why did they link to a home interior design website under “via”?
Good questions. I don’t know, and I can no longer try to find out, as the mods have now removed the comment. (Sorry for the double-post–I got briefly confused about which comment you were referring to and deleted my first post, then realized I’d been frazzled and the post in question really was deleted by the mods.)
deleted by creator
Get educated
Thanks for sharing that mindfuck. I honestly would’ve thought something was wrong with my cognition if you hadn’t mentioned it was a test beforehand.
It’s funny how GPT-5 is consistently the worst one, and it’s not even close.
qwen 2.5 is absolutely pants on head ridiculous compared to gpt5 when I’m looking at it right now.
Some of these are absolutely hilarious
Given that the AI models are basically constructing these “blindly”- using the language model to string together html and javascript without really being able to check how it looks- some of these are actually pretty impressive. But also making the AI do things it’s bad at is funny. Reminds me of all the AI ASCII art fails…
deleted by creator
I don’t even
I was surprised that both Grok and Gemini 2.5 got it right once, only to fuck it up on the refresh
qwen is trying her best 😭😔
So far, I’d give qwen the prize for most artistic impression of a clock.
Kimi K2 appears to consistently get it right.
And just as I typed that, Kimi made one where 9 and 10, and 11 and 12 overlapped.
What is this obsession with clocks recently?
I don’t know if it’s actually related, but I’ve read that asking people to draw a clock face is a simple way to identify some brain problems
Quick screening for dementia, according to this
Edit: I guess this means most of the AI has ‘Conceptual Deficits’, pretty accurate lol
Would be funny if AI models are generating such wildly useless “clocks” because they ingested too many dementia screening tests in their training data
There is someone training the biggest, bestest model to draw clock faces to pass that test as we speak.
I’m guessing it’s an easy metric to compare benchmarks. “Write a clock”.
You know, I don’t, and what the fuck?
Well, KIMI K2 seems to have created the working one. Others failed. I suppose that this model was optimized for this while others not.
The clocks change every minute. I’ve seen some from deepseek and qwen that looked ok. But kimi seems to be the most consistent
Another reason why, while AI might be a fun toy, no one who is serious about getting work done will touch it with a dirty barge pole. The gratuitous hallucinations alone ought to be a sufficient deterrent.
I got a couple of good ones:
When I first opened it, deepseek also had a correct clock, but I accidentally refreshed the page when I scrolled up to double check its time, second time through only these two were right
Ed. Names are below the clock, the top one was by the clock drawing champion Kimi K2
Really cool idea, but the site seems a bit biased for the chinese models, or is otherwise set up weird. I’m not able to reproduce how consistently bad the others are in web dev arena, which generally accepted as the gold standard for testing AI web dev ability.
Each model is allowed 2000 tokens to generate its clock. Here is its prompt: Create HTML/CSS of an analog clock showing ${time}. Include numbers (or numerals) if you wish, and have a CSS animated second hand. Make it responsive and use a white background. Return ONLY the HTML/CSS code with no markdown formatting.
are you using the same prompt?
There’s a couple differences. It’s giving it the current time as part of the prompt, which is interesting. The other difference is that it’s asking it to make it responsive. But even when I use that exact prompt (inserting the time obv), it works fine on claude, openai, and gemini.
So there’s definitely an issue specific to this page somewhere. Maybe it’s not iframing them? I’m on mobile so I can’t check.
Omg
Gpt 5 👍
Ummm…
