Skip to content

Instantly share code, notes, and snippets.

@izabera

izabera/cube.md Secret

Created April 1, 2025 16:31
new state of the art turing test: drawing a rubik's cube

a rubik's cube looks like this

image of a rubik's cube with arrows showing the various piece types

all the possible moves will change the position of the cubies relative to each other, but none will change which pieces the stickers are attached to. so you always have:

  • 6 centres with 1 sticker each, all 6 with different colours
  • 12 edges with 2 stickers each, each with 2 different adjacent colours (4 edges for each of the 6 colours)
  • 8 corners with 3 stickers each, each with 3 different adjacent colours (4 corners for each of the 6 colours)

now let's ask some ai to draw a cube, with images generation wherever possible or with svg if text only

chatgpt

pretty cube but inaccurate

told it to fix the wrong colours, result is wrong in a different way

wrong again in a new way

claude

complete mess of an svg where faces overlap each other

told it to fix the overlaps at least, which it did, but the result is super weird

deepseek

mess of overlapping faces

the faces now cannot touch each other but these are the most cube-accurate colours i managed to get

grok

weirdly messed up 4x4-ish cube

grok pls that's not even a cube

gemini

got a weirdly broken 4x4

what

perplexity

tells me how to generate one using tools online

forcing it to do the work

disappointing result

mistral

image no worky

that's not a cube

nope

llama

that's almost a gan cube but the colours aren't quite there

again similar issue

@offsetcyan
Copy link

Keep in mind there are two "standard" cube colour schemes: western style has yellow opposite red, blue opposite green and white opposite yellow; japanese style swaps yellow and blue. This requirement would make the challenge harder.

@izabera
Copy link
Author

izabera commented Apr 1, 2025

there's also a specific standard order for the colours (e.g. in the western style you have blue-orange-yellow in a clockwise fashion), but i'm happy to consider any legal configuration in whatever colour scheme a success

@bmarshallk
Copy link

Mind including which model from each was used?

@izabera
Copy link
Author

izabera commented Apr 2, 2025

@bmarshallk the test was done shortly before posting, so whatever the latest models are at the moment

chatgpt whatever the free tier is with the latest image generation thingy that can do studio ghibli images (i think it's chatgpt4-turbo?)
claude 3.7
deepseek r1
grok 3
gemini 2.5 pro
perplexity whatever the free tier is (claims to be llama 3.1 405B when asked but maybe it has some extra smarts idk)
mistral le chat (i think there's only one version at the moment?)
llama whatever the free tier is on meta.ai

@mlebkowski
Copy link

I guess kudos to chatgpt for knowing what a cube is at least?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment