This is really good! It would be really cool to somehow get human designs in the mix to see how the models compare. I bet there are curated design datasets with descriptions that you could pass to each of the models and then run voting as a "bonus" question (comparing the human and AI generated versions) after the normal genAI voting round.

This is a surprisingly good idea. The model vs model is fun, but not really that useful.

But this could be a legitimate way to design apps in general if you could tell the models what you liked and didn't like.

I tried the vote and both results always suck, there's no option to say neither are winners. Also it seems from the network tab you're sending 4 (or 5?) requests but only displaying the first two that respond, which biases it to the small models that respond more quickly which usually results in showing two bad results

I never thought comparing different models could be this fun!

Generating a new image is great, but it would be even better if I could see multiple images from different models in the /feed, just to explore how other prompts look without having to generate and wait.

How about adding "mobile"? A lot of the time models tend to default to designs that don't make sense on mobile, even when instructed to design it as such.

As a UX/UI designer in Korea, I love seeing related products being released. I hope they become even more advanced in the future.

nice! Training models using reward signals for code correctness is obviously very common; I'm very curious to see how good things can get using a reward signal obtained from visual feedback

Very cool! Can the code and design that is generated be used?

interesting idea, this benchmark maps fairly closely to the types of output I typically ask LLMs to generate for me day-to-day

It would lend credibility to publish your system prompt.

The problem is, what is being taught as UI-UX is 90% hogwash, balooney, pure bullshit. And these results reflect that.

[dead]

[flagged]

[flagged]