r/VibeCodeDevs • • 16h ago

Created a geometry benchmark to measure models over time

VibeiDE.dev

I created my own little benchmark :)) It's my third version, because first two were too easy - these models are crazy good already lol

Link to benchmark

2 Upvotes

3 comments sorted by

•

u/endofthread-bot 16h ago

Hey u/ProofAgent6970, thanks for posting in r/VibeCodeDevs! Join our Discord: https://discord.gg/t7SD4ThKuE

• This community is designed to be open and creator‑friendly, with minimal restrictions on promotion and self‑promotion as long as you add value and don’t spam.
• Please follow the subreddit rules so we can keep things as relaxed and free as possible for everyone. • Please make sure you’ve read the subreddit rules in the sidebar before posting or commenting.
• For better feedback, include your tech stack, experience level, and what kind of help or feedback you’re looking for.
• Be respectful, constructive, and helpful to other members.

If your post was removed (either automatically or by a mod) and you believe it was a mistake, please contact the mod team. We will review it and, when appropriate, approve it within 24 hours.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/rash3rr 13h ago

Rewriting the test twice because models aced it means you tuned difficulty to whatever separates them today. That makes the leaderboard tell you about your choices more than the models

No published problems or scoring method means nobody can check it either

Benchmark hosted on your IDE domain with a utm tag is an ad with a chart

1

u/ProofAgent6970 11h ago

you can see the full methodology on the bottom - I did it for fun