Show HN: A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)

55 pointsposted 7 days ago
by mrqjr

10 Comments

swyx

7 days ago

idk what it is but buying that domain made it seem more commercial and therefore less trustworthy. also most people prob want to just use artificialanalysis' numbers rather than self run benchmarks (but this is ok if want to run your own)

mrqjr

7 days ago

I honestly don't know how to make you feel credible about this project, it was just a demo site and didn't have any features that you had to pay to use, I just simply felt like I was making something that might be of some use to someone else as well.

MitPitt

6 days ago

If it was named 'api arena' everyone would eat it up

mdhb

7 days ago

In what universe is a post created by a new account with zero comments and a grand total of 2 votes over the course of 2 hours doing on the front page?

vntok

7 days ago

It's an informative post about new tech, that fits pretty well here of all places.

Why would you want the author to write about something else to validate the post? That would be an appeal to authority, which is the complete opposite of what the Hacker Manifesto has always been about in terms of ethos, goals, etc.

bdangubic

7 days ago

I am polishing up my blog about some FORTRAN code I wrote last week in hopes of the same :)

mrqjr

7 days ago

I wish I could see some of your code besides tech gossip and financial news.

user

7 days ago

[deleted]

vmeklis

7 days ago

cool idea, seems like a nice twist on the LMArena