Show HN: A tool to benchmark LLM APIs (OpenAI, Claude, local/self-hosted)

55 pointsposted 7 months ago
by mrqjr

10 Comments

swyx

7 months ago

idk what it is but buying that domain made it seem more commercial and therefore less trustworthy. also most people prob want to just use artificialanalysis' numbers rather than self run benchmarks (but this is ok if want to run your own)

mrqjr

7 months ago

I honestly don't know how to make you feel credible about this project, it was just a demo site and didn't have any features that you had to pay to use, I just simply felt like I was making something that might be of some use to someone else as well.

MitPitt

7 months ago

If it was named 'api arena' everyone would eat it up

mdhb

7 months ago

In what universe is a post created by a new account with zero comments and a grand total of 2 votes over the course of 2 hours doing on the front page?

vntok

7 months ago

It's an informative post about new tech, that fits pretty well here of all places.

Why would you want the author to write about something else to validate the post? That would be an appeal to authority, which is the complete opposite of what the Hacker Manifesto has always been about in terms of ethos, goals, etc.

bdangubic

7 months ago

I am polishing up my blog about some FORTRAN code I wrote last week in hopes of the same :)

mrqjr

7 months ago

I wish I could see some of your code besides tech gossip and financial news.

user

7 months ago

[deleted]

vmeklis

7 months ago

cool idea, seems like a nice twist on the LMArena