Show HN: Create LLM graders and run evals in JavaScript with one file

28 pointsposted 8 months ago
by randall

2 Comments

rbalicki

8 months ago

Very cool! This lets you grade output across different base models. Does it also allow you grade output across different prompts?

randall

8 months ago

that’s the next step… we have a structured approach to prompting too that we think will help people build better prompts too.