Ship Harness Bench – Same prompt, same model, different harnesses

1 pointsposted 7 hours ago
by grigio
(grigio.github.io)

4 Comments

jaggs

7 hours ago

Really interesting experiment. Are there any other variables which could have been missed though?

grigio

7 hours ago

Also memory could be a thing for complex open prompts. But creativity is a mix of model, context, harness

grigio

7 hours ago

tldr: probably browser usage skill is the most important thing