cdurth
2 days ago
I tried the Fugu models with some real world tales in C# and unity using mcp and open code. I exhausted the $20 plan 5 hour window in one prompt to review my theme system and plan some color changes. So I upgraded to the $100 to see the implementation and result. Well the result was worse than Opus, incredibly slow, and I ended up exhausting the new 5 hour window and have used 35% of the weekly now and it hardly created something opus was able to do at a fraction of the time and cost.
Do what you wish with this info, but it seems to be a complete waste of $$.
ezoe
a day ago
Because Fugu is not an independent model. They just use multiple existing SaaS models from OpenAI, Anthropic etc in background, gather response and generate results based on these response.
They claims that combining the results of multiple AI models and generate final result by using their in-house proprietary model improve the quality than using the single backend model.
It cause all sorts of doubts like: is their in-house model really exists? Is their in-house model really capable?
Personally, even if their claim is correct, such feature can be easily implemented in client side like Claude Code etc, using the equally capable model from background model to generate the final result.
I smell something fishy on their service.
GTP
a day ago
I saw something similar on openRouter.
OsrsNeedsf2P
2 days ago
We provide a similar service for Godot instead of Unity, and 20$ plan being exhausted in one prompt on a top model like Opus sounds about right. That's the life when you pay API prices and can't afford 10x subsidies.
cdurth
a day ago
Not sure if you meant Fable/Mythos instead of Opus, but I can comfortable work several hours a day using Opus on Max-Ultracode on the CC 10x.
Zababa
5 hours ago
Yes because you don't pay API costs with the Claude Code plans.
rtpg
2 days ago
Is this true even for more targeted prompts that aren't about looking over an entire codebase or w/e? I just stick to my sub pricing and find good success on targeted requests, but I wonder if I would run up against things even then if not for subsidies.
delusional
a day ago
One prompt might be a bit much, but experience shows that $20 is roughly 3 or 4 context windows on GTP-5.5
user
2 days ago
zzleeper
2 days ago
I tested Fable through Cursor; asked for ideas on how to make a data website I have less "Claude-like" (IYKYK what are the usual tells), and it spun out the most useless, Claude-like CSS styling ever, wasting $40 in 10 minutes.
The website was created through Opus, so you could also say the results were worse than Opus. (This is just to say that I had the same experience using the US models, so perhaps those Asian models are Mythos-like lol)
cheema33
2 days ago
> I tested Fable through Cursor;
I tested Fable for a whole day. And my experience was quite the opposite. I was blown away. Admittedly, I did not try it through a middleman like Cursor. I used Claude Code CLI.
josephg
2 days ago
Me too. It’s output was fabulous. And it acted like a senior engineer - actually coding up hypotheses, testing them, finding problems and presenting good, usable recommendations backed by solid evidence and wisdom. It can probably do most of my job, which gave me a bit of an existential crisis.
I’ve paused my Claude subscription until they bring it back. Opus makes mistakes constantly, on every level of abstraction. Every time I look closely at its work I find problems.
solenoid0937
a day ago
I also felt that Fable was mindblowing.
nonethewiser
2 days ago
If you actually give it an example of the style it can copy it well. even just screenshots of other websites or UIs. It just sucks at producing it itself.
addandsubtract
2 days ago
Why would the model know what "Claude-like" is?
valleyer
2 days ago
Well, in part because the phenomenon has been discussed on Web forums that (a) have at this point made their way back into training data and (b) are accessible in Web searches that the model can invoke. And in part because the model can "know" what its initial instinct is and "decide" to go against it.
jazzyjackson
2 days ago
Still it’s like asking an image generator to produce an image without an elephant. Just tell it what you want.
ninjalanternshk
2 days ago
It’s like saying “make this bad animal drawing look better, and like someone else made it” without telling them what animal was supposed to be.
ninjalanternshk
2 days ago
Yeah this is about the worst way you could imagine to evaluate an AI model.
If you’d given it a real task you’d have been impressed.
I was floored by the day I spent with Fable. Got weeks of work done.
LarsDu88
2 days ago
Which unity mcp do you use? I've been playing around with the official one, but was wondering what other folks use.
Ran into a package conflict issue with the popular coplay one
cdurth
a day ago
I have been using the coplay MCP for Unity.
Bombthecat
2 days ago
Same experience with web search / research, it was bad compared to opus.
Missed half the stuff the other half was outdated/ didn't verify.
hmokiguess
2 days ago
I experienced the same exact thing, however, I will say that I had misconfigured it on `pi` at first.
I was using its chat endpoint not the responses with tool calling and everything, and I haven't tried it again since, learned that recently and I am planning on giving it another shot.
pranaym
2 days ago
This is useful info. For the couple of days that Fable was live - it was clearly a step above Opus 4.8 and I was able to get 8-10 prompts in using my $20 plan.
zobzu
2 days ago
thata what i usually expect. its all as good as the top 3 u til you try em and then theyre.. just ok at best
achow
2 days ago
[dead]