dumberquestions
10 hours ago
Tested one prompt in the playground ("Move the elephant next to the ball") and this is the generated recorded video link:
wand3r
10 hours ago
Yeah. I didn't want to be rude, because real people building things they are passionate about is a great ideal. However, it is REALLY starting to feel like 1999. There is a new paradigm with clearly amazing potential, but we do not have all the pieces in place to execute on the forward thinking ideas, much less the businesses. Just imagine if that robot arm destroyed a ton of super expensive machinery. It was an extremely fair prompt, very clear and very simple instructions. Also, 90 Million to tweak an AI model to not achieve a task in an unvalidated market? IDK if that is too harsh and I just don't understand? There is 100% chance that myself or Dream-1 is out of touch, but I am concerned I can't tell which is which.
mapkkk
8 hours ago
I tried "Make a matryoshka out of the appropriate objects" https://dreamlabs.ai/playground/?play=c3ed4d011f05ce94
Approximately the same result as your run. But it was interesting to see that the idle arm seems to have these rhythmic movements across all the prompts I saw on there. Also that one arm, the left one most of the time, is just idling.
pedalpete
8 hours ago
I wonder if the entire thing would be better if the first step was for the LLM to try to understand the final goal of the user, rather than just the simple instruction.
For instance, the LLM may have an understanding that the ball is easier for it to pick-up than the elephant (which it seemed to struggle with, which also made it a strange choice for the demo).
How much of an LLM understanding the physical limitations of the robot would help the task be accomplished in a way that satisfies the goal, without following the exact directions.
ajjenkins
10 hours ago
Interesting. It actually moved the ball next to the elephant, but I guess that accomplishes the goal of the elephant and ball being next to each other. But probably not how must humans would interpret that prompt. And it continued to move both the elephant and ball after that for some reason.
Hopefully this is like the first GPT models and it gets better over time.