abtinf
6 hours ago
From the FAQ… doesn’t seem promising when they ask and then evade a crucial question.
> What is the memory bandwidth supported by Ascent GX10? AI applications often require a bigger memory. With the NVIDIA Blackwell GPU that supports 128GB of unified memory, ASUS Ascent GX10 is an AI supercomputer that enables faster training, better real-time inference, and support larger models like LLMs.
Youden
3 hours ago
They seem to have another FAQ here that gives a real answer (273GB/s): https://www.asus.com/us/support/faq/1056142/
fancyfredbot
3 hours ago
They have failed to provide answers to other FAQ as well. The answers are really awkward and don't read like LLM output which I'd expect to be much more fluent. Perhaps a model which was lobotomized through FP4 quantisation and "fine tuning" on one of these.
LeifCarrotson
6 hours ago
It sounds good, but it ultimately fails to comprehend the question: ignoring the word "bandwidth" and just spewing pretty nonsense.
Which is appropriate, given the applications!
I see that they mention it uses LPDDR5x, so bandwidth will not be nearly as fast as something using HBM or GDDR7, even if bus width is large.
Edit: I found elsewhere that the GB10 has a 256bit L5X-9400 memory interface, allowing for ~300GB/sec of memory bandwidth.
tuhgdetzhh
4 hours ago
For comparison, the RTX 5090 has a memory bandwidth of 1,792 GB/s. The GX10 will likely be quite disappointing in terms of tokens per second and therefore not well suited for real-time interaction with a state-of-the-art large language model or as a coding assistant.
guerrilla
4 hours ago
It doesn't sound good at all. It sounds like malicious evasion and marketing bullshit.
exe34
4 hours ago
It gives you a very good idea of the capability of the models you'll be running on it!
guerrilla
4 hours ago
It doesn't give a good idea of anything. We already know it has 128GB unified memory from the first bullet point on the page.
darkwater
4 hours ago
GP was subtly implying that the text was written by an LLM (running in the very same Ascent GX10).
guerrilla
2 hours ago
Ah! Thanks for explaining. haha
BikiniPrince
4 hours ago
With a little tinkering we can just have the AI gaslight us about it’s capabilities.
epolanski
4 hours ago
I think the previous user made a joke about LLMs spewing nonsense on top of AI bs thus this product being quite fitting.
curvaturearth
4 hours ago
Written by a LLM?