In case you think there is consciousness, intelligence or personality in an LLM [video]

3 pointsposted 6 hours ago
by spottedmarley
(youtube.com)

8 Comments

spottedmarley

6 hours ago

This video is about how Kimi K3 works but the mechanics discussed are the same across all LLMs. It is 100% all about MATH, pure and simple. Well... not simple, but pure math. No brain in there.

XMPPwocky

5 hours ago

Could you explain how this is related to "consciousness", "intelligence", or "personality"?

spottedmarley

5 hours ago

It's not, that's the point. It's all just math. You should watch the video.

XMPPwocky

4 hours ago

I think you'd benefit from explaining why something being "just math" means it can't be intelligent, conscious, or have a personality- it seems like you're sort of assuming that implicitly, could you make an argument for it?

Rotundo

4 hours ago

This is, trivially, not intelligent nor conscious:

  function add(x): return x + 1; end.
An LLM has a bit of randomness to its calculations but that does not change the fact that

  function add_random(x): return x + rand(1, 10); end
is also just math. No personality. There's nobody home. After the function ends there is no residue.

An LLM does a lot of calculations but that doesn't change how it works.

XMPPwocky

4 hours ago

Is a single subatomic particle conscious? Unless you're a panpsychist then surely no, right?

And yet humans, made of such particles, are!

So it seems like reductionism doesn't work here.

spottedmarley

4 hours ago

Surely no? So you are sure that sub-atomic particles are not conscious but math could be conscious. Interesting

XMPPwocky

3 hours ago

tbc, I'm pretty sure that both an individual subatomic particle and a NAND gate or an adder are not conscious. (At least when I'm not in panpsychist moods!)

But, in the same way that one particle not being conscious doesn't necessarily mean some configurations of many particles- like humans- aren't, one logic gate not being conscious doesn't mean there can't exist configurations of many logic gates that are.