How information theory saved my word game

19 pointsposted 3 days ago
by jamwise

22 Comments

Michelangelo11

4 hours ago

> Marshall McLuhan gets the credit for the medium is the message, but Claude Shannon had beaten him to a colder version of it years earlier: to a machine moving your words, the meaning doesn’t matter at all; only the medium does, and which of its signals can be told apart. Bravo and Delta survive a bad line; B and D don’t.

> I didn’t arrive there as a mathematician; I’m not one.

> This wasn’t a speed problem I could optimise away. It was a wall, and it asked a question I couldn’t answer

Very strong LLM whiff. A line of thought that constantly, constantly turns back on itself, negating and doubting and qualifying in one way or another, is the biggest tell (the classic "It's not X, it's Y," is only the baldest example).

Noticing that whiff instantly turns me off from reading on.

stavros

3 hours ago

> This wasn’t a speed problem I could optimise away. It was a wall

jamwise

3 hours ago

Well it certainly was a wall. That's how I kept describing it to my partner, I was hitting a wall.

stavros

3 hours ago

Yes but I'm fairly sure you didn't use the words "this isn't a speed problem. It is a wall" when talking to your partner.

I liked the post, I just don't like Claude writing every article I read, just like I didn't like every website I visited looking like Bootstrap.

freehorse

an hour ago

> Yes but I'm fairly sure you didn't use the words "this isn't a speed problem. It is a wall" when talking to your partner.

I am not afraid of a future where people use llms to write. I am afraid of a future where people adopt themselves the writing style of llms because that's all they ingest.

Oops

jamwise

3 hours ago

Yeah that's fair. I might dust off my draft and re-edit myself, I foolishly thought this would lead to a better post, and I guess am not as attuned to the AI smell as others.

tapland

3 hours ago

That's fair. When you start to notice the smell, it reeks. Put some time into it, it doesn't have to be perfectly worded, it will be a fun read

Michelangelo11

3 hours ago

I agree, and I'm completely sure it will be better than this, so long as you say just what you want to say.

busymom0

2 hours ago

A few hours ago, on another post, I had someone explain/teach me why another article may be written by LLM and they pointed out the "It's not X, it's Y" thing. Since I read that comment, I instantly picked that up in this post article too.

https://news.ycombinator.com/item?id=48739555

throawayonthe

an hour ago

which really sucks, because it's a good structure for emphasis in some limited situations, but now human writers that use it correctly get accused of being LLMs

jamwise

3 hours ago

Sorry about the turn off ¯\_(ツ)_/¯ I tried to put my best foot forward by reading about prose, engaging story telling, and did use an LLM to help me edit and reword parts of the post. Either way, I appreciate the feedback.

terabytest

3 hours ago

I have the feeling that this article was hurt rather than helped by being written using LLMs. It was really hard to follow, and even though I read it hoping to learn something new, I left feeling more confused than when I started. The feeling while reading was that the prose was trying to hold my hand but had absolutely no empathy for the build up of my understanding over the article. It’s a bit like when, as a child, you’d do homework with your parent and the parent would start saying “don’t you see how it’s obvious that 25/5=5” with no further explanation and a building tone of frustration.

jamwise

3 hours ago

Seems like others feel the same. I guess getting an LLM to help with editing was a bad choice. Thanks for the feedback.

mental_block

14 minutes ago

Even ignoring the llm-speak, the game is frustrating. I love the concept but the puzzle uses archaic words and there is no hint or a way (like sudoku) to enter in guesses (yes I know I can take out a pen). At least, I'd suggest the author to do these puzzles daily and then put some difficulty ranking so people know to manage expectations. Tough words are fine but this game is just slightly obtuse in its approach.

It's cool that llms are helping but there is a genuine "human" element of game design which needs various iterations even when you have the mechanic down.

Nice job OP on bringing this concept to life though!

frostpine

27 minutes ago

For the game, I dont like the hashed/greyed out squares. Looks like its trying to be a black square in a crossword, but it is actually just a hidden letter? Maybe there is a different way to obscure the letter?

jamwise

12 minutes ago

Thanks for the feedback. The premise of the game is you solve each individual word in order, so greyed out cells are places that aren't the next letter for any of the words right now. As you place the letters those cells open up.

jamwise

3 days ago

Information theory has been a really fascinating topic to get more acquainted with. Not really related to the crossword, but I highly recommend 3Blue1Brown's video "Compression is Intelligence", https://www.youtube.com/watch?v=l6DKRf-fAAM

yepyoukno

3 days ago

Compression is not intelligence.

While intelligence and compression both may have similar goals (to optimize paths of information), intelligence negotiates probability (allowing multiple divergent outcomes) while compression requires an idempotent symbolic translation.

nl

3 hours ago

> intelligence negotiates probability (allowing multiple divergent outcomes) while compression requires an idempotent symbolic translation.

What does this mean?

Lossy, non-deterministic compression is a thing. Does that meet the "allowing multiple divergent outcomes" criteria?

jamwise

an hour ago

EDIT: I used an LLM as an editor, and clearly that stank. So I just touched up my original draft and updated the page.

avvt4avaw

2 hours ago

This is impossible to read as every other sentence sounds like it was written by an LLM. I had to stop after a few paragraphs.

plasticeagle

3 hours ago

Jesus Christ another AI slop post. I give up. Have the internet you fools, enjoy the world of shit you've created.

This might even have been an interesting journey if it had been REMOTELY READABLE.