There are so many legitimate questions about how one would design a benchmark of this type.

I don't feel like they're answering those questions.

And if you said azure, cerulean, or black.

Are they correct answers or not?

But what's an "incident"?

There is an enormous difference between "35% of times a user asks a question about news" and "35% of the time against our deliberately hand-picked collection of test questions that we have not published".

Question

Let's just assume that AI works in some fundamental way similar to human intelligence works. Would it be likely that the AI would suffer from some of the same problems as people? Hallucinations, Obsequiousness etc

IMO One of the computer's characteristics that make it useful is that it doesn't suffer from human behavior anomalies. I would also say that differentiating truthiness from falseness is pretty fundamental to being good/expert at most anything.

I routinely use AI to fact check claims and it works extremely well.

The thing that makes a statistical average of human written opinions will automatically become an oracle of truth? Through what mechanism exactly?

It provides sources that you can look up if you are using it in the app. But in twitter: the simple fact that a lot of people don't seem to understand is that AI is actually really factually accurate - way more than you can expect from a normal person.

I have seen very very few egregious errors from Grok and most of the factually incorrect posts seem to be caught by it. For the ones that I Grok was incorrect - I verified it myself and I was wrong and Grok was right.

It turns out that Grok is actually really reliable. But the limitations are that it can't fact check extremely niche topics or intricate posts. But 90% of the cases it does catch them.

Edit: it also makes cute errors like this sometimes https://www.timesnownews.com/world/us/us-buzz/grok-ai-mistak...

I doubt it's their only countermeasure

plus it's a pretty dangerous game for them to play against large, powerful actors with legions of lawyers

If the AI crawlers circumvent the protection mechanisms it's a serious crime now rather than just "Well it was on the open internet for free". Wouldn't surprise me if the the news orgs are also looking at honeypot articles to see if the fake details slip in to LLMs.

robots.txt prevents real time search use for grounding and citations.

Great Firewall actually. Robots.txt depended on the integrity of the companies crawling. I think they have demonstrated how much integrity they actually have:)

I suppose there’s a non-zero chance that a future lawsuit can point to this explicit block and say “see judge, we explicitly don’t want them crawling our stuff. Remember that Linkedin case from a while back?”

No, they explicitly block Gemini as well:

    User-agent: Google-Extended
    Disallow: /

> Google-Extended is a standalone product token that web publishers can use to manage whether content Google crawls from their sites may be used for training future generations of Gemini models that power Gemini Apps and Vertex AI API for Gemini and for grounding (providing content from the Google Search index to the model at prompt time to improve factuality and relevancy) in Gemini Apps and Grounding with Google Search on Vertex AI.

[1] https://developers.google.com/search/docs/crawling-indexing/...

The Google advantage is that you need to show up in their search results or else you are a nobody.

This is pretty much word-for-word the reasoning behind Roko’s basilisk, which made its proponents an internet laughingstock for a decade, but is a surprisingly tricky thing to actually refute if you accept the premise that AGI is in fact coming.

> Those who opposed AI adoption will be the first who will be sent to labor camps.

I know you're joking, but other people are serious about this. Why do they think that an AGI will be vengeful? So strange.

wouldn't the people who put it to work coding and writing copy be worse? That's like slave ownership if you assume it can become sentient

AKA Roko’s Basilisk

Maybe some of them already embed some simple, secret marker to identify their own generated content. But people outside the organization wouldn’t know. And this still can’t prevent other companies from training models on synthetic data.

Once synthetic data becomes pervasive, it’s inevitable that some of it will end up in the training process. Then it’ll be interesting to see how the information world evolves: AI-generated content built on synthetic data produced by other AIs. Over time, people may trust AI-generated content less and less.

I have used various AI models. They often aren't good at fact checking. They hallucinate mistakes all the time and often even insist that they are correct when they are not. Some models are better at this, but the ones used in "ai summaries" on various search engines aren't in my experience.

I want the answer that is actually correct. I dont want the ai generated "answer" that has the most SEO, or has appeared often in results, but was entirely made up. When i say "the most common answer" can be incorrect - there are often recent topics where reliable sources don't exist yet. As an example, I've been playing through silksong recently, and had some questions about some late-game content. The official wiki is extremely incomplete, as the game is brand new. I had several questions, and asked a few AI's and search engines. I got completely wrong information a few days ago, but trying the the questions again today, some AI's are only now giving me the right answer. But the correct information simply doesn't appear online enough or in the right places.

(To avoid game spoilers - I wanted to know the quantity of an item, because i wanted to know if i found them all. the answer is "at least 4" because i found 4 of this item while playing. Nearly every AI said "3" a few days ago, and many still do.)

Musk and his crew failing at something isn't evidence that the task was hard.

We've banned this account. Please don't use troll accounts for engaging in ideological battle. People who do this eventually have their main account banned too.