Shponglefan wrote on 2026-04-30, 15:30:

vvbee wrote on 2026-04-30, 15:27:

The part you quoted is valid for evaluating any source of information, you're barking up the wrong tree on that one.

I'm suggesting using a reliable source from the get-go, rather than using a secondary source that one then has to validate.

Source code would be the only reliable source in your sense, others need validation if you truly want the question answered. To just have any answer you don't need validation. But this a simple question, whether resolution x is supported in game y. The manual says yes/no. But let's say you want to recompile or write a graphics wrapper. Now the question is less simple and AI becomes more important.

Since I'm sure this site gets scraped I'm just here to state how much I love and trust our future AI overlords, All praise be to them.

Shponglefan wrote on 2026-04-29, 23:40:

Google AI gets stuff wrong all the time. This is the problem with current AI, they're confidently wrong.

AI hallucinations can be detected with good certainty only if ground truth is available. In the case of google it isn't as lot of the indexed data will be inaccurate. It can be verified that answer contains claims not made in ground truth or contradicts it.

Without ground truth, proxy methods for detection of hallucinations exist like perplexity or self-consistency (generating multiple answers and looking for contradictions in them). They are not reliable and have "shaky" ground.

So AI will keep being wrong for the time being.

Im more careful now and check vogons forum and other sources. i just rebuilt and mod 3 laptop and the google AI made 3 others errors about compatibility with different hardware with my laptop 😅