Hacker Read top | best | new | newcomments | leaders | about | bookmarklet login

Indeed, I pattern matched (a) as the correct answer too, but on reflection on the content of the words and what it would all actually mean, I think that (a) is a bad answer. If we aren't careful we'll train our AIs to be good at giving incorrect, pat answers to inadequately thought out questions.


sort by: page size:

Not sure what you mean. There's a viable answer that's marked incorrect. The examples should show the pattern well enough to eliminate possible wrong answers, correct?

I am curious what percentage of humans would also give the incorrect answer to this puzzle, and for precisely the same reason (i.e. they incorrectly pattern-matched it to the classic puzzle version and plowed ahead to their stored answer). If the percentage is significant, and I think it might be, that's another data point in favor of the claim that really most of what humans are doing when we think we're being intelligent is also just dumb pattern-matching and that we're not as different from the LLMs as we want to think.

Well then I did answer it correctly for me, so the question is bad. I thought there was just some way to change it that I was aware of.

I find AI answers wrong a lot of the times.

The answers sometimes refer to other answers (e.g. "A and D are true") but it's not clear which answers correspond to which letters.

What's the expected mistaken answer?

> The "right" answer here is wrong.

I assume by "right", you mean the answer given? What do you think the correct answer is?


Both answers are wrong. I didn't look at many files, and not all of them had the reasoning in them, but it was fairly easy to find examples of wrong answers based on the reasoning in the file.

Which would be some of the wrong answers?

Is the answer to question 8 simply due to the pattern of the other answers?

If you have AI answers then you get incorrect answers - why would this be good?

I bet you are right. And, it would be really fascinating to see how "right" the AI wanted to be with the candidate answers. Thinking about that has me go down a rabbit hole, wondering how my learning would be improved or impeded by the "right" wrong answers.

It is also possible that people who answered got the interpretation wrong.

I thought it was understood in this subthread we're playing a game. Yes, we all know what the intended correct answers are.

It's not a correct answer, but I can't blame the algorithm for thinking that.

I'm confused. Is the right answer or the wrong answer?

Why? it got the correct answer (guess #3 was arguably correct, albeit phrased a bit misleadingly)

Unfortunately the "best answer" is taken to mean "the wrong answer that the teacher programmed into you".

Your point is good, but in making it, you sound like an adversarial interviewer.

You and OP are actually agreeing with "the correct answer is it depends and now let's discuss context". This echoes my experience as interviewer too. It's a red flag when the candidate responds with "the correct answer". That's what OP is calling out.

I'm replying here because I get the impression you're looking for "the right answer" as you see it: "the first step is to mitigate then do root cause". You're right! But it also could be too adversarial.

next

Legal | privacy