I love to show that kind of shit to AI boosters. (In case you’re wondering, the numbers were chosen randomly and the answer is incorrect).
They go waaa waaa its not a calculator, and then I can point out that it got the leading 6 digits and the last digit correct, which is a lot better than it did on the “softer” parts of the test.
Well, it did reach for “I double checked it, I’m totally sure now” language.
From the perspective of trying to convince the top brass that they are making good progress towards creating an artificial psychopath - not just an artificial human - it’s pretty good.