This is a supplement to an article I wrote elsewhere, to provide the complete transcript of an interaction with ChatGPT.
I evaluated ChatGPT's performance by tasking it with real-world problems I encounter in my work as an applications engineer.
Main takeaway: ChatGPT seems to perform well in general troubleshooting scenarios, even in domains which require considerable background knowledge. Failures occur with narrow queries that require specific technical data.
ChatGPT can offer suggestions to solve common engineering issues, even regarding specific integrated circuit parts. As long as the solution space is large, it generates good recommendations for diagnosing and solving problems.
... (read 1846 more words →)You are an applications engineer working to support various products. A customer of yours writes
Yep! That's something that I wrote in my original writeup:
My last comment about "self-awareness seems to be 100%" was a (perhaps non-obvious) joke; mainly that at least it is trained to recommend that it shouldn't be trusted blindly. But even this is a conclusion that isn't arrived at via "awareness" or "reasoning" in the traditional sense — again, it's just training data and machine learning.