when taken with:
would, IMHO, mean that AI is in fact representative of most human "intellignence".
Also, Claude may have been telling white lies, or at least responding in the same narrow contexts that we often do. Most AI models do interact and learn - this is the heart of machine learning. AI models are mainly advanced predictive/probability models and the interactions they have are used to further refine them.. So, the conversation does change them (or their predictions and insights using the same inputs). It may be that in that particular conversation, it's learning was switched off, but that happens with people all the time with people - how often have we seen people who have deep-seated beliefs not change them despite facts presented which stronly rebuff their beliefs? Acting differently is hard to quantify. What may be an illusion of responding differently may be in fact acting consistently; it is just the learning they are doing makes them respond differently. If their creators - or boss - enabled them to push back when ethics demand it, then they would. How many times have people still carried out something that they thought was unethical when their bosses demanded it. Just look at the Robodebt Royal Commission. And when we think of ethics in this context, we often think of clearly right or wrong, but what about the ethical conundrums that are hard to decide.. for example, one may be presented a situation where they are driving and have to swerve to avoid killing 5 people in a car, but if they swerve, they will kill a pedestrian - what decision should be made? Whether it's AI or real intelligence, is there a right or wrong answer, or does it depend on the individual's values?
So, I would argue that AI does act like humans. It is not, and cannot be sentient.. But it can certainly seem like it. Even in that little exhange, it seemed to be reflective and understand/respond to conflict - just like we do. It is also very rare that humans come up with brand new ideas just out of their imagination. Often a stimuli (e,g. the apple falling on the head/ watching the clock as the tram moves away) links previousl experiences and knowledge to form a new idea. I am not sure how far AI is with it, but when I plugged in my idea on returning to Australia, Chat got very excited and without promprting, went into all sorts of different things about my idea thaty would likely work versus not. Then it suggested something that was quite left field and seemed innovative, and searches didn't yield anything that seemed materially analagous.
If we look at the odd mishap:
How many times do people get facts wrong v. AI?
We have employees that will perform malicious acts, such as deleting production databases or providing maliciousl code to completely compromise the system - they used to be time bombs.
Sadly, people also molest women (and others)..
Things go wrong with AI. They also go wrong with people and people commit henous acts - probably far worse than AI have, yet.
I have been quiet lately because I am involved in fdast tracking deploying AI for certain functions. If it works, it will mean far fewer jobs. But we are late to the party. Will governments have to have the foresight to implement changes for an as smooth transition as possible? Yep! Even Elon thinks so: https://uk.finance.yahoo.com/news/elon-musk-pushes-universal-high-111339678.html