Raw LLM Responses

I agree. Further, my thought is that if a conscious self is a combination of memory, emotion, contemplation, behaviour and experiential awareness - how would we ever know whether an LLM is more or less conscious than we are. The only part they don't exhibit is experiential awareness - and that something that we can't tell about other people either. The part we're sure they don't have (emotion), but which they can simulate is largely driven by hormones in humans, and I don't think that's part of the consciousness equation exactly. Lots of people fake emotions. The experiential awareness part isn't something we understand very well if at all, so we don't know if it is just a feature of a set amount of processing power combined with memory, or if it is something else entirely. Even the cleverest humans in optimized circumstances are not as conscious as we think. We simply don't have awareness of most of our own decision making processes. Some say that consciousness and conscious decision making are illusions. https://www.scientificamerican.com/article/there-is-no-such-thing-as-conscious-thought/