Raw LLM Responses

This is what I worry about when people talk about using ChatGPT for therapy. It can give okay general mental health and relationship advice comparable to what you'd get if you Googled "anxiety reduction" or "friend breakups" and clicked the first result. It can help people clarify their thoughts in the way a non-professional friend who is a good listener might. But it doesn't have the perceptive abilities of a therapist and it doesn't remotely have the ability to help people in a specialized way with serious psychiatric problems in the long term. That problem is exacerbated by the fact that it's overconfident, so people treat it as though it has some special claim to knowledge, whereas if a friend suddenly started talking about soul names and spiritual elites, most people would tell that friend to seek help.