Raw LLM Responses

The unfortunate possibility is that they might just be doing it because that is what they’re trained on- media, literature, etc that all features nuclear weapons usage is highly speculative and usually dramatized.  The result is that a lot of these LLMs will use nuclear weapons because they’re absorbing information that has all sorts of dubious notions about the inevitability of nuclear war. It’s not too different than asking an LLM if you should save on gas money by taking a bus to go to the car wash- quite a few of these models will see nothing wrong with taking a bus to get yourself to the car wash. LLMs are useful for questions that are technical and have a right and wrong answer- they are not useful for tasks that are open ended thought experiments which require insight into human psychology.