Raw LLM Responses

Inspect the exact model output for any coded comment.

Comment
They state that they gave the instruction "the code only" but GPT decided to add the markdown quotes and additional explanations on multiple occasions? This does imply that GPT is less compliant with requests and does not follow the users prompts as closely. I don't see how "their tests don't work" here lol. Yeah the code might be right, but if (like they say in the paper) you use chatGPT as a code generator in a pipeline, you now have to have an additional parser that checks for python markdown and other text and deletes it. Is this a minor change that does not change code quality? Probably yes. Does it decrease performance in a production environment? Absolutely. The test is valid. You just dismiss these changes because they do not seem important to you and your use of ChatGPT. edit: typo
reddit AI Harm Incident 1689776098.0 ♥ 12
Coding Result
DimensionValue
Responsibilityai_itself
Reasoningconsequentialist
Policynone
Emotionindifference
Coded at2026-04-25T08:33:43.502452
Raw LLM Response
[{"id":"rdc_jslc385","responsibility":"ai_itself","reasoning":"consequentialist","policy":"none","emotion":"indifference"},{"id":"rdc_jslo95t","responsibility":"none","reasoning":"deontological","policy":"none","emotion":"outrage"},{"id":"rdc_jsm370w","responsibility":"company","reasoning":"consequentialist","policy":"none","emotion":"frustration"},{"id":"rdc_jsmea4a","responsibility":"company","reasoning":"virtue","policy":"none","emotion":"outrage"},{"id":"rdc_jsk7i6o","responsibility":"none","reasoning":"consequentialist","policy":"none","emotion":"indifference"}]