Raw LLM Responses

First, this kind of thing was inevitable. All tools get misused sooner or later. Second, As usual when it comes to technology that people don't understand and thus fear, the focus is being placed in the wrong place. Facial recognition is flawed and early in its development. There are some inherent biases in the software that still need to be worked out of it, for example. But that isn't the actual issue here. The actual issue is not the technology, but how the police investigate crimes. What happened here is the police fed a picture into a computer and it spit out a result. Instead of doing actual police work to determine if that result appeared to be accurate, they went and grabbed the person and then tried to make everything fit their suspect (and failing that, force a confession) instead of having a suspect that fit the evidence. I'm sure that the software only gave a 98% likelihood of a match or something at best, too. Only an idiot would ever give a 100% match even when comparing the same picture as twins exist. He probably spent 30 hours there because he refused to confess and they couldn't be bothered to check out his alibi. This is why things like a DNA database and facial recognition are dangerous. Not because the technology is flawed, but because our law enforcement and prosecution intentionally misuse them in order to get the easy win.