
If the model is just a model, a pre-trained probability seive, what difference does it make if someone is abusive? If it causes a token spike, the user has to pay for that. The abuse shouldn’t survive beyond the context window and the model isn’t wired up to “feel” or suffer.
So is this a publicity stunt (“Our model is as intelligent and human as a real person”), or is it about social influence/normalization—they worry that if people become accustomed to abusing the prompt, that will trickle over into other social interactions?

Computer monitoring software should be designed and set up to monitor hardware and software, not people.
This isn’t to say that it can’t monitor people, but that shouldn’t be how it is architected.
Identity monitoring software on the other hand… that should be monitoring people, with the goal to protect their PII from unauthorized access.