Em Adespoton

  • 0 Posts
  • 15 Comments
Joined 3 years ago
cake
Cake day: June 4th, 2023

help-circle

  • If the model is just a model, a pre-trained probability seive, what difference does it make if someone is abusive? If it causes a token spike, the user has to pay for that. The abuse shouldn’t survive beyond the context window and the model isn’t wired up to “feel” or suffer.

    So is this a publicity stunt (“Our model is as intelligent and human as a real person”), or is it about social influence/normalization—they worry that if people become accustomed to abusing the prompt, that will trickle over into other social interactions?










  • Something I’ve been noticing recently is that while the cost per token on specific models hasn’t gone up, the provided interfaces for using those models are starting to chew up significantly larger numbers of tokens for the same tasks that used fewer tokens with older versions of the interface software just a few months ago. Likely the interfaces are applying more expensive guardrail prompts and charging the end user for those tokens — but the end result is that it costs 4x as much to get the same work done.