Guardrails Are More Than Prompt Safety
The nightmare version is easy to imagine. It is 2am. OpsGenie is paging you. A user-uploaded PDF contained instructions the model should have ignored, and now the system has produced an answer that could expose something it should not expose. Maybe that sounds dramatic. But the underlying problem is not exotic. A receipt, invoice, comment, […]
