Interesting Paper Exploring Prompt Injection
Schneier on Security·
Originalartikel lesen bei Schneier on SecurityThis is a fascinating explotation of how LLMs fall for prompt injection attacks. It turns out that they learn to recognize the style of text in different role/instruction blocks, and not just the tags. Their conclusion: Role tags were a formatting trick that became the security architecture and the...
Themen
Uncategorized