Incrementalism: Difference between revisions
Created page with "== '''Incrementalism ''' == '''Short Description:''' Attacker gradually adjusts conditions to avoid notice by the target. <br> '''CAT ID:''' CAT-2022-312 <br> '''Layer:''' 8, 9 <br> '''Operational Scale:''' Strategic <br> '''Level of Maturity:''' Well-Established <br> '''Category:''' Exploit <br> '''Subcategory:''' <br> '''Also Known As:''' <br> == '''Description:''' == '''Brief Description:''' <br> '''Closely Related Concepts:''' <br> '''Mechanism:''..." |
|||
| Line 21: | Line 21: | ||
'''Brief Description:''' <br> | '''Brief Description:''' <br> | ||
'''Closely Related Concepts:''' | '''Closely Related Concepts:''' Incrementalism has some interesting parallels with many-shot jail breaking of large language models where attackers gradually move toward their objective (usually manipulating a model to violate guardrails) until the model eventually crosses the threshold of violating prescribed protocols. <br> | ||
'''Mechanism:''' <br> | '''Mechanism:''' <br> | ||
Revision as of 15:26, 4 November 2024
Incrementalism
Short Description: Attacker gradually adjusts conditions to avoid notice by the target.
CAT ID: CAT-2022-312
Layer: 8, 9
Operational Scale: Strategic
Level of Maturity: Well-Established
Category: Exploit
Subcategory:
Also Known As:
Description:
Brief Description:
Closely Related Concepts: Incrementalism has some interesting parallels with many-shot jail breaking of large language models where attackers gradually move toward their objective (usually manipulating a model to violate guardrails) until the model eventually crosses the threshold of violating prescribed protocols.
Mechanism:
Multipliers:
Detailed Description: Technique that gradually adjusts conditions to avoid notice by the target(s). If the attacker seeks to influence the target to accept a new situation that is presently unacceptable, the attacker may introduce gradual changes that are incrementally viewed as acceptable until the target has adjusted their worldview to accept the new circumstance.
INTERACTIONS [VETs]:
Examples:
Use Case Example(s):
Example(s) From The Wild:
