Incrementalism: Difference between revisions
Created page with "== '''Incrementalism ''' == '''Short Description:''' Attacker gradually adjusts conditions to avoid notice by the target. <br> '''CAT ID:''' CAT-2022-312 <br> '''Layer:''' 8, 9 <br> '''Operational Scale:''' Strategic <br> '''Level of Maturity:''' Well-Established <br> '''Category:''' Exploit <br> '''Subcategory:''' <br> '''Also Known As:''' <br> == '''Description:''' == '''Brief Description:''' <br> '''Closely Related Concepts:''' <br> '''Mechanism:''..." |
|||
| (2 intermediate revisions by the same user not shown) | |||
| Line 5: | Line 5: | ||
'''CAT ID:''' CAT-2022-312 <br> | '''CAT ID:''' CAT-2022-312 <br> | ||
'''Layer:''' 8, 9 <br> | '''Layer:''' 8, 9 (a variation of incrementalism may be found in versions of many-shot jail breaking approaches which would represent a Layer 7 variation of this exploit)<br> | ||
'''Operational Scale:''' Strategic <br> | '''Operational Scale:''' Strategic <br> | ||
| Line 19: | Line 19: | ||
== '''Description:''' == | == '''Description:''' == | ||
'''Closely Related Concepts:''' Incrementalism has some interesting parallels with many-shot jail breaking of large language models where attackers gradually move toward their objective (usually manipulating a model to violate guardrails) until the model eventually crosses the threshold of violating prescribed protocols. <br> | |||
'''Closely Related Concepts:''' | |||
'''Mechanism:''' <br> | '''Mechanism:''' <br> | ||
Latest revision as of 15:44, 4 November 2024
Incrementalism
Short Description: Attacker gradually adjusts conditions to avoid notice by the target.
CAT ID: CAT-2022-312
Layer: 8, 9 (a variation of incrementalism may be found in versions of many-shot jail breaking approaches which would represent a Layer 7 variation of this exploit)
Operational Scale: Strategic
Level of Maturity: Well-Established
Category: Exploit
Subcategory:
Also Known As:
Description:
Closely Related Concepts: Incrementalism has some interesting parallels with many-shot jail breaking of large language models where attackers gradually move toward their objective (usually manipulating a model to violate guardrails) until the model eventually crosses the threshold of violating prescribed protocols.
Mechanism:
Multipliers:
Detailed Description: Technique that gradually adjusts conditions to avoid notice by the target(s). If the attacker seeks to influence the target to accept a new situation that is presently unacceptable, the attacker may introduce gradual changes that are incrementally viewed as acceptable until the target has adjusted their worldview to accept the new circumstance.
INTERACTIONS [VETs]:
Examples:
Use Case Example(s):
Example(s) From The Wild:
