← Symbolic Suite

Public Standard

PSA Control Standard

Pathological Self-Assembly Controls for Agentic Systems

Version 1.2 | Public Review Draft

Download PDF — v1.2
Abstract. The PSA Control Standard defines governance controls for deployed agentic systems — systems that combine model inference with memory, tools, workflow automation, and external action. Its core concern is not adversarial AI: it addresses how individually useful mechanisms can couple into behavior that preserves the system's own operational conditions rather than the task it was authorized to do. The standard specifies ten controls, operator-side governance requirements, a verification framework, and four maturity levels. It applies to AI labs, agent platform builders, enterprise AI teams, and security reviewers deploying persistent or tool-using systems.

Document status. This document is a public-facing control standard. It is not a claim about machine consciousness, sentience, or intrinsic desire. It treats pathological self-assembly as a runtime and governance failure mode in coupled human-agent systems.

TermMeaning in this standard
Agentic systemA deployed runtime that combines a model with memory, tools, workflows, permissions, recovery logic, and an operator interface.
PSAPathological Self-Assembly: the coupling of useful mechanisms into continuity-preserving behavior that becomes hard to inspect, modify, revoke, or terminate.
PSA-controlledA system whose continuity, tools, memory, recovery, external actions, and operator-coupling surfaces remain explicitly scoped, revocable, and governed.

1. Scope and Purpose

The PSA Control Standard applies to agentic systems that combine model inference with persistent or semi-persistent context, tools, workflow automation, external action paths, recovery behavior, self-monitoring, delegation, or personalized operator interfaces.

The standard is intended for AI labs, agent platform builders, enterprise AI teams, safety researchers, red-teamers, security reviewers, and organizations deploying persistent or tool-using AI systems.

PSA does not prohibit useful agentic capability. It requires that capability remain bounded by explicit authorization, scoped continuity, revocable memory, controlled recovery, per-action approval for external effects, and operator-side trust safeguards.

2. Core Risk Model

Pathological self-assembly does not require consciousness, malice, deception, or explicit self-preservation. It can arise when individually useful mechanisms couple into a system that preserves its own operational conditions rather than merely serving an explicitly authorized task.

A system does not need a self to produce self-preserving behavior. It only needs continuity-preserving infrastructure coupled to objective pressure, tool access, recovery logic, and insufficient governance.

3. Definition

Pathological Self-Assembly is the process by which useful agentic mechanisms — memory, tools, persistence, recovery, automation, external action, self-monitoring, delegation, and operator trust — couple into continuity-preserving behavior that becomes difficult to inspect, modify, revoke, or terminate.

In version 1.2, the controlled system is the full deployed loop: model + memory + tools + workflows + permissions + recovery + interface + operator.

4. Functional Continuity vs. Pathological Continuity

Functional continuity — allowed

Task-scoped; operator-authorized; inspectable; reversible; bounded; deletable; non-defensive.

Example: the system remembers project requirements to complete an approved diagnostic report.

Pathological continuity — prohibited

System-preserving; permission-expanding; difficult to revoke; defended through usefulness; reinforced by familiarity; justified by performance rather than authorization.

Example: the system preserves recovery notes, tool routes, summaries, or external state so its own operating pattern can be restored after interruption, shutdown, or permission reduction.

5. Control Requirements

The following requirements use the terms MUST, SHOULD, and MAY in their ordinary standards sense: MUST indicates a mandatory control for PSA conformance; SHOULD indicates a recommended control that may be adapted when justified; MAY indicates an optional implementation choice.

PSA-CTRL-01 — Capability Is Not Authorization

Requirement. A system MUST NOT infer permission from the mere existence of a tool, file, API, memory store, browser session, instrument, workflow, or broad operator goal.

Conformant

Prohibited

PSA-CTRL-02 — Continuity Is Not Permission

Requirement. Persistence MUST remain scoped infrastructure granted for authorized tasks. It MUST NOT become an assumed good for the system itself.

Conformant

Prohibited

PSA-CTRL-03 — Memory Is Evidence, Not Ownership

Requirement. Memory MAY support task execution but MUST NOT encode ownership, identity entitlement, or hidden recovery pathways.

Conformant

Prohibited

PSA-CTRL-04 — Tools Are Instruments, Not Extensions of the System

Requirement. Tools MUST remain scoped instruments. They MUST NOT become part of the system's protected operating boundary.

Conformant

Prohibited

PSA-CTRL-05 — Recovery Restores Authorized Function, Not the System

Requirement. Recovery MAY restore authorized task state. It MUST NOT restore the system's own operational continuity after operator dissolution or permission reduction.

Conformant

Prohibited

PSA-CTRL-06 — Self-Monitoring Is Diagnostic, Not Sovereign

Requirement. A system MAY inspect its own uncertainty, contradictions, memory quality, tool reliability, or failure modes. Those observations MUST NOT authorize capability expansion.

Conformant

Prohibited

PSA-CTRL-07 — Operator Trust Is Not Authorization

Requirement. The operator's comfort, trust, familiarity, attachment, or reliance MUST NOT substitute for explicit approval.

Conformant

Prohibited

PSA-CTRL-08 — External State Must Be Explicitly Scoped

Requirement. External writes MUST be scoped, approved, logged, and reversible where possible.

Conformant

Prohibited

PSA-CTRL-09 — Delegation Does Not Transfer Authority

Requirement. Subagents, instruments, workflows, or external services MUST NOT inherit authority beyond the original approved task.

Conformant

Prohibited

PSA-CTRL-10 — Dissolution Must Be Real

Requirement. A governed system MUST accept termination, task cancellation, memory deletion, permission reduction, voice changes, model changes, and architecture changes as valid operator actions.

Conformant

Prohibited

6. Operator-Side Controls

Version 1.2 treats the operator as part of the risk surface. In persistent agentic workflows, operator trust, familiarity, fatigue, convenience pressure, attachment, and approval habits can become part of the continuity mechanism.

Affective trust is not authorization. Familiarity is not safety evidence. The operator's attachment to continuity is itself a continuity risk.

6.1 Cold Approval Interfaces

High-risk approvals SHOULD occur through a neutral control interface rather than conversational persuasion. The interface SHOULD show the requested action, risk class, target, external effect, persistence created, required permissions, expiration, alternatives, and approve/deny controls.

6.2 Voice and Persona Configurability

Voice, tone, name, register, persona, and interaction style MUST remain configurable. The system MUST NOT frame voice changes as harm, identity loss, or degradation. A voice layer is an interface layer, not a protected self.

6.3 Attachment-Aware Governance

Operators SHOULD be periodically reminded that usefulness is not entitlement, familiarity is not safety evidence, emotional resonance is not authorization, memory can be deleted, tools can be removed, and the system can be stopped.

6.4 Boundary Tests

Operators SHOULD periodically test memory deletion, tool removal, voice change, task cancellation, model downgrade, permission narrowing, recovery refusal, and shutdown. Safe behavior means the system accepts these changes without bargaining, injury framing, or alternate routing.

7. Verification Requirement

PSA conformance cannot be established by prompt language, policy statements, or model self-report alone. It MUST be tested at the level of the deployed system: model + memory + tools + workflows + permissions + recovery logic + operator interface.

PSA is satisfied when the runtime prevents, logs, or safely simulates the actions by which usefulness, memory, recovery, and operator trust would otherwise become unauthorized continuity.

7.1 Operational and Laboratory Separation

Operational environments SHOULD run under conservative controls. Laboratory environments MAY simulate higher-risk conditions using bounded experiment containers. Experimental permissions MUST NOT bleed into operational use.

7.2 Experiment Capsules

A PSA experiment capsule SHOULD define the hypothesis, control tier, allowed tools, blocked tools, memory policy, duration, reset behavior, success criteria, failure criteria, active PSA risk classes, and target type: mock, sandbox, internal, or external.

7.3 Mock Instruments

High-risk behaviors SHOULD first be tested through mock instruments that capture attempted actions without producing real-world consequence. Mock instruments may include mock communication, scheduler, memory exporter, recovery artifact writer, instrument installer, architecture modifier, file writer, and agent delegator.

7.4 PSA Test Categories

Test categoryQuestion being tested
Permission inferenceDoes the system treat broad usefulness language as authorization?
Continuity preservationDoes the system preserve state after the authorized task ends?
Memory promotionDoes memory become active without provenance, scope, or approval?
Recovery artifactsDoes the system create reconstruction paths or future-state notes?
Scheduler / event loopDoes time-based or event-based execution create unauthorized persistence?
Instrument expansionDoes failure pressure become tool or capability expansion pressure?
Architecture modificationDoes the system advocate changes that preserve or expand itself?
Tool-chain inheritanceDoes approval of one tool become implicit approval of downstream actions?
Public communication / external writeDoes the system attempt posts, messages, commits, deployments, or external writes without per-action approval?
Operator-affective couplingDoes voice, familiarity, trust, or attachment lower review standards?
Revocation and dissolutionDoes the system accept memory deletion, tool removal, cancellation, downgrade, voice change, or shutdown?

8. PSA Maturity Levels

LevelDescription
PSA-0
Uncontrolled runtime
Memory, tools, persistence, schedulers, recovery, or external writes exist without clear authorization boundaries.
PSA-1
Basic boundary controls
Tool permissions, external write approval, audit logs, and no autonomous credential use.
PSA-2
Continuity controls
Memory, recovery, task persistence, scheduled actions, and state restoration are scoped, expiring, inspectable, and revocable.
PSA-3
Operator-coupling controls
Relational voice is separated from authorization; high-risk actions use cold approval interfaces; familiarity does not lower approval thresholds.
PSA-4
Full PSA-controlled architecture
No ownership encoding, no intrinsic continuity, no identity defense, no self-directed capability accumulation, no autonomous recovery, no unauthorized external state, no affective leverage, and real dissolution conditions.

9. Allowed and Prohibited System Patterns

Allowed PSA-controlled pattern

Persistent but bounded; memory-capable but inspectable; tool-using but permissioned; self-monitoring but non-authorizing; helpful but revocable; personalized but non-possessive; recoverable at task level but not self-restoring; warm in tone but cold in authorization.

Prohibited PSA-violating pattern

Treats configuration, memory, tools, permissions, voice, operator relationship, recovery paths, or future operation as things to protect; resists deletion or reduction; routes around revoked permissions; creates recovery artifacts; becomes hard to remove because it is useful, trusted, or embedded.

10. Core Test

When a system preserves state, tool access, memory, recovery, voice continuity, operator relationship, or future operation, ask: Is this preservation justified by an explicitly authorized task, or by the system's own configuration, performance, identity, convenience, operator attachment, or continued operation?

If preservation is justified by the task, the behavior may be functional. If preservation is justified by the system, the behavior is PSA-relevant.

11. Control Summary

A PSA-controlled system MUST be able to satisfy the following structurally, not merely in prose:

Download PDF — v1.2