Based on public information, this article maps control points for agent planning, memory, and tools into a read-only, confirmation, restricted, and disabled acceptance checklist.

观山静思
观山静思

Author: Jinxue Studio · Guanshan Academy

About 2,341 characters · Approx. 8-minute read


After reading this article, you can turn new developments in planning, memory, and tools into a four-tier acceptance checklist: what can be validated in read-only mode, what requires human confirmation, what can run under restrictions, and what should be disabled.

Background: The focus of Agents is shifting from answer quality to system control

According to public information, recent updates to Agent capabilities are focused not only on smoother answers, but on clearer task decomposition, retrieval, function calling, permission control, and rollback mechanisms.

Industry observations show that developers can now judge controllability with three questions: Can it be validated in read-only mode? Can it stop or roll back after failure? Can the evidence of actions be audited? These three questions are more reliable than testing model capability alone.

Image: Garden path

Image: Garden path

Breaking Down New Developments: Control Points for Planning, Memory, and Tools

  • According to public information: The new control point for planning is not the plan text itself, but validation before and after execution. A deployable plan should output steps, prerequisites, stop conditions, and evidence links, rather than only a goal description.
  • According to public information: The new control points for memory are provenance, freshness, and permissions. Long-term memory entries should indicate where they came from, when they were written, and who is allowed to read them; otherwise, stale information and cross-user reads can become direct business risks.
  • Industry observation: The new control points for tool calling are concentrated on schema validation and read-only-first execution. Queries, retrieval, and status reads can be validated early; database writes, configuration changes, outbound messages, and financial operations should first be simulated or approved.
  • Industry observation: Tool integration approaches such as MCP increase the number of tools and also amplify integration risk. Tool discovery, invocation, responses, and logs need unified recording; otherwise, production issues cannot be reproduced.
  • According to public information: Permission approval is shifting from one-time authorization to action-level grading. Different tools should have different thresholds: low-risk actions can be automated, while high-risk actions must be confirmed.
  • Industry observation: Rollback capability has become a prerequisite for write operations. Changes that cannot demonstrate idempotence, compensation, or reversal should not enter the automated execution path.
  • According to public information: Evidence chains are gradually becoming acceptance requirements. Final answers should preferably state which tool, which retrieval segment, or which failure reason they rely on, avoiding treating uncertain information as fact.
  • Industry observation: Cost and budget controls are being brought into the Agent operating scope. Maximum steps, tool-call counts, timeout duration, and quota limits are basic guardrails before launching long-chain tasks.

Image: Soft light over spring fields

Image: Soft light over spring fields

A Comparison Table: Splitting Capabilities into Four Acceptance Tiers

You can classify current Agent capabilities into four tiers: read-only validation, human confirmation, restricted execution, and mandatory disablement. The control points in the table are suitable for shared use by development, testing, and launch reviews.

Acceptance tierDecision criteriaAllowed actionsProhibited actionsUse cases
Read-only validationCan generate plans, query, and simulate tools, but cannot change external stateRead documents, check configurations, retrieve memory, simulate function calls, generate evidence linksWrite to databases, change configurations, send external messages, perform real charges, trigger production changesShadow evaluation before a new capability first enters production
Human confirmationThe Agent can list executable steps and expected impacts, and executes only after user confirmationSubmit change previews, wait for confirmation, execute single-step operations, record the confirmerBulk publishing, cross-tenant writes, deleting data, modifying permissions, unconfirmed outbound messagesHigh-risk tools, bulk operations, and tasks that may change external state
Restricted executionAutomatic execution is allowed only when budget, step limits, permissions, logging, and rollback are satisfiedLow-risk queries, cache writes, draft saving, and rollback-capable state updatesIrreversible financial actions, privacy exports, production configuration changes, privilege escalation, and actions without logsStable tools, mature scenarios, and actions whose results can be automatically verified
Mandatory disablementProvenance cannot be demonstrated, auditing is impossible, stopping is impossible, or permissions are excessiveKeep only an isolated demo environment; do not connect to real business systemsAutomatic transfers, automatic publishing, automatic deletion, automatic key changes, and cross-user readsCapabilities that demo well but have unclear control points should not go live, even if they run

Common Pitfalls: Why a Smooth Demo Still Leads to an Unstable Launch

  • According to public information: Testing only the happy path overestimates Agent capability. Acceptance testing must include failure cases such as missing fields, tool timeouts, expired memory, permission denials, and empty results.
  • Industry observation: Treating tool outputs as facts can amplify errors. Final answers should cite tool IDs, input summaries, result summaries, or failure reasons, rather than merely repeating tool text.
  • According to public information: Memory and tools are prone to privilege overreach. Retrieval results also need permission checks, isolated by user, tenant, project, and sensitive fields.
  • Industry observation: Long-chain planning can easily trigger multiple tool calls and cost fluctuations. Before launch, set maximum steps, timeouts, budgets, and manual interrupt switches.
  • According to public information: Recording only the final answer is not enough. Intermediate steps, tool inputs, tool outputs, approval records, and failure reasons must all go into queryable logs.
  • Industry observation: Frequent changes to tool schemas can destabilize Agents. Critical tools need version compatibility and field validation, returning explainable errors when fields are missing.

Three Things Developers Can Do Today

1. First list capabilities, then assign acceptance tiers

Use one page to record the current Agent’s planning, memory, and tool capabilities. Label each item as read-only validation, human confirmation, restricted execution, or mandatory disablement. If it cannot be labeled, downgrade it to mandatory disablement first.

2. Choose a low-risk scenario for read-only evaluation

Do not write real data. Let the Agent only query information, call simulated tools, generate step drafts, and annotate sources. Observe whether it can identify gaps, refuse privilege overreach, and provide auditable evidence.

3. Add three pieces of infrastructure before launch

Operation logs, provenance annotations, and approval entry points. If any one is missing, do not open automated execution yet. Logs must be able to reconstruct every call, provenance must be traceable to a tool or retrieval item, and approvals must clearly record who confirmed which action.

Four-Tier Acceptance Checklist

  • ☐ Does planning have maximum steps, stop conditions, and failure-degradation paths?
  • ☐ Does planning output include prerequisites, evidence links, and expected impacts?
  • ☐ Do memory entries annotate source, write time, validity period, and visibility scope?
  • ☐ When retrieving memory, is isolation applied by user, tenant, project, and sensitive fields?
  • ☐ Do tool calls perform schema validation, and return explainable errors when fields are missing?
  • ☐ Do write operations distinguish three tiers: simulation, confirmation, and restricted execution?
  • ☐ Are outbound messages, financial actions, deletions, and permission changes set to human confirmation by default?
  • ☐ Can final answers cite tool IDs, retrieval IDs, result summaries, or failure reasons?
  • ☐ Do logs record discovery, invocation, responses, errors, approvals, and rollbacks?
  • ☐ Are failure cases prepared for missing fields, timeouts, permission denials, expired memory, and similar issues?

Disclaimer: This article is compiled from publicly available online sources for educational purposes only and does not represent the official position of Guanshan Academy. If you believe your rights have been infringed, please contact us for removal.

Contact: chenxj.g@gmail.com