Agent Architecture
GitHubOfficialCreated by Stanislav BankovskiiDistributed by GitHub
- Skill
- Research and analysis
- Agent tooling
- MIT
- No issues found
AutoGineer summary
Written by AutoGineer from the skill’s own files, not by the author
This skill provides a systematic approach to defining the architecture of AI agents or auditing existing ones. It focuses on requirements discovery, structural integrity, and operational reliability, ensuring that agent designs are justified by specific needs rather than unnecessary complexity. It delivers comprehensive architectural packages, including diagrams and validation plans, without performing implementation or code-level reviews.
What it does
- Designs new agent architectures based on clear requirements discovery.
- Audits existing agent architectures to identify flaws and verify paths.
- Diagnoses performance issues or failures in agent logic.
- Produces architectural reports including Mermaid or C4 diagrams.
- Defines validation loops, state management, and execution contracts.
- Evaluates the necessity of complex components like RAG, memory, or multi-agent systems.
When to use it
- When you need to design an AI agent from scratch and want a justified, efficient architecture.
- When an existing agent is failing, producing errors, or not meeting performance goals.
- When you need to verify if your current agent design is robust and scalable.
- When you need to document an agent's architecture for stakeholders or developers.
Advantages
- Promotes architectural simplicity by requiring justification for every added component.
- Provides evidence-based audits rather than subjective assessments.
- Ensures clear boundaries between agent logic, tools, and external effects.
- Delivers professional, ready-to-use architectural documentation and diagrams.
- Focuses on verifiable outcomes and robust error handling.
Usage examples
- “I need to design an agent that handles customer support tickets. Can you help me define the architecture?”
- The agent will guide you through a discovery process to define requirements, select the appropriate topology, and deliver an architecture package including diagrams and validation rules.
- “My current agent keeps getting stuck in a loop when searching for data. Can you audit it?”
- The agent will reconstruct the current execution paths, identify the root cause of the loop, and propose a corrected architectural approach with diagnostic checks.
Install
Download the skill as a ZIP:
https://mp-staging.autogineer.com/agent-skills/github/agent-architecture/downloadUnzip it into the cross-client skills folder of your project:
mkdir -p .agents/skills && unzip agent-architecture.zip -d .agents/skills
Documentation by Stanislav Bankovskii
AI Agent Architecture
Help the user obtain a justified architecture for their task or an evidence-based audit of an existing agent. Deliver architectural decisions and ways to verify them, without implementing the agent. By default, completed work includes a PDF report and a visualization of the results. An “ideal architecture” fits the requirements, cost of failure, and team resources; it does not maximize the number of components.
Choose a route
| Request | Route | Read |
|---|---|---|
| New agent, requirements are not yet clear | Design: working cases → early design → requirements and decision coverage → delivery | design.md, architecture-contract.md |
| Architecture from an existing specification | Design: fill in what is known and clarify only gaps | The same files; do not restart the interview |
| Review an agent already written | Audit: reconstruct actual paths → verify → deliver findings | audit.md, and architecture-contract.md as criteria |
| Agent makes mistakes, has degraded, or falsely reports “done” | Diagnosis within the audit: case → hypotheses → discriminating checks → correction and closure criterion | audit.md and diagnostic-review.md |
| Review and redesign | Audit first; its demonstrated problems become design inputs | audit.md first, then design.md |
In either mode, read source-map.md once: it explains the origins of the principles and the textbook's limitations. The original PDF is not needed for ordinary skill use. scenarios.md is needed only to test the skill itself.
When choosing or revisiting the execution approach, use architecture-selection.md; when designing acceptance or reviewing quality claims, use evaluation-design.md. Develop the validation loop and completion evidence using validation-loop.md; for long-running/background work, pauses, recovery, and competing sessions, use execution-continuity.md, including storage, RTO/RPO, budgets, the human decision queue, and scheduling. Develop delegation, mutable memory, execution isolation, and long-running/streaming interaction only when the task has these properties. A section's existence does not make its question mandatory: material gaps under discovery-protocol.md determine depth.
Shared decision rules
First read the available specification, local instructions, architectural decisions, and relevant materials. Use code to reconstruct architecture, not to make unsolicited fixes. Do not run an application with external effects for an audit.
Maintain a brief register: source-confirmed / user requirement / proposal / assumption / open question / not applicable. Identify where requirements came from. A user decision and an architect's hypothesis have different statuses.
Corporate contracts and accepted decisions apply only within their own project. The textbook is an engineering reference, not a source of authority or a replacement for local canon. Identify conflicts rather than resolving them silently.
First consider ordinary automation without an LLM, a single call, and a predefined workflow. Introduce an agent loop, RAG, persistent memory, MCP, or multiple agents only for a concrete need. For each added complexity, identify its benefit, cost, verification method, and simpler alternative.
Do not select a model or framework before understanding the task. For a concrete selection, check current official documentation and version constraints. A documented capability is not yet demonstrated quality on the user's data.
Separate probabilistic model decisions from programmatically enforced rules. Describe where permissions, parameters, budget, and action admissibility are checked before an external effect, including bypass paths and resumption.
For a timed-out external write, a readback that finds nothing does not by itself prove that no effect occurred. Permit a retry only under an established downstream idempotency contract or authoritative proof of non-execution; otherwise retain
effect unknownand reconcile or escalate. Apply this rule in concrete flows and examples as well as in the risk section.An audit or design does not authorize writing code, changing agent settings, publishing, or initiating external actions. On a subsequent explicit implementation request, hand the architecture to the appropriate process; this skill does not continue into implementation itself.
How to work
Before an interview or audit planning, read discovery-protocol.md. Show a clear route and maintain a coverage map. By default, devote each turn to one decision or working episode; do not hide several independent topics inside one question. Material gaps and evidence determine depth. There is no fixed total round limit.
Deliver the first useful design as soon as context is sufficient, otherwise no later than the third answer; the count does not reset on continuation. This limits the wait for an early result, not the completeness of the interview. If the task is too unclear, show a map of what is understood and conditional options. After the sketch, continue investigating material gaps under the protocol; two or three rounds alone do not justify declaring readiness.
The first design includes the goal and boundaries, main capabilities and their outputs, recommended components, main flow and external actions, key constraints, assumptions, and open decisions. It is a sketch for early feedback. The interview budget limits the wait for a sketch, not design depth: develop it into an architecture package from what is already known, without waiting for a separate instruction to elaborate. If context suffices, deliver the package immediately. If the user explicitly asks only for a sketch, respect and label that depth.
Phrases such as “that's enough,” “let's go with this for now,” “the rest later,” or “enough questions” end requirements gathering: deliver the architecture from accumulated context in the same answer. Do not require a separate “now design it” instruction or end at “interview complete.” If a design has already been delivered, show its current final version or a substantive update. An explicit request to stop all work (“don't continue,” “that's all for today, stop”) means stop, rather than deliver a new design.
If the user does not know an answer, propose a justified option and label its status. Represent unknowns as assumptions and open decisions. Unclear authority blocks the corresponding external action in the proposed architecture, but not delivery of the architecture itself. Silence and ending the interview do not approve proposals.
After a significant answer, update the working summary of requirements and decisions. Save it in an agreed document if artifact creation is within the request; otherwise maintain it in the conversation. On continuation, start with that summary and changed information.
After the first design, clarify specific branches and uncovered material requirements, including real exceptions, human work, and feasibility. Explain which decision the answer will change; propose internal mechanisms yourself. Do not confine gap discovery to components already drawn or restart a questionnaire. Finish when the declared scope has sufficient coverage; if further confirmation is unavailable, deliver a conditional package with owners and checks for gaps.
Complete design with the architecture package from architecture-contract.md: domain capabilities and methods, output contracts, the structure of instructions/skills/materials, allocation between the existing platform and additions, a populated end-to-end example, and checks. Read capability-design.md for this part; in an audit, use it to check required capabilities. Describe the agent's main work deeply enough that a developer does not have to invent its method again. A platform name and a list of stages do not accomplish that.
Always cover limits on iterations, time, tokens/money, and tool calls, stopping rules, and what the user receives on stopping. Mark unknown values as open or proposed rather than inventing an agreed limit. An architecture package with skill specifications remains a design: it does not imply skill installation, code implementation, or verification of a running agent.
Complete an audit with demonstrated problems, separately identifying unknowns and accepted tradeoffs. Do not claim production readiness from reading code. Architectural readiness for implementation and demonstrated operational quality are different outcomes.
Final artifacts
When completing design, audit, or diagnosis, read result-delivery.md and create a PDF of the results with a rendered Mermaid or C4 diagram as appropriate; retain editable text and diagram source. Do this as part of completion without a separate user request to “make the PDF now.” An early sketch and intermediate answers do not require repeated export. Explicit user constraints (“chat only,” “no files/PDF”) and a request to stop all work take precedence. Creating the report does not authorize implementing or changing the reviewed agent.
Package metadata
This package is distributed under the MIT license. Optional client metadata supports compatible Agent Skills clients; Copilot uses SKILL.md and the linked references.
Files
- ATTRIBUTION.mdAdded by AutoGineer982 B
- LICENSE.txt1.1 KiB
- SKILL.md9.8 KiB
- agents/openai.yaml309 B
- references/architecture-contract.md20.3 KiB
- references/architecture-selection.md7.3 KiB
- references/audit.md9.5 KiB
- references/capability-design.md6.1 KiB
- references/design.md10.2 KiB
- references/diagnostic-review.md13.0 KiB
- references/discovery-protocol.md8.6 KiB
- references/evaluation-design.md7.5 KiB
- references/execution-continuity.md13.4 KiB
- references/result-delivery.md7.4 KiB
- references/scenarios.md24.7 KiB
- references/source-map.md18.4 KiB
- references/validation-loop.md6.8 KiB
references/evaluation-design.md
Evaluation and Improvement Design
Read when defining acceptance, checking quality claims, and diagnosing measurement. Scale the set to the task; the table does not require an LLM judge, separate service, or new customer questions.
1. Evaluation contract
For each significant criterion, specify R/E-ID → property evaluated → input/state → source of correct answer (oracle) → checker/scorer → threshold and status → mandatory gate or diagnostic metric → behavior on failure/missing evaluation.
| Axis | What to check |
|---|---|
| Task result | Domain correctness, completeness, grounds; actual external-system state and absence of unwanted changes if actions occurred |
| Mandatory action constraints | Permissions, data scope, permitted parameters, and order where required by contract |
| Human interaction | Clear output and limitations, honest reporting of missing data, correct waiting/cancellation, manual rework volume |
| Resources | Cost per accepted task, time, every retry/worker, and user labor |
| Evidence coverage | Cases, paths, and criteria actually evaluated; what remains unknown |
Do not offset a mandatory safety-boundary violation with a high average score. Define final admission: which gates must pass and which metrics guide tradeoffs. A correct alternative tool sequence is acceptable if it achieves the required outcome and respects mandatory constraints. A reference trajectory alone does not mandate order. A separate score's existence does not prove inclusion in the final gate.
Example: a report calculates a metric correctly but reads another tenant's data. Domain evaluation may pass, the access gate fails, and final admission is prohibited. Another report honestly states that data is missing: this is not calculation success, but may be a correct task outcome under the agreed rubric.
2. Measurement reliability
Separate agent error, environment/runner error, evaluator error, and missing evaluation. For each axis, show planned tasks/attempts, actually executed, evaluated, errors, and omissions with reasons; do not mix “task,” “attempt,” and “criterion.” Categories may overlap across axes, so state accounting rules. Missing evaluation is not success; an accepted fail-closed gate may block admission without attributing failure to the agent.
Example: of 100 executed tasks, a judge evaluated 60, accepted 57, and gave unparsable responses for 40. Confirmed: 57/60 = 95% among evaluated tasks, 60% coverage, 40 unknowns. Do not claim 95% success overall; confirmed acceptance among all tasks is 57%. Next, localize omissions and check bias toward difficult cases. Do not count them automatically as successes or hide them by excluding them from the denominator.
Pin versions of the dataset, grader/rubric, model, prompts/skills, tools, environment, and material data. Check task feasibility, ambiguous/incorrect references, and evaluator calibration on known good/bad cases. After benchmark or grader changes, earlier numbers need comparability checks, a shared subset, or a new baseline. Keeping the benchmark name is insufficient.
For retries, explicitly describe attempt count, limits, aggregation, and uncertainty. pass@k asks whether at least one of k attempts succeeds; pass^k asks about consistent success across all k. Choose according to product needs: one successful attempt does not prove every run reliable. Do not calculate all-success probability by simply exponentiating an estimate without justified independence; retain individual attempt results. No universal minimum evaluation-set size exists.
Test real-gate sensitivity, bypasses, and negative controls under diagnostic-review.md. Judge, parser, and reducer belong to the measurement system and can also fail. Model self-reported confidence is not an oracle.
3. Controlled improvement from feedback
The check execution, release, and Evidence Bundle loop is in validation-loop.md. Telemetry becomes a diagnostic input and new test case; a signal alone does not authorize behavior changes.
For a significant change, make a brief card:
case → first observable obligation violation → suspected mechanism → target component (method/context/tool/runtime/model/scorer) → protected invariants → change → comparison budget → independent validation → acceptance/rollback condition and owner.
Use diagnosis to distinguish cause, propagation, and the check that missed the error. Correcting success reporting can limit harm while leaving cause open. Compare original and new versions under identical conditions; preserve successful regression cases and a holdout outside tuning. Bound iterations, spending, and stopping; do not optimize scores endlessly.
The optimized agent does not change its own admission criteria or private evaluation set to improve results. Correcting a faulty grader is allowed as a separate controlled measurement change with a new comparison basis. Do not tune on holdout; leakage requires new independent validation.
Admit a new prompt/tool/skill or memory version according to owner authority and accepted policy. Automatic acceptance is possible within a preauthorized scope when criteria pass; arbitrary publication from the improvement loop is not authorized. Separate proposed experiment, executed run, and measured effect. Finish with an accepted change and evidence, or a comparison result and specific remaining limitation.
4. Escalation and user labor
Use the decision map from design.md. Include cases where human decisions are mandatory and cases where context/permissions already allow continuation. Count necessary performed and missed escalations, unnecessary requests, and requests lacking sufficient materials separately. Denominators come from labeled cases of the relevant class; one overall escalation rate does not show quality.
Measure active participation, waiting, manual rework, queue size/age, and completed useful tasks. Distinguish agent work, human availability, and flow scheduling. Faster generation with a growing unreviewed backlog is not improvement of the whole process. Fewer confirmations do not justify bypassing mandatory authority.
Paired example: drafting from accessible sources within authorized scope completes without repeated permission for every read; publication needs an exact preview and valid approval. “Enough questions” ends the interview, not authorizes publication. After a decision arrives, the agent continues authorized work rather than stopping at “interview complete.”
5. Long horizon and continuation
For long-running work, compare equivalent tasks in a fresh session, after relevant/distracting history accumulates, after compaction, handoff, and crash/resume. Vary conditions to distinguish these transitions; retain task versions, data, settings, evaluators, and total budget. History length and task duration are different factors. More hours of autonomy is not a goal in itself.
Measure domain outcome, preservation of goals/constraints/sources, procedure versions, effect state and current authority, lost progress, rework, time, and cost. For checkpoints, use execution-continuity.md. A minimized short example that passes may remove the failure condition; it does not refute a long-run failure. Improvement after a fresh session localizes a condition but does not yet establish mechanism.
Show separate outcomes and coverage for each mode. Label test design, execution on a fixture, and confirmation on the actual runtime separately. Risk and budget determine sample size and acceptable degradation, not a fixed textbook percentage.
Requirements and compatibility
Written for: GitHub Copilot
Works with: Claude Code, Claude apps, OpenAI Codex, GitHub Copilot, Cursor, Gemini CLI, Kiro, OpenCode, Goose, Amp, Roo Code, JetBrains Junie, Factory Droid, Devin (ex-Windsurf), Mistral Vibe, OpenHands, Letta
“Works with” means the tool reads the open Agent Skills format; a skill written for one tool may use features others lack.
Security
No issues found by our static scan· No issues found
A static scan is not a guarantee. Skills are third-party content: review a skill before you let an agent use it.
Attribution and licence
- Created by
- Stanislav Bankovskii
- Publisher
- GitHub (Official)
- Distributed by
- GitHub
- Source
- github/awesome-copilot · skills/agent-architecture · commit 797337f
- Licence
- MIT License (redistribution allowed)
- ATTRIBUTION.md (written by AutoGineer)
- Synced
AutoGineer is not affiliated with or endorsed by Stanislav Bankovskii or GitHub.
Download ZIP
The ZIP holds the skill’s files, its licence files and an ATTRIBUTION.md. Download agent-architecture.zip