mirror of
https://github.com/affaan-m/everything-claude-code.git
synced 2026-05-14 02:10:07 +08:00
docs: record post-hardening rc1 release evidence (#1852)
This commit is contained in:
parent
209abd403b
commit
f6e13ab520
@ -39,6 +39,12 @@ As of 2026-05-13:
|
|||||||
`docs/security/supply-chain-incident-response.md`, plus a workflow-security
|
`docs/security/supply-chain-incident-response.md`, plus a workflow-security
|
||||||
validator rule blocking `pull_request_target` workflows from restoring or
|
validator rule blocking `pull_request_target` workflows from restoring or
|
||||||
saving shared dependency caches.
|
saving shared dependency caches.
|
||||||
|
- PR #1850 merged as `248673271455e9dc85b8add2a6ab76107b718639` and removed
|
||||||
|
shell access from read-only analyzer agents and zh-CN copies, reducing
|
||||||
|
AgentShield high findings on that surface without changing operator agents.
|
||||||
|
- PR #1851 merged as `209abd403b7eaa968c6d4fa67be82e04b55706d6` and made
|
||||||
|
`persist-credentials: false` mandatory for `actions/checkout` in workflows
|
||||||
|
with write permissions.
|
||||||
- `docs/architecture/harness-adapter-compliance.md` maps Claude Code, Codex,
|
- `docs/architecture/harness-adapter-compliance.md` maps Claude Code, Codex,
|
||||||
OpenCode, Cursor, Gemini, Zed-adjacent, dmux, Orca, Superset, Ghast, and
|
OpenCode, Cursor, Gemini, Zed-adjacent, dmux, Orca, Superset, Ghast, and
|
||||||
terminal-only support to install paths, verification commands, and risk
|
terminal-only support to install paths, verification commands, and risk
|
||||||
@ -61,8 +67,12 @@ As of 2026-05-13:
|
|||||||
release-readiness evidence refresh: 70/70 harness audit, adapter compliance
|
release-readiness evidence refresh: 70/70 harness audit, adapter compliance
|
||||||
PASS, 16/16 observability readiness, 2376/2376 root Node tests, markdownlint,
|
PASS, 16/16 observability readiness, 2376/2376 root Node tests, markdownlint,
|
||||||
release-surface and npm publish-surface tests, and 462/462 `ecc2` Rust tests.
|
release-surface and npm publish-surface tests, and 462/462 `ecc2` Rust tests.
|
||||||
- After #1848, `node tests/run-all.js` reports 2377/2377 and the current
|
- `docs/releases/2.0.0-rc.1/publication-evidence-2026-05-13-post-hardening.md`
|
||||||
observability gate reports 18/18.
|
records the post-hardening release-readiness refresh after PR #1850 and
|
||||||
|
PR #1851: 70/70 harness audit, adapter compliance PASS, 18/18 observability
|
||||||
|
readiness, 2380/2380 root Node tests, markdownlint, release-surface and
|
||||||
|
npm publish-surface tests, 462/462 `ecc2` Rust tests, npm audit/signature
|
||||||
|
checks, Rust advisory audit, and TanStack/Mini Shai-Hulud IOC checks.
|
||||||
- A detached clean worktree at
|
- A detached clean worktree at
|
||||||
`bfacf37715b39655cbc2c48f12f2a35c67cb0253` verified Claude plugin tag
|
`bfacf37715b39655cbc2c48f12f2a35c67cb0253` verified Claude plugin tag
|
||||||
dry-run without `--force`, local marketplace discovery, temp-home local
|
dry-run without `--force`, local marketplace discovery, temp-home local
|
||||||
@ -225,10 +235,10 @@ is not complete unless the evidence column exists and has been freshly verified.
|
|||||||
|
|
||||||
| Prompt requirement | Required artifact or gate | Current evidence | Status |
|
| Prompt requirement | Required artifact or gate | Current evidence | Status |
|
||||||
| --- | --- | --- | --- |
|
| --- | --- | --- | --- |
|
||||||
| Keep public PRs below 20 | Repo-family PR recheck | 0 open PRs across the tracked public repos on 2026-05-13 after merging #1848 | Complete for this checkpoint |
|
| Keep public PRs below 20 | Repo-family PR recheck | 0 open PRs across the tracked public repos on 2026-05-13 after merging #1851 | Complete for this checkpoint |
|
||||||
| Keep public issues below 20 | Repo-family issue recheck | 0 open issues across the tracked public repos on 2026-05-13 | Complete for this checkpoint |
|
| Keep public issues below 20 | Repo-family issue recheck | 0 open issues across the tracked public repos on 2026-05-13 | Complete for this checkpoint |
|
||||||
| Manage repository discussions | Repo-family discussion recheck | Latest trunk discussion GraphQL sweep returned closed discussions only; satellite repos remain disabled or empty | Complete for this checkpoint |
|
| Manage repository discussions | Repo-family discussion recheck | Latest trunk discussion GraphQL sweep returned closed discussions only; satellite repos remain disabled or empty | Complete for this checkpoint |
|
||||||
| Manage PR discussions | PR review/comment closure plus merge/close state | #1848 merged after current-head CI; no open PRs remain | Complete for this checkpoint |
|
| Manage PR discussions | PR review/comment closure plus merge/close state | #1851 merged after current-head CI; no open PRs remain | Complete for this checkpoint |
|
||||||
| Salvage useful stale work | `docs/stale-pr-salvage-ledger.md` | Ledger records salvaged, superseded, skipped, and manual-review tails; #1815-#1818 added cost tracking, skill scout, frontend design guidance, code-reviewer false-positive guardrails, and the May 12 gap pass | Complete except translation/manual review tail |
|
| Salvage useful stale work | `docs/stale-pr-salvage-ledger.md` | Ledger records salvaged, superseded, skipped, and manual-review tails; #1815-#1818 added cost tracking, skill scout, frontend design guidance, code-reviewer false-positive guardrails, and the May 12 gap pass | Complete except translation/manual review tail |
|
||||||
| ECC 2.0 preview pack ready | Release docs, quickstart, publication readiness, release notes | `docs/releases/2.0.0-rc.1/` and readiness docs are in-tree; May 13 evidence refresh records harness, adapter, observability, Node, lint, release-surface, npm publish-surface, and Rust checks | Needs final clean-checkout release approval |
|
| ECC 2.0 preview pack ready | Release docs, quickstart, publication readiness, release notes | `docs/releases/2.0.0-rc.1/` and readiness docs are in-tree; May 13 evidence refresh records harness, adapter, observability, Node, lint, release-surface, npm publish-surface, and Rust checks | Needs final clean-checkout release approval |
|
||||||
| Hermes specialized skills included safely | Hermes setup/import docs and sanitized skill surface | Hermes setup and import playbook are public; secrets stay local | Needs final release review |
|
| Hermes specialized skills included safely | Hermes setup/import docs and sanitized skill surface | Hermes setup and import playbook are public; secrets stay local | Needs final release review |
|
||||||
@ -237,7 +247,7 @@ is not complete unless the evidence column exists and has been freshly verified.
|
|||||||
| Articles, tweets, and announcements | X thread, LinkedIn copy, GitHub release copy, push checklist | Draft launch collateral exists under rc.1 release docs | Needs URL-backed refresh |
|
| Articles, tweets, and announcements | X thread, LinkedIn copy, GitHub release copy, push checklist | Draft launch collateral exists under rc.1 release docs | Needs URL-backed refresh |
|
||||||
| AgentShield enterprise iteration | Policy gates, SARIF, packs, provenance, corpus, HTML reports, exception lifecycle audit, baseline drift Action/CLI surfaces, enterprise research roadmap | PRs #53, #55-#64 landed with test evidence; native PDF export deferred in favor of self-contained HTML plus print-to-PDF until explicit enterprise demand appears; `docs/architecture/agentshield-enterprise-research-roadmap.md` selects baseline drift as the first control-plane slice | Baseline-drift Action and CLI write surfaces landed; evidence-pack routing remains |
|
| AgentShield enterprise iteration | Policy gates, SARIF, packs, provenance, corpus, HTML reports, exception lifecycle audit, baseline drift Action/CLI surfaces, enterprise research roadmap | PRs #53, #55-#64 landed with test evidence; native PDF export deferred in favor of self-contained HTML plus print-to-PDF until explicit enterprise demand appears; `docs/architecture/agentshield-enterprise-research-roadmap.md` selects baseline drift as the first control-plane slice | Baseline-drift Action and CLI write surfaces landed; evidence-pack routing remains |
|
||||||
| ECC Tools next-level app | Billing audit, PR checks, deep analyzer, sync backlog, evaluator/RAG corpus | PRs #26-#40 landed with test evidence | Needs capacity-backed Linear rollout |
|
| ECC Tools next-level app | Billing audit, PR checks, deep analyzer, sync backlog, evaluator/RAG corpus | PRs #26-#40 landed with test evidence | Needs capacity-backed Linear rollout |
|
||||||
| GitGuardian/Dependabot/CodeRabbit-style checks | Non-blocking taxonomy, deterministic follow-up checks, and local supply-chain gates | ECC-Tools risk taxonomy check plus follow-up signals landed, including Skill Quality, Deep Analyzer Evidence, Analyzer Corpus Evidence, RAG/Evaluator Evidence, and PR Review/Salvage Evidence; #1846 added npm registry signature gates; #1848 added the supply-chain incident-response playbook and `pull_request_target` cache-poisoning validator guard | Partially complete |
|
| GitGuardian/Dependabot/CodeRabbit-style checks | Non-blocking taxonomy, deterministic follow-up checks, and local supply-chain gates | ECC-Tools risk taxonomy check plus follow-up signals landed, including Skill Quality, Deep Analyzer Evidence, Analyzer Corpus Evidence, RAG/Evaluator Evidence, and PR Review/Salvage Evidence; #1846 added npm registry signature gates; #1848 added the supply-chain incident-response playbook and `pull_request_target` cache-poisoning validator guard; #1851 added the privileged checkout credential-persistence guard | Partially complete |
|
||||||
| Harness-agnostic learning system | Audit, adapter matrix, observability, traces, promotion loop | Audit/adapters/observability gates plus `docs/architecture/evaluator-rag-prototype.md`, `examples/evaluator-rag-prototype/`, and ECC-Tools PR #40 define read-only stale-salvage, billing-readiness, CI-failure-diagnosis, harness-config-quality, AgentShield policy-exception, skill-quality evidence, deep-analyzer evidence, and RAG/evaluator comparison scenarios with trace, report, playbook, verifier, and predictive-check artifacts | Local corpus complete; hosted integration remains future |
|
| Harness-agnostic learning system | Audit, adapter matrix, observability, traces, promotion loop | Audit/adapters/observability gates plus `docs/architecture/evaluator-rag-prototype.md`, `examples/evaluator-rag-prototype/`, and ECC-Tools PR #40 define read-only stale-salvage, billing-readiness, CI-failure-diagnosis, harness-config-quality, AgentShield policy-exception, skill-quality evidence, deep-analyzer evidence, and RAG/evaluator comparison scenarios with trace, report, playbook, verifier, and predictive-check artifacts | Local corpus complete; hosted integration remains future |
|
||||||
| Linear roadmap is detailed | Linear project status plus repo mirror | Repo mirror exists; issue creation was retried on 2026-05-12 and remains blocked by the workspace free issue limit | Needs recurring status updates after each merge batch |
|
| Linear roadmap is detailed | Linear project status plus repo mirror | Repo mirror exists; issue creation was retried on 2026-05-12 and remains blocked by the workspace free issue limit | Needs recurring status updates after each merge batch |
|
||||||
| Flow separation and progress tracking | Flow lanes with owner artifacts and update cadence | This roadmap defines lanes below and `docs/architecture/progress-sync-contract.md` makes GitHub/Linear/handoff/roadmap sync part of the readiness gate | Active |
|
| Flow separation and progress tracking | Flow lanes with owner artifacts and update cadence | This roadmap defines lanes below and `docs/architecture/progress-sync-contract.md` makes GitHub/Linear/handoff/roadmap sync part of the readiness gate | Active |
|
||||||
|
|||||||
@ -0,0 +1,96 @@
|
|||||||
|
# ECC v2.0.0-rc.1 Publication Evidence - 2026-05-13 Post-Hardening
|
||||||
|
|
||||||
|
This is release-readiness evidence only. It does not create a GitHub release,
|
||||||
|
npm publication, plugin tag, marketplace submission, or announcement post.
|
||||||
|
|
||||||
|
## Source Commit
|
||||||
|
|
||||||
|
| Field | Evidence |
|
||||||
|
| --- | --- |
|
||||||
|
| Upstream main base | `209abd403b7eaa968c6d4fa67be82e04b55706d6` |
|
||||||
|
| Evidence branch | `docs/post-hardening-release-evidence-20260513` |
|
||||||
|
| Evidence scope | Current `main` after PR #1850 and PR #1851 |
|
||||||
|
| Git remote | `https://github.com/affaan-m/everything-claude-code.git` |
|
||||||
|
| Local status caveat | Working tree had the unrelated untracked `docs/drafts/` directory |
|
||||||
|
|
||||||
|
The actual release operator should repeat these checks from the final release
|
||||||
|
commit with a clean checkout before publishing.
|
||||||
|
|
||||||
|
## Queue And Release State
|
||||||
|
|
||||||
|
| Surface | Command | Result |
|
||||||
|
| --- | --- | --- |
|
||||||
|
| GitHub PRs and issues | `gh pr list` / `gh issue list` across trunk, AgentShield, and JARVIS | 0 open PRs and 0 open issues on accessible `affaan-m` repos |
|
||||||
|
| Trunk discussions | GraphQL discussion count for `affaan-m/everything-claude-code` | 0 open discussions |
|
||||||
|
| Dependabot alerts | Dependabot alert API for trunk, AgentShield, and JARVIS | 0 open alerts |
|
||||||
|
| Release state | `gh release view v2.0.0-rc.1` | Still not created; release remains approval-gated |
|
||||||
|
|
||||||
|
ECC-Tools organization repo counts were not rechecked through the current
|
||||||
|
GraphQL token in this pass because the token cannot resolve those org repos.
|
||||||
|
The prior post-#42 local checkout handoff recorded both ECC-Tools repos at
|
||||||
|
0 open PRs and 0 open issues.
|
||||||
|
|
||||||
|
## Hardening Landed Since Previous Evidence
|
||||||
|
|
||||||
|
| PR | Merge commit | Evidence |
|
||||||
|
| --- | --- | --- |
|
||||||
|
| #1850 | `248673271455e9dc85b8add2a6ab76107b718639` | Removed `Bash` tool access from read-only analyzer agents and zh-CN copies; AgentShield high findings on that surface dropped 21 -> 18 with no new high findings |
|
||||||
|
| #1851 | `209abd403b7eaa968c6d4fa67be82e04b55706d6` | Disabled `actions/checkout` credential persistence in write-permission workflows and added a workflow-security validator rule to keep that guard in place |
|
||||||
|
|
||||||
|
## Required Command Evidence
|
||||||
|
|
||||||
|
| Evidence | Command | Result |
|
||||||
|
| --- | --- | --- |
|
||||||
|
| Harness audit | `npm run harness:audit -- --format json` | `overall_score: 70`, `max_score: 70`, no top actions |
|
||||||
|
| Adapter scorecard | `npm run harness:adapters -- --check` | `Harness Adapter Compliance: PASS`; 11 adapters |
|
||||||
|
| Observability readiness | `npm run observability:ready -- --format json` | `overall_score: 18`, `max_score: 18`, `ready: true`, no top actions |
|
||||||
|
| Workflow security validator | `node scripts/ci/validate-workflow-security.js` | Validated 7 workflow files |
|
||||||
|
| Workflow validator tests | `node tests/ci/validate-workflow-security.test.js` | Passed 14/14 |
|
||||||
|
| Release surface | `node tests/docs/ecc2-release-surface.test.js` | Passed 18/18 |
|
||||||
|
| Package surface | `node tests/scripts/npm-publish-surface.test.js` | Passed 2/2 |
|
||||||
|
| Root suite | `node tests/run-all.js` | Passed 2380/2380, 0 failed |
|
||||||
|
| Markdown lint | `npx markdownlint-cli '**/*.md' --ignore node_modules --ignore docs/drafts` | Passed |
|
||||||
|
| Rust surface | `cd ecc2 && cargo test` | Passed 462/462; warnings only for unused functions/fields |
|
||||||
|
|
||||||
|
## Supply-Chain Evidence
|
||||||
|
|
||||||
|
| Surface | Command or check | Result |
|
||||||
|
| --- | --- | --- |
|
||||||
|
| Local npm vulnerability audit | `npm audit --json` | 0 vulnerabilities |
|
||||||
|
| Local npm signature audit | `npm audit signatures` | 241 verified registry signatures and 30 verified attestations |
|
||||||
|
| Rust advisory audit | `cd ecc2 && cargo audit -q` | Passed silently |
|
||||||
|
| TanStack / Mini Shai-Hulud IOC check | Grep for affected package namespaces, payload filenames, and known commit marker | No runtime or lockfile dependency on affected packages; no worm IOC matches |
|
||||||
|
|
||||||
|
## External Advisory Mapping
|
||||||
|
|
||||||
|
The May 2026 TanStack incident maps to ECC release risk through three workflow
|
||||||
|
classes:
|
||||||
|
|
||||||
|
- `pull_request_target` workflows that execute or checkout untrusted PR code;
|
||||||
|
- shared dependency caches crossing fork, base, and release workflow trust
|
||||||
|
boundaries;
|
||||||
|
- release jobs with writable tokens or OIDC tokens exposed to subsequent
|
||||||
|
process execution.
|
||||||
|
|
||||||
|
ECC's current guardrails cover those classes through:
|
||||||
|
|
||||||
|
- rejection of untrusted checkout refs in `workflow_run` and
|
||||||
|
`pull_request_target` workflows;
|
||||||
|
- rejection of shared caches in `pull_request_target` and `id-token: write`
|
||||||
|
workflows;
|
||||||
|
- mandatory `npm audit signatures` when workflows run `npm audit`;
|
||||||
|
- mandatory `npm ci --ignore-scripts` in workflows with write permissions;
|
||||||
|
- mandatory `persist-credentials: false` on `actions/checkout` in workflows
|
||||||
|
with write permissions.
|
||||||
|
|
||||||
|
## Blockers Still Requiring Approval Or External Action
|
||||||
|
|
||||||
|
- Create or verify GitHub prerelease `v2.0.0-rc.1`.
|
||||||
|
- Publish `ecc-universal@2.0.0-rc.1` with npm dist-tag `next`.
|
||||||
|
- Create and push the Claude plugin tag only after explicit approval.
|
||||||
|
- Confirm the live Claude/Codex/OpenCode marketplace submission path or record
|
||||||
|
the manual submission owner and status.
|
||||||
|
- Verify ECC Tools billing/App/Marketplace claims before using them in launch
|
||||||
|
copy.
|
||||||
|
- Refresh announcement copy with live URLs after release and package/plugin
|
||||||
|
URLs exist.
|
||||||
@ -10,6 +10,8 @@ For the May 12 dry-run evidence pass, see
|
|||||||
[`publication-evidence-2026-05-12.md`](publication-evidence-2026-05-12.md).
|
[`publication-evidence-2026-05-12.md`](publication-evidence-2026-05-12.md).
|
||||||
For the May 13 release-readiness evidence refresh, see
|
For the May 13 release-readiness evidence refresh, see
|
||||||
[`publication-evidence-2026-05-13.md`](publication-evidence-2026-05-13.md).
|
[`publication-evidence-2026-05-13.md`](publication-evidence-2026-05-13.md).
|
||||||
|
For the May 13 post-hardening evidence refresh after PR #1850 and PR #1851, see
|
||||||
|
[`publication-evidence-2026-05-13-post-hardening.md`](publication-evidence-2026-05-13-post-hardening.md).
|
||||||
|
|
||||||
## Release Identity Matrix
|
## Release Identity Matrix
|
||||||
|
|
||||||
@ -39,6 +41,7 @@ For the May 13 release-readiness evidence refresh, see
|
|||||||
| OpenCode package | Build output is regenerated from source and package metadata is current | `npm run build:opencode` | `Blocker: none for local build; public distribution still follows npm/plugin release` | Package owner | Evidence recorded |
|
| OpenCode package | Build output is regenerated from source and package metadata is current | `npm run build:opencode` | `Blocker: none for local build; public distribution still follows npm/plugin release` | Package owner | Evidence recorded |
|
||||||
| ECC Tools billing reference | Any billing claim links to verified Marketplace/App state | `gh api repos/ECC-Tools/ECC-Tools` plus app/marketplace URL check | `Blocker:` | ECC Tools owner | Pending |
|
| ECC Tools billing reference | Any billing claim links to verified Marketplace/App state | `gh api repos/ECC-Tools/ECC-Tools` plus app/marketplace URL check | `Blocker:` | ECC Tools owner | Pending |
|
||||||
| Announcement copy | X, LinkedIn, GitHub release, and longform copy point to live URLs | `rg -n "TODO" docs/releases/2.0.0-rc.1` and repeat for `TBD` | `Blocker:` | Release owner | Pending |
|
| Announcement copy | X, LinkedIn, GitHub release, and longform copy point to live URLs | `rg -n "TODO" docs/releases/2.0.0-rc.1` and repeat for `TBD` | `Blocker:` | Release owner | Pending |
|
||||||
|
| Privileged workflow hardening | Release and maintenance workflows avoid persisted checkout tokens | `node scripts/ci/validate-workflow-security.js` | `Blocker:` | Release owner | Evidence recorded in post-hardening refresh |
|
||||||
|
|
||||||
## Required Command Evidence
|
## Required Command Evidence
|
||||||
|
|
||||||
@ -49,8 +52,8 @@ Record the exact commit SHA and command output before any publication action:
|
|||||||
| Clean release branch | `git status --short --branch` | On intended release commit; no unrelated files | Pending final clean-checkout release pass; May 13 evidence branch still had unrelated untracked `docs/drafts/` |
|
| Clean release branch | `git status --short --branch` | On intended release commit; no unrelated files | Pending final clean-checkout release pass; May 13 evidence branch still had unrelated untracked `docs/drafts/` |
|
||||||
| Harness audit | `npm run harness:audit -- --format json` | 70/70 passing | `publication-evidence-2026-05-13.md`: 70/70 |
|
| Harness audit | `npm run harness:audit -- --format json` | 70/70 passing | `publication-evidence-2026-05-13.md`: 70/70 |
|
||||||
| Adapter scorecard | `npm run harness:adapters -- --check` | PASS | `publication-evidence-2026-05-13.md`: PASS, 11 adapters |
|
| Adapter scorecard | `npm run harness:adapters -- --check` | PASS | `publication-evidence-2026-05-13.md`: PASS, 11 adapters |
|
||||||
| Observability readiness | `npm run observability:ready` | 16/16 passing | `publication-evidence-2026-05-13.md`: 16/16, ready true |
|
| Observability readiness | `npm run observability:ready` | 18/18 passing | `publication-evidence-2026-05-13-post-hardening.md`: 18/18, ready true |
|
||||||
| Root suite | `node tests/run-all.js` | 0 failures | `publication-evidence-2026-05-13.md`: 2376 passed, 0 failed |
|
| Root suite | `node tests/run-all.js` | 0 failures | `publication-evidence-2026-05-13-post-hardening.md`: 2380 passed, 0 failed |
|
||||||
| Markdown lint | `npx markdownlint-cli '**/*.md' --ignore node_modules` | 0 failures | `publication-evidence-2026-05-13.md`: passed after zh-CN CLAUDE list-marker normalization |
|
| Markdown lint | `npx markdownlint-cli '**/*.md' --ignore node_modules` | 0 failures | `publication-evidence-2026-05-13.md`: passed after zh-CN CLAUDE list-marker normalization |
|
||||||
| Package surface | `node tests/scripts/npm-publish-surface.test.js` | 0 failures; no Python bytecode in npm tarball | `2/2` passed in May 12 evidence pass |
|
| Package surface | `node tests/scripts/npm-publish-surface.test.js` | 0 failures; no Python bytecode in npm tarball | `2/2` passed in May 12 evidence pass |
|
||||||
| Release surface | `node tests/docs/ecc2-release-surface.test.js` | 0 failures | `publication-evidence-2026-05-13.md`: 18/18 passed |
|
| Release surface | `node tests/docs/ecc2-release-surface.test.js` | 0 failures | `publication-evidence-2026-05-13.md`: 18/18 passed |
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user