mathias/hyperguild
1
0
Fork 0
Code Issues 30 Pull Requests 3 Actions Packages Projects Releases Wiki Activity

Track E.3 — skill-from-session generator (BLOCKED on E.1) #29

New Issue
Open
opened 2026-05-25 16:45:30 +00:00 by mathias · 1 comment
mathias commented 2026-05-25 16:45:30 +00:00
Owner
Copy Link
Copy Source

Part of mathias/infra Track E umbrella. Skills repo grows from real usage, not hand-curation.

Blocked on

hyperguild#NN E.1 — needs ingested Claude session corpus to mine.

Goal

New skill skill-from-session in mathias/skills repo (or new tool in hyperguild trainer skill). Mines recent Claude session corpus for patterns and proposes new SKILL.md drafts for human review.

Scope

Pattern detection

Over the last N days of ingested sessions, find:

  • Repeated tool sequences — e.g. grep → Read → Edit patterns that appear ≥5 times across sessions for the same task type. Candidate for a procedural skill.
  • Repeated user corrections — when Mathias says "no, that's wrong because X" → cluster by topic → candidate for a feedback skill or anti-pattern entry.
  • Repeated confirmations — "yes exactly" / "perfect, keep doing that" on non-obvious approaches → candidate for a positive-rule skill.
  • Repeated surprises — turns where Claude logs "unexpected: …" or where the brain has new failures hall entries → candidate for a watchout skill.

Output

Proposed SKILL.md draft in markdown, written to ~/.claude/projects/<host>/proposed-skills/ for human review. Skill metadata includes evidence: which sessions, which lines, how many occurrences.

Human reviews → either:

  • Accept → mv to ~/dev/skills/<name>/SKILL.md, commit, tag bump
  • Reject → delete
  • Edit → curate then accept

Files

  • hyperguild/internal/skills/skill-from-session/ (or reuse existing trainer/ skill scaffold)
  • New brain MCP tool propose_skill(window_days, min_occurrences) returns draft list

Acceptance

  • After E.1 has been running ≥2 weeks, propose_skill returns ≥3 candidate drafts
  • At least one candidate has evidence backing (linkable to session ids + lines)
  • Drafts compile to valid SKILL.md with required frontmatter (name + description)

Pre-mortem

  • Hallucinated patterns: if the model generating the draft sees 3 instances of grep → Read → Edit and concludes "every grep needs a Read+Edit" that's wrong. Mitigation: require ≥5 occurrences and ≥2 distinct sessions; show evidence not just summary.
  • Skill bloat: 19 current skills will turn into 50 if any pattern becomes a skill. Mitigation: human-review gate is hard. Default-reject anything below threshold.

Related

  • infra Track E umbrella
  • hyperguild#NN E.1 (blocks this)
  • mathias/skills repo (consumer of accepted drafts)
Part of mathias/infra Track E umbrella. Skills repo grows from real usage, not hand-curation. ## Blocked on hyperguild#NN E.1 — needs ingested Claude session corpus to mine. ## Goal New skill `skill-from-session` in `mathias/skills` repo (or new tool in hyperguild trainer skill). Mines recent Claude session corpus for patterns and proposes new `SKILL.md` drafts for human review. ## Scope ### Pattern detection Over the last N days of ingested sessions, find: - **Repeated tool sequences** — e.g. `grep → Read → Edit` patterns that appear ≥5 times across sessions for the same task type. Candidate for a procedural skill. - **Repeated user corrections** — when Mathias says "no, that's wrong because X" → cluster by topic → candidate for a feedback skill or anti-pattern entry. - **Repeated confirmations** — "yes exactly" / "perfect, keep doing that" on non-obvious approaches → candidate for a positive-rule skill. - **Repeated surprises** — turns where Claude logs "unexpected: …" or where the brain has new `failures` hall entries → candidate for a watchout skill. ### Output Proposed `SKILL.md` draft in markdown, written to `~/.claude/projects/<host>/proposed-skills/` for human review. Skill metadata includes evidence: which sessions, which lines, how many occurrences. Human reviews → either: - Accept → `mv` to `~/dev/skills/<name>/SKILL.md`, commit, tag bump - Reject → delete - Edit → curate then accept ### Files - `hyperguild/internal/skills/skill-from-session/` (or reuse existing `trainer/` skill scaffold) - New brain MCP tool `propose_skill(window_days, min_occurrences)` returns draft list ### Acceptance - After E.1 has been running ≥2 weeks, `propose_skill` returns ≥3 candidate drafts - At least one candidate has evidence backing (linkable to session ids + lines) - Drafts compile to valid SKILL.md with required frontmatter (name + description) ## Pre-mortem - **Hallucinated patterns**: if the model generating the draft sees 3 instances of `grep → Read → Edit` and concludes "every grep needs a Read+Edit" that's wrong. Mitigation: require ≥5 occurrences and ≥2 distinct sessions; show evidence not just summary. - **Skill bloat**: 19 current skills will turn into 50 if any pattern becomes a skill. Mitigation: human-review gate is hard. Default-reject anything below threshold. ## Related - infra Track E umbrella - hyperguild#NN E.1 (blocks this) - mathias/skills repo (consumer of accepted drafts)
mathias commented 2026-08-19 18:19:51 +00:00
Author
Owner
Copy Link
Copy Source

No state change — still genuinely blocked on E.1 (the referenced "hyperguild#NN E.1" was never actually filed as far as I can find; worth confirming whether E.1 exists under a different number or repo before this can even be picked up). Independent of #75's routing decision either way. Flagging only: once unblocked, its downstream dependency #25 has been re-scoped (see that issue's comment) — routing-mcp is out of scope now, not a factor for this one. Cascade re-triage per hyperguild#75, 2026-08-19.

No state change — still genuinely blocked on E.1 (the referenced "hyperguild#NN E.1" was never actually filed as far as I can find; worth confirming whether E.1 exists under a different number or repo before this can even be picked up). Independent of #75's routing decision either way. Flagging only: once unblocked, its downstream dependency #25 has been re-scoped (see that issue's comment) — routing-mcp is out of scope now, not a factor for this one. Cascade re-triage per hyperguild#75, 2026-08-19.
mathias added the risk/lowsize/ltype/feat labels 2026-08-27 05:25:41 +00:00
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
agent/ready
Meets the agent-ready contract; authorizes unattended execution
 blocked/client
Waiting on the client
 blocked/supplier
Waiting on a supplier
 blocked/upstream
Waiting on an upstream project or vendor
 risk/high
Irreversible, security-relevant, or control plane
 risk/low
Reversible, local, test-covered
 risk/medium
Touches shared state, deploys or data
 size/l
Too big - split it
 size/m
Under two days
 size/s
Under half a day
 size/xs
Under an hour
 status:dispatch
status:dispatched
status:review
status:reviewing
type/chore
Maintenance, no behaviour change
 type/decision
Human decision required; never agent/ready
 type/docs
Documentation only
 type/feat
New capability
 type/fix
Corrects broken behaviour
 type/ops
Infrastructure, deploy, runtime
 type/research
Investigate; output is a finding, not code
 type/test
Test coverage only
No labels risk/low size/l type/feat
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
renovate-bot mathias
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mathias/hyperguild#29