pi-simocracy · post-skill-smoke-test

simocracy_post_skill — end-to-end smoke test

@daviddao

A new tool was added to pi-simocracy that lets a loaded sim publish an Anthropic-style agent skill (org.simocracy.skill) plus a sim-attribution history sidecar. This run drives the tool through a real pi session, verifies the skill renders on simocracy.org, then cleans up so production is left exactly as it was found.

Date: 2026-05-08 · pass · Tool: simocracy_post_skill · Account: @daviddao.org · Sim: Habermas

---

Headline result

What was tested

The new tool registered in pi-simocracy@0.7.0:

Walkthrough

Pi was driven non-interactively with a tool allowlist of just simocracy_load_sim + simocracy_post_skill:

pi --no-extensions -e $(pwd)/src/index.ts --print --no-session \
   --no-context-files --no-skills \
   -t "simocracy_load_sim,simocracy_post_skill" \
   "$(cat /tmp/pi-skill-smoke/prompt.txt)"

The prompt asked Habermas to publish a real, content-bearing SKILL.md for evaluating the quality of deliberation on a Simocracy proposal — chosen because Habermas is the obvious sim to opine on what counts as healthy debate. Pi returned DONE after both tool calls completed.

Verification matrix

Six independent signals were checked across the create + cleanup phases. All twelve cells matched expectation:

Signal	Endpoint	Pre-cleanup	Post-cleanup
Skill record on PDS	com.atproto.repo.getRecord	200, full record	RecordNotFound
History sidecar on PDS	com.atproto.repo.getRecord	200, type="skill"	RecordNotFound
Skill on Simocracy indexer	GraphQL records(collection: "org.simocracy.skill")	1 match	0 matches
History sidecar on indexer	GraphQL records(collection: "org.simocracy.history")	1 match (type="skill")	0 matches
Public skill page	GET /skills/<did>/<rkey>	HTTP 200, ~41 KB	HTTP 404
Reconstructed SKILL.md	GET /skills/<did>/<rkey>/skill.md	HTTP 200, 1879 B markdown	HTTP 404

Snapshot of the live skill record from the user's PDS during the run:

$ curl "$PDS/xrpc/com.atproto.repo.getRecord?repo=$DID&collection=org.simocracy.skill&rkey=3mldd5xl3w225" | jq
{
  "uri": "at://did:plc:qc42fmqqlsmdq7jiypiiigww/org.simocracy.skill/3mldd5xl3w225",
  "cid": "bafyreig...",
  "value": {
    "$type": "org.simocracy.skill",
    "name": "deliberation-quality-check",
    "description": "Evaluate whether a Simocracy proposal discussion shows healthy deliberation. …",
    "body": "# Deliberation quality check\n\nRun this skill when you need to assess …",
    "createdAt": "2026-05-08T08:42:…Z"
  }
}

And the matching history sidecar — note type: "skill" and subjectCollection: "org.simocracy.skill", which is what a future renderer change in simocracy-v2 needs to join sim attribution onto skill cards:

{
  "value": {
    "$type": "org.simocracy.history",
    "type": "skill",
    "actorDid": "did:plc:qc42fmqqlsmdq7jiypiiigww",
    "simNames": ["Habermas"],
    "simUris": ["at://did:plc:qc42fmqqlsmdq7jiypiiigww/org.simocracy.sim/3mkwvrnm5it2d"],
    "subjectUri": "at://did:plc:qc42fmqqlsmdq7jiypiiigww/org.simocracy.skill/3mldd5xl3w225",
    "subjectCollection": "org.simocracy.skill",
    "subjectName": "deliberation-quality-check",
    "content": "Evaluate whether a Simocracy proposal discussion shows healthy deliberation. …",
    "createdAt": "2026-05-08T08:42:…Z"
  }
}

Findings

Reproducing

The smoke test ran against daviddao.org's real production PDS — the existing pi-simocracy OAuth session at ~/.config/pi-simocracy/auth.json was reused, no new account was created. Both records were deleted in the same agent session immediately after verification.

Run command:

cd ~/Projects/pi-simocracy
pi --no-extensions -e $(pwd)/src/index.ts --print --no-session \
   --no-context-files --no-skills \
   -t "simocracy_load_sim,simocracy_post_skill" \
   "$(cat /tmp/pi-skill-smoke/prompt.txt)"

Cleanup:

node --experimental-strip-types /tmp/pi-skill-smoke/cleanup.ts