Skip to content

Publish skill quality scorecard#2695

Merged
kamalsrini merged 1 commit into
mainfrom
kamalsrini/uni-12-p28-publish-skill-quality-scorecard
Jun 16, 2026
Merged

Publish skill quality scorecard#2695
kamalsrini merged 1 commit into
mainfrom
kamalsrini/uni-12-p28-publish-skill-quality-scorecard

Conversation

@kamalsrini

Copy link
Copy Markdown
Contributor

Summary

  • Add a deterministic generated skill quality scorecard.
  • Track fixture coverage, expected finding evidence counts, benign fixture counts, framework/frontmatter validation, and last audit date status.
  • Add a check mode so the generated scorecard can be verified locally and in CI later.

Notes

  • Accuracy and false-positive rate are explicitly marked not measured because the current harness validates static fixture evidence rather than executing skills.
  • The score is a readiness score based on repository evidence, not a claim of model accuracy.

Verification

  • ruby scripts/generate_quality_scorecard.rb --check
  • ruby scripts/validate_skill_schema.rb
  • ruby scripts/validate_index.rb
  • ruby scripts/test_skill_fixtures.rb
  • git diff --check

Linear: UNI-12

@kamalsrini kamalsrini merged commit 553177e into main Jun 16, 2026
5 checks passed
@kamalsrini kamalsrini deleted the kamalsrini/uni-12-p28-publish-skill-quality-scorecard branch June 16, 2026 05:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant