Repository navigation
[TypeSpec Authoring] Add skill self evolvement agentic workflow - #47317
Open
Haoling Dong (haolingdong-msft) wants to merge 10 commits into
Open
Haoling Dong (haolingdong-msft) wants to merge 10 commits into
Haoling Dong (haolingdong-msft) wants to merge 10 commits into
Conversation
Move maintenance workflow from azure-sdk-tools into the canonical specs repository and evaluate specs-hosted skill refs through the tools benchmark. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Next Steps to Merge✅ All automated merging requirements have been met! To get your PR merged, see aka.ms/azsdk/specreview/merge.Comment generated by summarize-checks workflow run. |
Use native TypeScript execution with strict project checks and hermetic workflow coverage. Document that specs-hosted benchmark integration is deferred and only local skip-eval maintenance is currently supported. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Haoling Dong (haolingdong-msft)
changed the title
Register the maintenance package and tests in the shared workspace, use catalog dependencies and the root lockfile, and correct contributor commands and README formatting. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Disallow MCP tools and fallback retrieval during intake, including for uncovered cases or insufficient guidance. Restrict MCP knowledge retrieval and validation to their later workflow steps while preserving case-specific intake and planning guidance. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Revert f69247c because the user intended the intake-only correction for PR Azure#47350, not Azure#47317. Preserve the refinement pnpm workspace CI fix unchanged. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Restore standalone npm dependency management and remove the local-only workflow from the root pnpm and Vitest workspaces. Exclude the package from root TypeScript and type-aware lint while retaining focused local type checks and hermetic tests. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Restore the root pnpm lockfile and workspace manifest to this branch merge-base so the local-only workflow does not change either file in the pull request. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Restore the repository root Oxlint configuration and isolate the local-only maintenance package through its own nested config. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Arthur Ma (ArthurMa1978)
approved these changes
Oct 16, 2026
Haoling Dong (haolingdong-msft)
marked this pull request as ready for review
October 16, 2026 09:51
Haoling Dong (haolingdong-msft)
requested review from
a team,
Crystal YU (chunyu3) and
Renhe Li (lirenhe)
as code owners
October 16, 2026 09:51
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Move
.github/skills/azure-typespec-author/agentic-doc-refinementfrom the tools repository into specs, making this repository the source of truth for the skill and its maintenance workflow.doc-refinement.tsentry point with Node.js built-in TypeScript execution (Node >= 24.14.1), strict project checks, and 17 hermetic regression tests.package-lock.json; runnpm ciin the package directory.Azure/azure-rest-api-specs.agentic-doc-refinement/results/directory.SKILL.md, references, and maintenance prompts are unchanged by the TypeScript conversion.Because this workflow is local-only, the PR does not modify root
.oxlintrc.json,pnpm-lock.yaml,pnpm-workspace.yaml, orvitest.config.mts. The package is excluded from root TypeScript through.github/tsconfig.jsonand from root type-aware lint through its own nested.oxlintrc.json; repository formatting still covers its files.Companion PR and evaluation limitation
Companion: Azure/azure-sdk-tools#17276. Its requested scope is removal only: delete the old maintenance directory without changing evaluation pipelines, helpers, or fixtures.
Follows the agreement in Azure/azure-sdk-tools#17263.
Local
--skip-evalmaintenance works independently. Full specs-hosted evaluation is currently blocked: the existing tools benchmark resolves skill refs against its own repository and does not support theSkillRepositoryparameter sent by the migrated workflow. The companion removal PR will not enable this integration; any cross-repository evaluation support requires a separately requested follow-up.Validation
The standalone
npm ci, strict TypeScript check, all 17 hermetic workflow tests, native Node CLI help, root GitHub TypeScript check, root lint with package-local isolation, repository formatting, package-lock consistency, and scoped whitespace checks passed locally. The live PR file list confirms that root.oxlintrc.json,pnpm-lock.yaml,pnpm-workspace.yaml, andvitest.config.mtsare unchanged.Tests cover both workflow modes, argument validation, specs ref resolution, exact benchmark request parameters, report outputs, and explicit failure paths. Mocked checks do not establish live benchmark compatibility. No live Copilot maintenance run or ADO benchmark was queued.