Skip to content

Sync .github/skills directory with azure-sdk-tools for PR 17350 - #64143

Merged
Praveen Kuttappan (praveenkuttappan) merged 3 commits into
mainfrom
sync-.github-skills-fix/eval-mcp-app-runtime-17350
Oct 22, 2026
Merged

Praveen Kuttappan (praveenkuttappan) merged 3 commits into
mainfrom
sync-.github-skills-fix/eval-mcp-app-runtime-17350

Conversation

@azure-sdk-automation

Copy link
Copy Markdown
Contributor

Sync .github/skills directory with azure-sdk-tools for PR Azure/azure-sdk-tools#17350 See eng/common workflow

Copilot AI balanced review requested due to automatic review settings October 22, 2026 21:30
@azure-sdk-automation azure-sdk-automation Bot added EngSys This issue is impacting the engineering system. Central-EngSys This issue is owned by the Engineering System team. labels Oct 22, 2026
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
13 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Changes recommended

The new evaluations depend on a missing skill definition, and the generation anti-trigger conflicts with the skill’s documented routing.

2 open issues
What changed in this PR

Syncs skill evaluations from azure-sdk-tools PR #17350 into the .NET repository, updating evaluation configuration and routing checks.

Changes:

  • Replaces top-level config with defaults in four evaluation suites.
  • Adds generation and breaking-change trigger evaluations and updates release skill invocation checks.
  • Makes the release-plan schedule-risk prompt use next calendar month instead of a fixed date.
File Description
.github/​skills/​azsdk-common-sdk-release/​evals/​eval.yaml Updates defaults, skill loading, and invocation grading.
.github/​skills/​azsdk-common-sdk-breaking-change/​evals/​trigger.eval.yaml Adds a breaking-change skill trigger evaluation.
.github/​skills/​azsdk-common-prepare-release-plan/​evals/​schedule-risk.eval.yaml Uses a relative future release month and adds an explanatory comment.
.github/​skills/​azsdk-common-prepare-release-plan/​evals/​eval.yaml Migrates configuration to defaults.
.github/​skills/​azsdk-common-generate-sdk-locally/​evals/​trigger.eval.yaml Adds generation trigger and breaking-change anti-trigger cases.
.github/​skills/​azsdk-common-generate-sdk-locally/​evals/​eval.yaml Migrates configuration to defaults.
.github/​skills/​azsdk-common-apiview-feedback-resolution/​evals/​eval.yaml Migrates configuration to defaults.

Review effort: Balanced

@praveenkuttappan
Praveen Kuttappan (praveenkuttappan) merged commit 85be5f7 into main Oct 22, 2026
40 of 41 checks passed
@praveenkuttappan
Praveen Kuttappan (praveenkuttappan) deleted the sync-.github-skills-fix/eval-mcp-app-runtime-17350 branch October 22, 2026 21:57
RuiJun Hu (MSFT) (cxznmhdcxz) pushed a commit to cxznmhdcxz/azure-sdk-for-net that referenced this pull request Nov 6, 2026
…e#64143)

* Fix Vally 0.19 schema loading outside TypeSpec benchmarks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants