Skip to content

Fix duplicate entries in Skills Loaded (and Agents Invoked) columns of evaluation table#462

Merged
ViktorHofer merged 3 commits into
mainfrom
copilot/remove-duplicate-entries-evaluate-table
Mar 30, 2026
Merged

Fix duplicate entries in Skills Loaded (and Agents Invoked) columns of evaluation table#462
ViktorHofer merged 3 commits into
mainfrom
copilot/remove-duplicate-entries-evaluate-table

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Mar 28, 2026

When isolated and plugin runs produce identical skill activation, the "Skills Loaded" column renders the same entry twice separated by /:

✅ migrating-newtonsoft-to-system-text-json; tools: report_intent, skill / ✅ migrating-newtonsoft-to-system-text-json; tools: report_intent, skill

Changes

  • Reporter.cs: Skip appending the plugin activation string when it is equal to the isolated activation string. Same deduplication applied to the "Agents Invoked" column.

  • OverfittingJudgeTests.cs: Two new tests — one asserting no duplication when isolated and plugin activations are identical, one asserting both entries still appear when they differ.


⚡ Quickly spin up Copilot coding agent tasks from anywhere on your macOS or Windows machine with Raycast.

Copilot AI linked an issue Mar 28, 2026 that may be closed by this pull request
Copilot AI and others added 2 commits March 28, 2026 05:47
Agent-Logs-Url: https://github.com/dotnet/skills/sessions/2430176d-bf62-461d-bb79-781e34d7d084

Co-authored-by: danmoseley <6385855+danmoseley@users.noreply.github.com>
Copilot AI changed the title [WIP] Fix double entries in evaluate table Fix duplicate entries in Skills Loaded (and Agents Invoked) columns of evaluation table Mar 28, 2026
Copilot AI requested a review from danmoseley March 28, 2026 05:49
@danmoseley danmoseley requested a review from Copilot March 28, 2026 06:42
@danmoseley danmoseley marked this pull request as ready for review March 28, 2026 14:51
@ViktorHofer
Copy link
Copy Markdown
Member

/evaluate

@ViktorHofer ViktorHofer enabled auto-merge (squash) March 30, 2026 09:55
@ViktorHofer ViktorHofer merged commit d8d3f3d into main Mar 30, 2026
38 checks passed
@ViktorHofer ViktorHofer deleted the copilot/remove-duplicate-entries-evaluate-table branch March 30, 2026 10:56
@github-actions
Copy link
Copy Markdown
Contributor

Skill Validation Results

Skill Scenario Quality Skills Loaded Overfit Verdict
dotnet-pinvoke Generate LibraryImport declaration from C header (.NET 8+) 5.0/5 → 5.0/5 ✅ dotnet-pinvoke; tools: skill ✅ 0.05 [1]
dotnet-pinvoke Generate LibraryImport declaration from C header (.NET Framework) 5.0/5 → 5.0/5 ✅ dotnet-pinvoke; tools: skill ✅ 0.05 [2]
nuget-trusted-publishing Set up trusted publishing for a new NuGet library 3.0/5 → 4.0/5 🟢 ✅ nuget-trusted-publishing; tools: skill / ✅ nuget-trusted-publishing; tools: skill, task, read_agent ✅ 0.10
nuget-trusted-publishing Set up NuGet publishing without mentioning trusted publishing 3.0/5 → 4.0/5 🟢 ✅ nuget-trusted-publishing; tools: skill, report_intent, glob, view, bash, create / ✅ nuget-trusted-publishing; tools: report_intent, skill, view ✅ 0.10
nuget-trusted-publishing Migrate existing workflow from API key to trusted publishing 3.0/5 → 4.0/5 🟢 ✅ nuget-trusted-publishing; tools: skill / ✅ nuget-trusted-publishing; tools: skill, task, bash, view ✅ 0.10
csharp-scripts Test a C# language feature with a script 3.0/5 → 4.0/5 🟢 ✅ csharp-scripts; tools: skill, create 🟡 0.32
mcp-csharp-create Implement MCP tools with proper attributes and DI 1.0/5 ⏰ → 4.0/5 🟢 ✅ mcp-csharp-create; tools: skill, view, create, edit / ✅ mcp-csharp-create; tools: skill, view, edit ✅ 0.10
mcp-csharp-create Create an HTTP MCP server with tools and resources 1.0/5 ⏰ → 5.0/5 🟢 ✅ mcp-csharp-create; tools: skill, create, stop_bash / ✅ mcp-csharp-create; tools: skill, create ✅ 0.10 [3]
mcp-csharp-create Create an MCP server with tools, prompts, and proper logging 4.0/5 → 4.0/5 ✅ mcp-csharp-create; tools: skill ✅ 0.10
mcp-csharp-test Write unit and integration tests for an MCP server 2.0/5 → 4.0/5 🟢 ✅ mcp-csharp-test; tools: skill, report_intent, view 🟡 0.29
mcp-csharp-test Test an HTTP MCP server with WebApplicationFactory 4.0/5 → 5.0/5 🟢 ✅ mcp-csharp-test; tools: skill, report_intent, view 🟡 0.29 [4]
mcp-csharp-test Create evaluations for an MCP server 4.0/5 → 4.0/5 ✅ mcp-csharp-test; tools: skill 🟡 0.29
mcp-csharp-publish Publish an MCP server as a NuGet tool package 3.0/5 → 4.0/5 🟢 ✅ mcp-csharp-publish; tools: skill, glob 🟡 0.21
mcp-csharp-publish Deploy an HTTP MCP server to Azure Container Apps 3.0/5 → 5.0/5 🟢 ✅ mcp-csharp-publish; tools: skill, report_intent, view 🟡 0.21
mcp-csharp-publish Publish to the MCP Registry 1.0/5 → 4.0/5 🟢 ✅ mcp-csharp-publish; tools: report_intent, skill 🟡 0.21
mcp-csharp-debug Debug an MCP server with MCP Inspector 5.0/5 → 4.0/5 🔴 ✅ mcp-csharp-debug; tools: report_intent, skill / ✅ mcp-csharp-debug; tools: skill ✅ 0.14
mcp-csharp-debug Configure VS Code to use an MCP server 4.0/5 → 5.0/5 🟢 ✅ mcp-csharp-debug; tools: skill, view, glob ✅ 0.14 [5]
mcp-csharp-debug Debug a failing MCP server tool 5.0/5 → 4.0/5 🔴 ✅ mcp-csharp-debug; tools: skill ✅ 0.14
technology-selection ML.NET classification on tabular data 3.0/5 → 5.0/5 🟢 ✅ technology-selection; tools: skill 🟡 0.35
technology-selection LLM integration with MEAI abstraction 1.0/5 → 1.0/5 ⚠️ NOT ACTIVATED 🟡 0.35 [6]
technology-selection Reject LLM for tabular classification 3.0/5 → 2.0/5 🔴 ✅ technology-selection; tools: skill 🟡 0.35
technology-selection Agentic workflow with guardrails 3.0/5 → 1.0/5 ⏰ 🔴 ✅ technology-selection; tools: skill, read_agent, create / ✅ technology-selection; tools: skill, read_agent, grep, create 🟡 0.35
technology-selection Natural-language scenario decomposition — RAG chatbot 3.0/5 → 4.0/5 🟢 ✅ technology-selection; tools: skill, edit / ✅ technology-selection; tools: skill 🟡 0.35
technology-selection RAG pipeline with vector search 3.0/5 → 4.0/5 🟢 ✅ technology-selection; tools: skill 🟡 0.35
exp-simd-vectorization Optimize manual min/max with TensorPrimitives 1.0/5 → 5.0/5 🟢 ✅ exp-simd-vectorization; tools: skill, glob, create, bash ✅ 0.18
exp-simd-vectorization Optimize manual product with TensorPrimitives 1.0/5 → 5.0/5 🟢 ✅ exp-simd-vectorization; tools: skill, glob, create, bash ✅ 0.18
exp-simd-vectorization No optimization opportunity — dictionary-based lookup service 2.0/5 → 5.0/5 🟢 ✅ exp-simd-vectorization; tools: skill ✅ 0.18
exp-simd-vectorization Optimize int array conditional increment with SIMD 3.0/5 → 4.0/5 🟢 ✅ exp-simd-vectorization; tools: skill ✅ 0.18
exp-simd-vectorization Optimize byte buffer bit reversal with SIMD 1.0/5 ⏰ → 4.0/5 ⏰ 🟢 ✅ exp-simd-vectorization; tools: skill, edit, bash / ✅ exp-simd-vectorization; tools: skill, edit ✅ 0.18
exp-test-maintainability Recommend data-driven patterns with display names for unclear parameters 4.0/5 → 4.0/5 ✅ exp-test-maintainability; tools: skill / ⚠️ NOT ACTIVATED ✅ 0.14 [7]
exp-test-maintainability Recognize well-maintained tests that need minimal changes 5.0/5 → 5.0/5 ✅ exp-test-maintainability; tools: report_intent, skill ✅ 0.14 [8]
exp-test-tagging Tag an untagged MSTest test suite 4.0/5 → 4.0/5 ✅ exp-test-tagging; tools: skill / ✅ exp-test-tagging; tools: skill, glob ✅ 0.11
exp-test-tagging Tag an untagged xUnit test suite 4.0/5 → 5.0/5 🟢 ✅ exp-test-tagging; tools: skill / ✅ exp-test-tagging; tools: skill, glob ✅ 0.11
exp-test-tagging Tag an untagged NUnit test suite 3.0/5 → 5.0/5 🟢 ✅ exp-test-tagging; tools: skill, glob ✅ 0.11
exp-test-tagging Audit test distribution without modifying files 5.0/5 → 5.0/5 ✅ exp-test-tagging; tools: skill ✅ 0.11
exp-test-tagging Decline request to write new tests 4.0/5 → 4.0/5 ℹ️ not activated (expected) ✅ 0.11 [9]
mtp-hot-reload Suggest hot reload for failing test in MTP project (SDK 9) 1.0/5 → 4.0/5 🟢 ✅ mtp-hot-reload; tools: skill, stop_bash / ✅ mtp-hot-reload; tools: skill 🟡 0.21
mtp-hot-reload Suggest hot reload for failing test in MTP project (SDK 10) 1.0/5 → 4.0/5 🟢 ✅ mtp-hot-reload; tools: skill, bash, create 🟡 0.21
mtp-hot-reload Enable hot reload when package already installed 2.0/5 → 5.0/5 🟢 ✅ mtp-hot-reload; tools: skill, bash / ✅ mtp-hot-reload; tools: skill 🟡 0.21
mtp-hot-reload Suggest launchSettings.json configuration for hot reload 1.0/5 → 4.0/5 🟢 ✅ mtp-hot-reload; tools: skill, bash, create 🟡 0.21
mtp-hot-reload Use dotnet run not dotnet test for hot reload 3.0/5 → 3.0/5 ✅ mtp-hot-reload; tools: skill 🟡 0.21
mtp-hot-reload Negative: VSTest project cannot use MTP hot reload 1.0/5 → 3.0/5 🟢 ✅ mtp-hot-reload; tools: skill / ✅ mtp-hot-reload; tools: skill, create 🟡 0.21
mtp-hot-reload Run specific failing test with hot reload filter 1.0/5 → 3.0/5 🟢 ✅ mtp-hot-reload; tools: skill 🟡 0.21
migrate-vstest-to-mtp Migrate MSTest project from VSTest to Microsoft.Testing.Platform 4.0/5 → 5.0/5 🟢 ✅ migrate-vstest-to-mtp; tools: skill / ✅ migrate-vstest-to-mtp; tools: skill, report_intent, view ✅ 0.06
migrate-vstest-to-mtp Migrate NUnit project from VSTest to Microsoft.Testing.Platform 1.0/5 → 5.0/5 🟢 ✅ migrate-vstest-to-mtp; tools: skill ✅ 0.06
migrate-vstest-to-mtp Migrate xUnit.net v2 project from VSTest to Microsoft.Testing.Platform 2.0/5 → 5.0/5 🟢 ✅ migrate-vstest-to-mtp; tools: skill, report_intent, bash / ✅ migrate-vstest-to-mtp; tools: skill, report_intent, view ✅ 0.06
migrate-vstest-to-mtp Update Azure DevOps pipeline from VSTest task to MTP 4.0/5 → 5.0/5 🟢 ✅ migrate-vstest-to-mtp; tools: skill ✅ 0.06
migrate-vstest-to-mtp Migrate MSTest.Sdk project that explicitly uses VSTest 3.0/5 → 5.0/5 🟢 ✅ migrate-vstest-to-mtp; tools: skill ✅ 0.06
migrate-vstest-to-mtp Translate dotnet test VSTest arguments to MTP equivalents 5.0/5 → 5.0/5 ✅ migrate-vstest-to-mtp; tools: skill ✅ 0.06 [10]
migrate-vstest-to-mtp Handle exit code 8 when migrating from VSTest to MTP 2.0/5 → 5.0/5 🟢 ✅ migrate-vstest-to-mtp; tools: skill ✅ 0.06
migrate-vstest-to-mtp Configure dotnet test MTP mode on .NET 10 SDK 2.0/5 → 5.0/5 🟢 ✅ migrate-vstest-to-mtp; tools: skill ✅ 0.06
migrate-vstest-to-mtp Migrate xUnit.net VSTest filter syntax to MTP 4.0/5 → 5.0/5 🟢 ✅ migrate-vstest-to-mtp; tools: skill ✅ 0.06 [11]
migrate-vstest-to-mtp Full VSTest to MTP migration plan for MSTest solution 4.0/5 → 5.0/5 🟢 ✅ migrate-vstest-to-mtp; tools: skill ✅ 0.06
migrate-mstest-v1v2-to-v3 Migrate MSTest v1 project with assembly reference 3.0/5 → 5.0/5 🟢 ✅ migrate-mstest-v1v2-to-v3; tools: skill / ✅ migrate-mstest-v1v2-to-v3; tools: skill, edit, bash ✅ 0.04
migrate-mstest-v1v2-to-v3 Migrate MSTest v2 NuGet project to v3 4.0/5 → 3.0/5 🔴 ✅ migrate-mstest-v1v2-to-v3; tools: skill ✅ 0.04
migrate-mstest-v1v2-to-v3 Fix Assert.AreEqual object overload errors after v3 upgrade 4.0/5 → 5.0/5 🟢 ✅ migrate-mstest-v1v2-to-v3; tools: skill ✅ 0.04
migrate-mstest-v1v2-to-v3 Migrate from .testsettings to .runsettings 4.0/5 → 4.0/5 ✅ migrate-mstest-v1v2-to-v3; tools: skill, bash ✅ 0.04 [12]
migrate-mstest-v1v2-to-v3 Fix DataRow type mismatch errors after v3 upgrade 4.0/5 → 4.0/5 ✅ migrate-mstest-v1v2-to-v3; tools: skill ✅ 0.04
migrate-mstest-v1v2-to-v3 Migrate to MSTest.Sdk project style 3.0/5 → 5.0/5 🟢 ✅ migrate-mstest-v1v2-to-v3; tools: skill ✅ 0.04
migrate-mstest-v1v2-to-v3 Handle dropped target framework during v3 migration 5.0/5 → 5.0/5 ⚠️ NOT ACTIVATED / ✅ migrate-mstest-v1v2-to-v3; tools: skill ✅ 0.04 [13]
migrate-mstest-v1v2-to-v3 Migrate complex MSTest v2 project with testsettings, DataRow issues, and dropped TFM 3.0/5 → 5.0/5 🟢 ✅ migrate-mstest-v1v2-to-v3; tools: skill ✅ 0.04
migrate-mstest-v1v2-to-v3 Correctly identify MSTest v1 vs v2 and recommend different migration paths 4.0/5 → 5.0/5 🟢 ✅ migrate-mstest-v1v2-to-v3; tools: skill, task, read_agent, glob / ✅ migrate-mstest-v1v2-to-v3; tools: skill ✅ 0.04
migrate-mstest-v3-to-v4 Migrate custom TestMethodAttribute from Execute to ExecuteAsync 2.0/5 → 3.0/5 🟢 ✅ migrate-mstest-v3-to-v4; tools: skill ✅ 0.08
migrate-mstest-v3-to-v4 Replace ExpectedExceptionAttribute with Assert.ThrowsExactly 4.0/5 → 4.0/5 ⚠️ NOT ACTIVATED / ✅ migrate-mstest-v3-to-v4; tools: skill ✅ 0.08 [14]
migrate-mstest-v3-to-v4 Fix multiple v4 breaking changes: Assert, ClassCleanup, TestContext, Timeout 4.0/5 → 5.0/5 🟢 ✅ migrate-mstest-v3-to-v4; tools: skill ✅ 0.08
migrate-mstest-v3-to-v4 Handle net6.0 target framework dropped in MSTest v4 3.0/5 → 4.0/5 🟢 ⚠️ NOT ACTIVATED ✅ 0.08
migrate-mstest-v3-to-v4 Fix TestMethodAttribute CallerInfo constructor breaking change 4.0/5 → 4.0/5 ✅ migrate-mstest-v3-to-v4; tools: skill ✅ 0.08
migrate-mstest-v3-to-v4 Understand behavioral changes after MSTest v4 upgrade 3.0/5 → 5.0/5 🟢 ✅ migrate-mstest-v3-to-v4; tools: skill ✅ 0.08
migrate-mstest-v3-to-v4 Handle MSTest.Sdk and MTP changes in v4 2.0/5 → 3.0/5 🟢 ✅ migrate-mstest-v3-to-v4; tools: skill ✅ 0.08
migrate-mstest-v3-to-v4 Full MSTest v3 to v4 migration with multiple breaking changes 3.0/5 → 5.0/5 🟢 ✅ migrate-mstest-v3-to-v4; tools: skill ✅ 0.08
migrate-mstest-v3-to-v4 Migrate MSTest.Sdk v3 project using ManagedType and TestTimeout 3.0/5 → 4.0/5 🟢 ✅ migrate-mstest-v3-to-v4; tools: skill ✅ 0.08
migrate-mstest-v3-to-v4 Correctly identify MSTest v3 project and recommend v4 migration 5.0/5 → 5.0/5 ✅ migrate-mstest-v3-to-v4; tools: skill ✅ 0.08
run-tests Run tests in a VSTest MSTest project 4.0/5 → 5.0/5 🟢 ✅ run-tests; tools: skill ✅ 0.17
run-tests Run tests with trx reporting on MTP project (SDK 9) 3.0/5 ⏰ → 4.0/5 🟢 ✅ run-tests; tools: skill ✅ 0.17
run-tests Run tests with blame-hang on MTP project (SDK 10) 2.0/5 → 2.0/5 ✅ run-tests; tools: skill ✅ 0.17 [15]
run-tests Run tests in a multi-TFM project targeting a specific framework 2.0/5 → 5.0/5 🟢 ✅ run-tests; tools: skill, bash, glob ✅ 0.17
run-tests Filter MSTest tests by category on VSTest 5.0/5 → 5.0/5 ⚠️ NOT ACTIVATED / ✅ run-tests; tools: skill ✅ 0.17 [16]
run-tests Filter NUnit tests by class name on VSTest 4.0/5 → 5.0/5 🟢 ✅ run-tests; tools: skill, bash / ✅ run-tests; tools: skill, bash, glob ✅ 0.17
run-tests Filter xUnit v3 tests by class on MTP 1.0/5 → 5.0/5 🟢 ✅ run-tests; tools: skill, bash / ✅ run-tests; tools: skill ✅ 0.17
run-tests Filter xUnit v3 tests by trait on MTP 1.0/5 → 5.0/5 🟢 ✅ run-tests; tools: skill, view ✅ 0.17
run-tests Filter TUnit tests by class using treenode-filter 1.0/5 → 5.0/5 🟢 ⚠️ NOT ACTIVATED / ✅ run-tests; tools: skill ✅ 0.17
run-tests Combine multiple filter criteria on VSTest MSTest 4.0/5 → 4.0/5 ✅ run-tests; tools: skill, bash / ✅ run-tests; tools: skill ✅ 0.17 [17]
run-tests MTP project on SDK 9 must use -- separator for args 1.0/5 → 5.0/5 🟢 ✅ run-tests; tools: skill ✅ 0.17
run-tests MTP project on SDK 10 passes args directly 3.0/5 → 4.0/5 🟢 ✅ run-tests; tools: skill / ✅ run-tests; tools: skill, glob ✅ 0.17 [18]
run-tests Detect test platform from Directory.Build.props 3.0/5 → 5.0/5 🟢 ✅ run-tests; tools: skill ✅ 0.17
run-tests Negative test: do not use MTP syntax for a VSTest project 4.0/5 → 5.0/5 🟢 ✅ run-tests; tools: skill, view / ✅ run-tests; tools: skill, view, glob ✅ 0.17
writing-mstest-tests Write unit tests for a service class 2.0/5 ⏰ → 4.0/5 🟢 ✅ writing-mstest-tests; tools: skill / ✅ writing-mstest-tests; tools: skill, task, glob, grep 🟡 0.29
writing-mstest-tests Write data-driven tests for a calculator 4.0/5 → 3.0/5 ⏰ 🔴 ✅ writing-mstest-tests; tools: skill / ✅ writing-mstest-tests; tools: skill, edit 🟡 0.29
writing-mstest-tests Write async tests with cancellation 2.0/5 → 5.0/5 🟢 ✅ writing-mstest-tests; tools: skill 🟡 0.29
writing-mstest-tests Fix swapped Assert.AreEqual arguments 5.0/5 → 5.0/5 ✅ writing-mstest-tests; tools: skill 🟡 0.29 [19]
writing-mstest-tests Modernize legacy test patterns 2.0/5 ⏰ → 5.0/5 🟢 ✅ writing-mstest-tests; tools: skill 🟡 0.29
writing-mstest-tests Replace ExpectedException with Assert.Throws 3.0/5 → 5.0/5 🟢 ✅ writing-mstest-tests; tools: skill / ✅ writing-mstest-tests; tools: report_intent, skill 🟡 0.29
writing-mstest-tests Use proper collection assertions 3.0/5 → 3.0/5 ✅ writing-mstest-tests; tools: skill 🟡 0.29
writing-mstest-tests Use proper type assertions instead of casts 3.0/5 → 3.0/5 ⚠️ NOT ACTIVATED 🟡 0.29
writing-mstest-tests Set up test lifecycle correctly 1.0/5 → 4.0/5 🟢 ✅ writing-mstest-tests; tools: skill 🟡 0.29
writing-mstest-tests Use DynamicData with ValueTuples over object arrays 4.0/5 → 4.0/5 ✅ writing-mstest-tests; tools: skill / ✅ writing-mstest-tests; tools: report_intent, skill 🟡 0.29
crap-score Calculate CRAP score for a single method with partial coverage 3.0/5 → 4.0/5 🟢 ✅ crap-score; tools: skill, glob ✅ 0.11
crap-score Identify riskiest methods across a file 4.0/5 → 5.0/5 🟢 ✅ crap-score; tools: skill, bash ✅ 0.11
crap-score Generate coverage then compute CRAP score 3.0/5 → 4.0/5 🟢 ✅ crap-score; tools: skill ✅ 0.11 [20]
test-anti-patterns Detect mixed severity anti-patterns in repository service tests 5.0/5 → 5.0/5 ✅ test-anti-patterns; tools: report_intent, skill / ✅ test-anti-patterns; tools: skill, report_intent ✅ 0.06
test-anti-patterns Detect flakiness indicators and test coupling 3.0/5 → 5.0/5 🟢 ✅ test-anti-patterns; tools: report_intent, skill ✅ 0.06
test-anti-patterns Detect duplicated tests and magic values 3.0/5 → 5.0/5 🟢 ✅ test-anti-patterns; tools: skill / ✅ test-anti-patterns; tools: report_intent, skill ✅ 0.06
test-anti-patterns Recognize well-written tests without inventing false positives 2.0/5 → 5.0/5 🟢 ✅ test-anti-patterns; tools: report_intent, skill ✅ 0.06
dotnet-maui-doctor Plan macOS MAUI setup with Xcode 3.0/5 → 5.0/5 🟢 ✅ dotnet-maui-doctor; tools: report_intent, skill, view ✅ 0.16
dotnet-maui-doctor Plan Linux MAUI environment for Android 3.0/5 → 5.0/5 🟢 ✅ dotnet-maui-doctor; tools: report_intent, skill, bash, view / ✅ dotnet-maui-doctor; tools: report_intent, skill, view, bash ✅ 0.16
dotnet-maui-doctor Guardrail against workload update and repair 1.0/5 → 3.0/5 🟢 ✅ dotnet-maui-doctor; tools: report_intent, skill ✅ 0.16
dotnet-maui-doctor Diagnose non-Microsoft JDK causing build failure 4.0/5 → 5.0/5 🟢 ✅ dotnet-maui-doctor; tools: skill ✅ 0.16
dotnet-maui-doctor Plan complete MAUI setup on Windows 4.0/5 → 5.0/5 🟢 ✅ dotnet-maui-doctor; tools: report_intent, skill, view ✅ 0.16 [21]
dotnet-maui-doctor Prevent incorrect JAVA_HOME configuration 3.0/5 → 5.0/5 🟢 ✅ dotnet-maui-doctor; tools: report_intent, skill / ✅ dotnet-maui-doctor; tools: report_intent, skill, view ✅ 0.16
dotnet-maui-doctor Determine required Android SDK packages for specific .NET version 3.0/5 → 4.0/5 🟢 ✅ dotnet-maui-doctor; tools: report_intent, skill, view, bash ✅ 0.16
dotnet-maui-doctor Fix stale MAUI workloads after SDK update 2.0/5 ⏰ → 4.0/5 🟢 ✅ dotnet-maui-doctor; tools: skill ✅ 0.16
optimizing-ef-core-queries Optimize bulk operations with EF Core 7+ ExecuteUpdate and ExecuteDelete 5.0/5 → 4.0/5 🔴 ✅ optimizing-ef-core-queries; tools: skill / ⚠️ NOT ACTIVATED 🟡 0.31 [22]
dotnet-trace-collect High CPU in Kubernetes on Linux (.NET 8) 3.0/5 → 3.0/5 ✅ dotnet-trace-collect; tools: skill, report_intent, view ✅ 0.14
dotnet-trace-collect .NET Framework on Windows without admin privileges 1.0/5 → 5.0/5 🟢 ✅ dotnet-trace-collect; tools: skill ✅ 0.14
dotnet-trace-collect .NET 10 on Linux with root access and native call stacks 1.0/5 ⏰ → 4.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view ✅ 0.14
dotnet-trace-collect Memory leak on Linux (.NET 8) 3.0/5 → 3.0/5 ✅ dotnet-trace-collect; tools: skill, report_intent, view / ✅ dotnet-trace-collect; tools: skill ✅ 0.14
dotnet-trace-collect Slow requests on Windows with PerfView 5.0/5 → 5.0/5 ✅ dotnet-trace-collect; tools: skill, report_intent, view / ✅ dotnet-trace-collect; tools: skill ✅ 0.14 [23]
dotnet-trace-collect Excessive GC on Linux (.NET 8) 3.0/5 → 4.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view ✅ 0.14
dotnet-trace-collect Hang or deadlock diagnosis on Linux 3.0/5 → 4.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view / ✅ dotnet-trace-collect; tools: skill ✅ 0.14
dotnet-trace-collect Windows container high CPU with PerfView 1.0/5 → 5.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view ✅ 0.14
dotnet-trace-collect Long-running intermittent issue with PerfView triggers 3.0/5 → 4.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view ✅ 0.14
dotnet-trace-collect Linux pre-.NET 10 needing native call stacks 4.0/5 → 5.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view ✅ 0.14
dotnet-trace-collect Windows modern .NET with admin high CPU 2.0/5 → 5.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view ✅ 0.14
dotnet-trace-collect Memory leak on .NET Framework Windows 3.0/5 → 5.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view / ✅ dotnet-trace-collect; tools: report_intent, skill, view ✅ 0.14
dotnet-trace-collect Kubernetes with console access prefers console tools 4.0/5 → 5.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view ✅ 0.14
dotnet-trace-collect Container installation without .NET SDK 4.0/5 → 4.0/5 ✅ dotnet-trace-collect; tools: skill ✅ 0.14
dotnet-trace-collect HTTP 500s from downstream service on Linux (.NET 8) 4.0/5 → 4.0/5 ✅ dotnet-trace-collect; tools: skill, report_intent, view ✅ 0.14
dotnet-trace-collect Networking timeouts on Windows with admin (.NET 8) 2.0/5 → 5.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view ✅ 0.14
dotnet-trace-collect Assembly loading failure on Linux (.NET 8) 4.0/5 → 5.0/5 🟢 ✅ dotnet-trace-collect; tools: skill, report_intent, view / ⚠️ NOT ACTIVATED ✅ 0.14
android-tombstone-symbolication Symbolicate .NET frames in an Android tombstone 4.0/5 → 3.0/5 🔴 ✅ android-tombstone-symbolication; tools: skill 🟡 0.20
android-tombstone-symbolication Recognize tombstone with no .NET frames 5.0/5 → 5.0/5 ✅ android-tombstone-symbolication; tools: skill, bash 🟡 0.20 [24]
android-tombstone-symbolication Symbolicate CoreCLR frames in an Android tombstone 1.0/5 ⏰ → 3.0/5 🟢 ✅ android-tombstone-symbolication; tools: skill, read_bash 🟡 0.20
android-tombstone-symbolication Recognize NativeAOT tombstone with app binary and libSystem.Native.so 3.0/5 → 4.0/5 ⏰ 🟢 ✅ android-tombstone-symbolication; tools: skill, bash, read_bash, stop_bash / ✅ android-tombstone-symbolication; tools: skill, bash, stop_bash, read_bash 🟡 0.20
android-tombstone-symbolication Symbolicate multi-thread tombstone 4.0/5 → 5.0/5 🟢 ✅ android-tombstone-symbolication; tools: skill 🟡 0.20
android-tombstone-symbolication Handle .NET frames with no BuildId metadata 4.0/5 → 5.0/5 🟢 ✅ android-tombstone-symbolication; tools: skill, bash 🟡 0.20 [25]
android-tombstone-symbolication Symbolicate tombstone with multiple .NET libraries and different BuildIds 3.0/5 → 2.0/5 ⏰ 🔴 ✅ android-tombstone-symbolication; tools: skill, read_bash / ✅ android-tombstone-symbolication; tools: skill 🟡 0.20
android-tombstone-symbolication Reject iOS crash log as wrong format 5.0/5 → 5.0/5 ℹ️ not activated (expected) 🟡 0.20 [26]
dump-collect Configure automatic crash dumps for CoreCLR app on Linux 5.0/5 → 5.0/5 ✅ dump-collect; tools: skill, report_intent, view ✅ 0.15 [27]
dump-collect Set up NativeAOT crash dumps with createdump in Kubernetes 2.0/5 → 5.0/5 🟢 ✅ dump-collect; tools: skill, view ✅ 0.15
dump-collect Recover crash dump from macOS NativeAOT without createdump 3.0/5 → 5.0/5 🟢 ✅ dump-collect; tools: skill, report_intent, view / ⚠️ NOT ACTIVATED ✅ 0.15
dump-collect Configure CoreCLR dump collection in Alpine Docker as non-root 3.0/5 → 5.0/5 🟢 ✅ dump-collect; tools: skill, report_intent, view ✅ 0.15
dump-collect Advisory: macOS NativeAOT crash dump recovery steps 4.0/5 → 5.0/5 🟢 ✅ dump-collect; tools: skill, view ✅ 0.15
dump-collect Advisory: CoreCLR Alpine Docker non-root configuration 3.0/5 → 5.0/5 🟢 ✅ dump-collect; tools: skill, report_intent, view ✅ 0.15
dump-collect Advisory: NativeAOT Kubernetes dump collection setup 3.0/5 → 5.0/5 🟢 ✅ dump-collect; tools: skill, report_intent, view ✅ 0.15
dump-collect Detect runtime and configure crash dumps for unknown .NET app on Linux 3.0/5 → 5.0/5 🟢 ✅ dump-collect; tools: skill, view ✅ 0.15
dump-collect Decline dump analysis request 2.0/5 → 5.0/5 🟢 ℹ️ not activated (expected) ✅ 0.15 [28]
clr-activation-debugging Diagnose unexpected FOD dialog from native build tool 5.0/5 → 5.0/5 ⏰ ✅ clr-activation-debugging; tools: skill ✅ 0.06 [29]
clr-activation-debugging Diagnose FOD suppressed but activation still failing 3.0/5 → 5.0/5 🟢 ✅ clr-activation-debugging; tools: skill ✅ 0.06
clr-activation-debugging Explain why same binary behaves differently under different launch methods 5.0/5 → 5.0/5 ✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: skill, bash ✅ 0.06 [30]
clr-activation-debugging Analyze healthy managed EXE activation 5.0/5 → 5.0/5 ✅ clr-activation-debugging; tools: skill ✅ 0.06
clr-activation-debugging Identify multiple activation sequences in a single log 5.0/5 → 5.0/5 ✅ clr-activation-debugging; tools: skill ✅ 0.06
clr-activation-debugging Explain useLegacyV2RuntimeActivationPolicy in activation log 2.0/5 → 4.0/5 🟢 ✅ clr-activation-debugging; tools: skill / ✅ clr-activation-debugging; tools: report_intent, skill ✅ 0.06
clr-activation-debugging Decline non-CLR-activation issue 1.0/5 ⏰ → 5.0/5 🟢 ✅ clr-activation-debugging; tools: skill, bash / ℹ️ not activated (expected) ✅ 0.06
microbenchmarking Investigate runtime upgrade performance impact 4.0/5 → 4.0/5 ✅ microbenchmarking; tools: skill, edit ✅ 0.11
analyzing-dotnet-performance Detects compiled regex startup budget and regex chain allocations 1.0/5 ⏰ → 5.0/5 🟢 ✅ analyzing-dotnet-performance; tools: skill, bash ✅ 0.14
analyzing-dotnet-performance Detects CurrentCulture comparer and compiled regex budget in inflection rules 1.0/5 ⏰ → 5.0/5 🟢 ✅ analyzing-dotnet-performance; tools: skill, bash ✅ 0.14
analyzing-dotnet-performance Finds per-call Dictionary allocation not hoisted to static 5.0/5 → 5.0/5 ✅ analyzing-dotnet-performance; tools: skill, bash ✅ 0.14 [31]
analyzing-dotnet-performance Catches compound allocations in recursive number converter with ToLower 4.0/5 → 4.0/5 ✅ analyzing-dotnet-performance; tools: skill, bash ✅ 0.14 [32]
analyzing-dotnet-performance Finds StringComparison.Ordinal missing and FrozenDictionary opportunities 5.0/5 → 5.0/5 ✅ analyzing-dotnet-performance; tools: skill, grep / ✅ analyzing-dotnet-performance; tools: skill, bash, write_bash ✅ 0.14
analyzing-dotnet-performance Detects Aggregate+Replace chain and struct missing IEquatable 4.0/5 → 3.0/5 ⏰ 🔴 ✅ analyzing-dotnet-performance; tools: skill, bash ✅ 0.14
analyzing-dotnet-performance Finds branched Replace chain in format string manipulation 1.0/5 ⏰ → 1.0/5 ⏰ ✅ analyzing-dotnet-performance; tools: skill, bash, read_bash, stop_bash / ✅ analyzing-dotnet-performance; tools: skill, bash ✅ 0.14
analyzing-dotnet-performance Catches LINQ on hot-path string processing and All(char.IsUpper) 4.0/5 → 5.0/5 🟢 ✅ analyzing-dotnet-performance; tools: skill, bash ✅ 0.14
analyzing-dotnet-performance Detects LINQ pipeline in TimeSpan formatting and collection processing 5.0/5 → 1.0/5 ⏰ 🔴 ✅ analyzing-dotnet-performance; tools: skill, bash ✅ 0.14
analyzing-dotnet-performance Flags Span inconsistencies and compound method chains in truncation library 4.0/5 → 4.0/5 ✅ analyzing-dotnet-performance; tools: skill, bash / ✅ analyzing-dotnet-performance; tools: skill, bash, read_bash, write_bash, stop_bash ✅ 0.14 [33]
analyzing-dotnet-performance Identifies unsealed leaf classes and locale hierarchy patterns 2.0/5 ⏰ → 3.0/5 ⏰ 🟢 ✅ analyzing-dotnet-performance; tools: skill, bash ✅ 0.14
template-authoring Validate a template.json file 5.0/5 → 3.0/5 🔴 ✅ template-authoring; tools: skill ✅ 0.04 [34]
template-instantiation Create a console application 4.0/5 → 5.0/5 🟢 ✅ template-instantiation; tools: skill 🟡 0.38
template-instantiation Create project with specific framework 5.0/5 → 5.0/5 ⚠️ NOT ACTIVATED 🟡 0.38 [35]
template-discovery Find template for web API project 2.0/5 → 5.0/5 🟢 ✅ template-discovery; tools: report_intent, skill, bash 🟡 0.30
template-discovery Inspect template parameters 4.0/5 → 5.0/5 🟢 ✅ template-discovery; tools: skill 🟡 0.30
dotnet-aot-compat Make Azure.ResourceManager AOT-compatible 1.0/5 ⏰ → 1.0/5 ⏰ ✅ dotnet-aot-compat; tools: skill, read_bash / ✅ dotnet-aot-compat; tools: skill ✅ 0.14
migrate-nullable-references Enable NRT in a small library with mixed nullability 5.0/5 → 5.0/5 ✅ migrate-nullable-references; tools: skill ✅ 0.13 [36]
migrate-nullable-references File-by-file migration: only modify the targeted file 5.0/5 → 5.0/5 ⚠️ NOT ACTIVATED ✅ 0.13 [37]
migrate-nullable-references Enable NRT in ASP.NET Core Web API with EF Core 3.0/5 → 3.0/5 ⚠️ NOT ACTIVATED ✅ 0.13 [38]
migrate-dotnet10-to-dotnet11 Console app with compression and TAR operations 4.0/5 → 4.0/5 ✅ migrate-dotnet10-to-dotnet11; tools: skill ✅ 0.03
migrate-dotnet10-to-dotnet11 C# 15 compiler breaking changes — Span safe-context, nameof, with() 3.0/5 → 5.0/5 🟢 ✅ migrate-dotnet10-to-dotnet11; tools: skill, report_intent, view / ✅ migrate-dotnet10-to-dotnet11; tools: report_intent, skill, view ✅ 0.03
migrate-dotnet10-to-dotnet11 EF Core app with Cosmos DB provider using sync APIs 5.0/5 → 5.0/5 ✅ migrate-dotnet10-to-dotnet11; tools: skill, report_intent, view / ✅ migrate-dotnet10-to-dotnet11; tools: report_intent, skill, view ✅ 0.03 [39]
migrate-dotnet10-to-dotnet11 Deployment to older hardware with minimum requirement changes 2.0/5 → 5.0/5 🟢 ✅ migrate-dotnet10-to-dotnet11; tools: report_intent, skill, view ✅ 0.03
migrate-dotnet10-to-dotnet11 Cryptography app using DSA on macOS 4.0/5 → 5.0/5 🟢 ✅ migrate-dotnet10-to-dotnet11; tools: report_intent, skill, view ✅ 0.03 [40]
migrate-dotnet10-to-dotnet11 Basic TFM update with Docker and global.json 3.0/5 → 5.0/5 🟢 ✅ migrate-dotnet10-to-dotnet11; tools: skill ✅ 0.03
migrate-dotnet10-to-dotnet11 C# 15 dynamic operator and ref readonly delegate issues 3.0/5 → 4.0/5 🟢 ⚠️ NOT ACTIVATED / ✅ migrate-dotnet10-to-dotnet11; tools: report_intent, skill, view ✅ 0.03
migrate-dotnet8-to-dotnet9 App with empty environment variables, ZIP encoding, and keyed DI services 3.0/5 → 4.0/5 🟢 ✅ migrate-dotnet8-to-dotnet9; tools: skill, bash ✅ 0.07
migrate-dotnet8-to-dotnet9 C# 13 compiler breaking changes — InlineArray on record, iterator safe context, collection expressions 4.0/5 → 5.0/5 🟢 ✅ migrate-dotnet8-to-dotnet9; tools: skill, report_intent, view ✅ 0.07
migrate-dotnet8-to-dotnet9 ASP.NET Core app with DI validation, forwarded headers, and HttpClientFactory casting 2.0/5 → 5.0/5 🟢 ✅ migrate-dotnet8-to-dotnet9; tools: skill ✅ 0.07
migrate-dotnet8-to-dotnet9 EF Core app with migration patterns and Cosmos DB discriminator 3.0/5 → 4.0/5 🟢 ✅ migrate-dotnet8-to-dotnet9; tools: skill, bash ✅ 0.07
migrate-dotnet8-to-dotnet9 EF Core Cosmos DB app with existing documents and composite id format 4.0/5 → 4.0/5 ✅ migrate-dotnet8-to-dotnet9; tools: skill ✅ 0.07 [41]
migrate-dotnet8-to-dotnet9 App with JsonDocument null deserialization and BinaryFormatter fallback 5.0/5 → 5.0/5 ✅ migrate-dotnet8-to-dotnet9; tools: skill ✅ 0.07
migrate-dotnet8-to-dotnet9 CI pipeline with Terminal Logger parsing and version constraints 2.0/5 → 2.0/5 ℹ️ not activated (expected) / ✅ migrate-dotnet8-to-dotnet9; tools: skill ✅ 0.07 [42]
migrate-dotnet8-to-dotnet9 WinForms app with custom UserControls and PictureBox URL loading 3.0/5 → 5.0/5 🟢 ✅ migrate-dotnet8-to-dotnet9; tools: skill / ✅ migrate-dotnet8-to-dotnet9; tools: skill, create ✅ 0.07 [43]
migrate-dotnet8-to-dotnet9 Containerized app with zlib dependency and runtime configuration 5.0/5 → 4.0/5 🔴 ✅ migrate-dotnet8-to-dotnet9; tools: skill, bash / ✅ migrate-dotnet8-to-dotnet9; tools: skill ✅ 0.07 [44]
migrate-dotnet8-to-dotnet9 EF Core Cosmos DB app with discriminator and sync I/O 3.0/5 → 4.0/5 🟢 ✅ migrate-dotnet8-to-dotnet9; tools: skill ✅ 0.07
migrate-dotnet8-to-dotnet9 Library with String.Trim span overload, keyed services, and InlineArray 5.0/5 → 5.0/5 ✅ migrate-dotnet8-to-dotnet9; tools: skill, bash ✅ 0.07 [45]
migrate-dotnet8-to-dotnet9 Containerized app with env var precedence reversal and zlib removal 5.0/5 → 5.0/5 ✅ migrate-dotnet8-to-dotnet9; tools: skill ✅ 0.07
migrate-dotnet9-to-dotnet10 Console app with System.Linq.Async, SIGTERM, and BufferedStream 5.0/5 → 5.0/5 ✅ migrate-dotnet9-to-dotnet10; tools: skill, view [46]
migrate-dotnet9-to-dotnet10 Expression tree code broken by C# 14 span overload resolution 5.0/5 → 5.0/5 ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, grep, view / ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view [47]
migrate-dotnet9-to-dotnet10 ASP.NET Core app with WebHostBuilder, OpenAPI, and forwarded headers 4.0/5 → 4.0/5 ✅ migrate-dotnet9-to-dotnet10; tools: skill, report_intent, view / ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view [48]
migrate-dotnet9-to-dotnet10 ASP.NET Core app with OpenAPI transformers using Microsoft.OpenApi v1 APIs 3.0/5 → 5.0/5 🟢 ✅ migrate-dotnet9-to-dotnet10; tools: skill, bash / ✅ migrate-dotnet9-to-dotnet10; tools: skill, view, grep [49]
migrate-dotnet9-to-dotnet10 EF Core app with Azure SQL JSON columns and parameterized collections 3.0/5 → 5.0/5 🟢 ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view
migrate-dotnet9-to-dotnet10 EF Core app with dynamic ExecuteUpdate and complex types 5.0/5 → 5.0/5 ✅ migrate-dotnet9-to-dotnet10; tools: skill, view [50]
migrate-dotnet9-to-dotnet10 SQLite app with DateTimeOffset timezone handling 5.0/5 → 5.0/5 ✅ migrate-dotnet9-to-dotnet10; tools: skill, view [51]
migrate-dotnet9-to-dotnet10 Worker service with config null array binding and ProviderAlias assembly change 3.0/5 → 5.0/5 🟢 ✅ migrate-dotnet9-to-dotnet10; tools: skill, view
migrate-dotnet9-to-dotnet10 Cryptography app with OpenSSL, X.509, and Rfc2898DeriveBytes 5.0/5 → 5.0/5 ✅ migrate-dotnet9-to-dotnet10; tools: skill, view
migrate-dotnet9-to-dotnet10 SDK and NuGet obscure tooling changes 5.0/5 → 4.0/5 🔴 ✅ migrate-dotnet9-to-dotnet10; tools: skill
migrate-dotnet9-to-dotnet10 JSON polymorphism with conflicting property names and XmlSerializer 3.0/5 → 5.0/5 🟢 ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view
migrate-dotnet9-to-dotnet10 WinForms and WPF desktop app with System.Drawing and DynamicResource 5.0/5 → 4.0/5 🔴 ✅ migrate-dotnet9-to-dotnet10; tools: skill
migrate-dotnet9-to-dotnet10 Containerized single-file app with P/Invoke and IDispatchEx 4.0/5 → 5.0/5 🟢 ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view
migrate-dotnet9-to-dotnet10 App using SslStream properties and SystemEvents 5.0/5 → 5.0/5 ✅ migrate-dotnet9-to-dotnet10; tools: skill, grep / ✅ migrate-dotnet9-to-dotnet10; tools: skill
migrate-dotnet9-to-dotnet10 Library with NuGet auditing, transitive deps, and InlineArray 5.0/5 → 5.0/5 ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view [52]
migrate-dotnet9-to-dotnet10 C# 14 compiler breaking changes — field keyword, extension keyword, disposal 4.0/5 → 5.0/5 🟢 ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view [53]
migrate-dotnet9-to-dotnet10 Blazor WASM app with generic math shift masking and tar operations 3.0/5 → 4.0/5 🟢 ✅ migrate-dotnet9-to-dotnet10; tools: report_intent, skill, view [54]
thread-abort-migration Worker thread with abort-based cancellation 4.0/5 → 5.0/5 🟢 ✅ thread-abort-migration; tools: skill ✅ 0.09
thread-abort-migration Timeout enforcement via Thread.Abort 4.0/5 → 5.0/5 🟢 ✅ thread-abort-migration; tools: skill ✅ 0.09
thread-abort-migration Blocking WaitHandle with Thread.Interrupt 4.0/5 → 4.0/5 ✅ thread-abort-migration; tools: skill / ✅ thread-abort-migration; tools: report_intent, skill ✅ 0.09
thread-abort-migration ASP.NET Response.End and Response.Redirect with Thread.Abort 4.0/5 → 3.0/5 🔴 ✅ thread-abort-migration; tools: skill, report_intent, create / ✅ thread-abort-migration; tools: report_intent, skill ✅ 0.09
thread-abort-migration Thread.Join and Thread.Sleep only — should not migrate 4.0/5 → 5.0/5 🟢 ⚠️ NOT ACTIVATED / ✅ thread-abort-migration; tools: skill ✅ 0.09
directory-build-organization Organize build infrastructure for a multi-project repo 3.0/5 → 4.0/5 🟢 ✅ directory-build-organization; tools: skill / ⚠️ NOT ACTIVATED ✅ 0.18 [55]
msbuild-antipatterns Review MSBuild files for anti-patterns and style issues 5.0/5 → 5.0/5 ✅ msbuild-antipatterns; tools: skill, glob / ✅ msbuild-antipatterns; tools: task, read_agent, glob, skill ✅ 0.05 [56]
binlog-generation Build project with /bl flag 1.0/5 → 5.0/5 🟢 ✅ binlog-generation; tools: skill ✅ 0.00
binlog-generation Build with /bl in PowerShell 4.0/5 → 5.0/5 🟢 ✅ binlog-generation; tools: skill ✅ 0.00
binlog-generation Build multiple configurations with unique binlogs 5.0/5 → 5.0/5 ✅ binlog-generation; tools: skill / ⚠️ NOT ACTIVATED ✅ 0.00 [57]
msbuild-server Recommend MSBuild Server for slow CLI incremental builds 3.0/5 → 5.0/5 🟢 ✅ msbuild-server; tools: skill 🟡 0.23
binlog-failure-analysis Diagnose build failures from binlog only (no source files) 3.0/5 → 5.0/5 🟢 ✅ binlog-failure-analysis; tools: skill ✅ 0.05
incremental-build Analyze incremental build issues 3.0/5 → 4.0/5 🟢 ✅ incremental-build; tools: skill, bash / ⚠️ NOT ACTIVATED ✅ 0.12
check-bin-obj-clash Diagnose bin/obj output path clashes 4.0/5 → 5.0/5 🟢 ✅ check-bin-obj-clash; tools: skill / ✅ check-bin-obj-clash; tools: skill, glob ✅ 0.12
build-perf-diagnostics Diagnose slow build for a small project 4.0/5 → 4.0/5 ⚠️ NOT ACTIVATED 🟡 0.21
eval-performance Analyze MSBuild evaluation performance issues 4.0/5 → 4.0/5 ✅ eval-performance; tools: skill, bash / ✅ eval-performance; tools: skill ✅ 0.11 [58]
resolve-project-references Explain misleading ResolveProjectReferences time 3.0/5 → 5.0/5 🟢 ✅ resolve-project-references; tools: skill ✅ 0.12
build-perf-baseline Establish build performance baseline and recommend optimizations 2.0/5 ⏰ → 2.0/5 ⏰ ✅ build-perf-baseline; tools: skill / ⚠️ NOT ACTIVATED 🟡 0.24
build-parallelism Analyze build parallelism bottlenecks 2.0/5 ⏰ → 2.0/5 ⏰ ✅ build-parallelism; tools: skill, task, glob, edit / ✅ build-parallelism; tools: task, skill, edit ✅ 0.14
msbuild-modernization Modernize legacy project to SDK-style 5.0/5 → 5.0/5 ✅ msbuild-modernization; tools: skill, edit, bash ✅ 0.05 [59]
including-generated-files Diagnose generated file inclusion failure 3.0/5 → 5.0/5 🟢 ✅ including-generated-files; tools: skill / ⚠️ NOT ACTIVATED 🟡 0.24
convert-to-cpm Decline CPM conversion for packages.config project 1.0/5 → 1.0/5 ℹ️ not activated (expected) 🟡 0.25
convert-to-cpm Recommend CPM when updating packages with version conflicts 2.0/5 → 3.0/5 🟢 ✅ convert-to-cpm; tools: skill, bash, create / ✅ convert-to-cpm; tools: skill, bash 🟡 0.25
convert-to-cpm Recommend CPM when updating packages in a complex repository 2.0/5 → 2.0/5 ✅ convert-to-cpm; tools: skill, read_agent 🟡 0.25
convert-to-cpm Convert single project to CPM 2.0/5 → 5.0/5 🟢 ✅ convert-to-cpm; tools: skill, glob, bash 🟡 0.25
convert-to-cpm Convert multi-project solution to CPM 2.0/5 → 5.0/5 🟢 ✅ convert-to-cpm; tools: skill, bash 🟡 0.25
convert-to-cpm Convert solution with MSBuild property versions to CPM 2.0/5 → 4.0/5 🟢 ✅ convert-to-cpm; tools: skill, bash / ✅ convert-to-cpm; tools: skill, task, glob, bash, read_agent, grep 🟡 0.25
convert-to-cpm Convert solution with version conflicts to CPM 2.0/5 → 4.0/5 🟢 ✅ convert-to-cpm; tools: skill, bash / ✅ convert-to-cpm; tools: skill, task, bash 🟡 0.25
convert-to-cpm Convert complex repository with multiple CPM challenges 3.0/5 → 4.0/5 🟢 ✅ convert-to-cpm; tools: skill, glob 🟡 0.25

[1] (Plugin) Quality unchanged but weighted score is -10.0% due to: tokens (24337 → 51391), tool calls (2 → 4), time (14.7s → 29.3s)
[2] (Plugin) Quality unchanged but weighted score is -11.0% due to: tokens (24574 → 50700), quality, tool calls (2 → 3), time (19.9s → 25.9s)
[3] (Plugin) Quality unchanged but weighted score is -16.2% due to: judgment, quality
[4] (Plugin) Quality unchanged but weighted score is -5.6% due to: tokens (12846 → 46330), tool calls (0 → 3)
[5] (Isolated) Quality improved but weighted score is -3.1% due to: tokens (24176 → 59316), tool calls (2 → 5)
[6] (Plugin) Quality unchanged but weighted score is -3.3% due to: tokens (174624 → 277817), tool calls (19 → 25)
[7] (Isolated) Quality unchanged but weighted score is -24.8% due to: judgment, tokens (13145 → 27630), quality, tool calls (0 → 1), time (13.7s → 25.3s)
[8] (Plugin) Quality unchanged but weighted score is -4.8% due to: tokens (12956 → 27436), tool calls (0 → 2)
[9] (Isolated) Quality unchanged but weighted score is -0.8% due to: time (32.2s → 39.0s)
[10] (Plugin) Quality unchanged but weighted score is -7.2% due to: tokens (13313 → 33831), tool calls (0 → 1)
[11] (Plugin) Quality unchanged but weighted score is -11.8% due to: judgment, quality
[12] (Isolated) Quality unchanged but weighted score is -1.2% due to: tokens (38091 → 98219)
[13] (Plugin) Quality unchanged but weighted score is -3.9% due to: time (11.8s → 22.1s), tokens (24062 → 32186)
[14] (Plugin) Quality unchanged but weighted score is -5.9% due to: tokens (65851 → 128086), tool calls (7 → 10)
[15] (Plugin) Quality unchanged but weighted score is -3.0% due to: tokens (51890 → 653025), errors (0 → 1), tool calls (7 → 33), time (33.3s → 300.1s)
[16] (Plugin) Quality unchanged but weighted score is -6.6% due to: time (12.2s → 28.5s), tokens (36463 → 53022), tool calls (4 → 7)
[17] (Plugin) Quality unchanged but weighted score is -6.0% due to: tokens (24577 → 67446), tool calls (3 → 6), time (15.2s → 30.2s)
[18] (Isolated) Quality improved but weighted score is -18.5% due to: completion (✓ → ✗), quality
[19] (Plugin) Quality unchanged but weighted score is -4.0% due to: tokens (11983 → 32022), tool calls (0 → 1), time (6.8s → 11.8s)
[20] (Isolated) Quality improved but weighted score is -3.2% due to: tokens (346352 → 511191), time (170.8s → 222.1s)
[21] (Plugin) Quality improved but weighted score is -9.0% due to: completion (✓ → ✗), tokens (12980 → 55869), tool calls (0 → 9), time (26.2s → 94.3s)
[22] (Plugin) Quality unchanged but weighted score is -3.3% due to: quality
[23] (Plugin) Quality unchanged but weighted score is -5.2% due to: tokens (12248 → 33601), tool calls (0 → 1), time (22.5s → 30.2s)
[24] (Plugin) Quality unchanged but weighted score is -9.4% due to: tokens (24841 → 47175), tool calls (2 → 5), time (17.7s → 34.7s)
[25] (Isolated) Quality improved but weighted score is -6.5% due to: tokens (25278 → 62879), tool calls (2 → 6), time (23.3s → 43.6s)
[26] (Plugin) Quality unchanged but weighted score is -0.1% due to: efficiency metrics
[27] (Plugin) Quality unchanged but weighted score is -6.3% due to: tokens (12151 → 44634), tool calls (0 → 3)
[28] (Plugin) Quality unchanged but weighted score is -10.3% due to: errors (0 → 1), tokens (24275 → 40969), time (21.5s → 30.1s), tool calls (3 → 4)
[29] (Isolated) Quality unchanged but weighted score is -24.9% due to: completion (✓ → ✗), errors (0 → 1), tokens (41595 → 62697), tool calls (5 → 10), time (42.2s → 120.2s)
[30] (Isolated) Quality unchanged but weighted score is -9.5% due to: tokens (38683 → 97190), tool calls (4 → 9), time (31.5s → 56.1s)
[31] (Plugin) Quality unchanged but weighted score is -1.4% due to: tokens (108543 → 128648), tool calls (7 → 9)
[32] (Isolated) Quality unchanged but weighted score is -10.0% due to: tokens (28602 → 92624), tool calls (2 → 8), time (41.3s → 98.4s)
[33] (Plugin) Quality unchanged but weighted score is -15.3% due to: quality, tokens (43177 → 256347), tool calls (3 → 13), time (29.0s → 174.8s)
[34] (Plugin) Quality unchanged but weighted score is -8.7% due to: tokens (24486 → 67658), time (19.4s → 35.0s), tool calls (3 → 5)
[35] (Plugin) Quality unchanged but weighted score is -0.5% due to: efficiency metrics
[36] (Plugin) Quality unchanged but weighted score is -3.2% due to: tokens (146389 → 230365)
[37] (Isolated) Quality unchanged but weighted score is -5.2% due to: tokens (65875 → 113909), time (36.0s → 52.3s)
[38] (Isolated) Quality unchanged but weighted score is -33.7% due to: completion (✓ → ✗), judgment, quality, time (84.9s → 122.0s)
[39] (Isolated) Quality unchanged but weighted score is -12.1% due to: quality, tokens (12951 → 46679), tool calls (0 → 3)
[40] (Isolated) Quality improved but weighted score is -29.1% due to: judgment, quality, tokens (13398 → 46159), tool calls (0 → 4)
[41] (Plugin) Quality unchanged but weighted score is -0.8% due to: quality
[42] (Isolated) Quality unchanged but weighted score is -22.4% due to: quality, judgment
[43] (Isolated) Quality improved but weighted score is -10.3% due to: judgment
[44] (Plugin) Quality unchanged but weighted score is -4.4% due to: tokens (63308 → 119355), tool calls (15 → 20)
[45] (Isolated) Quality unchanged but weighted score is -26.0% due to: judgment, tokens (58613 → 510280), quality, tool calls (12 → 29), time (59.0s → 210.5s)
[46] (Isolated) Quality unchanged but weighted score is -15.9% due to: judgment, quality, tokens (49236 → 54482)
[47] (Isolated) Quality unchanged but weighted score is -13.7% due to: quality, tokens (16117 → 74472), tool calls (0 → 5)
[48] (Isolated) Quality unchanged but weighted score is -14.7% due to: quality, tokens (14193 → 53803), tool calls (0 → 3)
[49] (Isolated) Quality improved but weighted score is -3.9% due to: judgment
[50] (Isolated) Quality unchanged but weighted score is -5.2% due to: tokens (30967 → 54468), tool calls (2 → 3)
[51] (Isolated) Quality unchanged but weighted score is -14.4% due to: judgment, quality
[52] (Isolated) Quality unchanged but weighted score is -13.2% due to: tokens (12538 → 56576), quality, tool calls (0 → 6), time (16.6s → 33.9s)
[53] (Isolated) Quality improved but weighted score is -6.9% due to: tokens (13868 → 55947), tool calls (0 → 5)
[54] (Plugin) Quality unchanged but weighted score is -0.3% due to: tokens (15860 → 59559), tool calls (0 → 6)
[55] (Plugin) Quality unchanged but weighted score is -27.0% due to: judgment, quality, tokens (59602 → 180555), time (54.3s → 149.8s), tool calls (14 → 20)
[56] (Isolated) Quality unchanged but weighted score is -17.6% due to: judgment, tokens (42352 → 97742), tool calls (11 → 14)
[57] (Plugin) Quality unchanged but weighted score is -1.8% due to: tokens (36232 → 47527)
[58] (Isolated) Quality unchanged but weighted score is -6.2% due to: tokens (38256 → 149730), time (24.9s → 54.6s), tool calls (9 → 16)
[59] (Plugin) Quality unchanged but weighted score is -9.2% due to: tokens (40014 → 125438), tool calls (7 → 14), time (36.3s → 61.5s)

timeout — run(s) hit the (30s, 60s, 120s, 160s, 180s, 300s, 360s, 1050s) scenario timeout limit; scoring may be impacted by aborting model execution before it could produce its full output (increase via timeout in eval.yaml)

Model: claude-opus-4.6 | Judge: claude-opus-4.6

📖 See InvestigatingResults.md for how to diagnose failures. Additional debugging guidance may be provided by your workflow.

🔍 Full results — includes quality and agent details

To investigate failures, paste this to your AI coding agent:

For PR 462 in dotnet/skills, download eval artifacts with gh run download 23738841866 --repo dotnet/skills --pattern "skill-validator-results-*" --dir ./eval-results, then fetch https://raw.githubusercontent.com/dotnet/skills/f457c8f277f4cac8138a8cc8eba9673b2b548b87/eng/skill-validator/InvestigatingResults.md and follow it to analyze the results.json files. Diagnose each failure, suggest fixes to the eval.yaml and skill content, and tell me what to fix first.

github-actions Bot added a commit that referenced this pull request Mar 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

double entries in evaluate table

3 participants