[External Plugin]: Add Arize skills as a plugin

[jimbobbennett]

Plugin name

arize-skills

Short description

Add Arize AX observability to LLM applications — auto-instrumentation, trace export, dataset management, experiment workflows, prompt optimization, and deep linking via the ax CLI.

GitHub repository

Arize-ai/arize-skills

Plugin path inside the repository

No response

Ref to review

v1.1.0

Commit SHA to review

45aef8d714ab489fd753b968c0f4dbd8cc9eaefd

Version

1.1.0

License identifier

MIT

Author name

Arize AI

Author URL

https://arize.com

Homepage URL

https://arize.com/docs/ax

Keywords

arize, observability, tracing, opentelemetry, llm, evals, datasets, experiments, instrumentation

Additional notes for reviewers

We have Arize AX plugins already synced to this repo, so those will need to be deleted when this plugin is made available.

Submission checklist

• The plugin lives in a public GitHub repository.
• The ref and/or sha I provided is immutable (release tag and/or full 40-character commit SHA), not a branch.
• This submission follows this repository's contribution, security, and responsible AI policies.
• This plugin is not already listed in the Awesome Copilot marketplace.

[github-actions]

⚠️ External plugin intake requires submitter fixes

This submission passed metadata validation, but quality gates found issues that must be fixed before it can move to maintainer review. Update the issue details or source plugin and then comment /rerun-intake.

• Plugin: arize-skills
• Repository: https://github.com/Arize-ai/arize-skills
• Ref: v1.1.0
• SHA: 45aef8d714ab489fd753b968c0f4dbd8cc9eaefd

Quality gate summary

Gate	Status
vally lint	fail
install smoke test	fail

• vally lint: fail
• install smoke test: fail
• overall: fail

vally lint output

✅ arize-admin (3/3 checks passed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✓ [orphan-files] No orphan files found across 1 skill(s).
        ✓ orphan-files: All 3 file(s) in references/ are reachable from SKILL.md.
❌ arize-ai-provider-integration (2/3 checks passed, 1 failed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 2 orphan file(s) not reachable from SKILL.md: references/ax-profiles.md, references/ax-setup.md.
❌ arize-annotation (2/3 checks passed, 1 failed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 2 orphan file(s) not reachable from SKILL.md: references/ax-profiles.md, references/ax-setup.md.
❌ arize-compliance-audit (2/3 checks passed, 1 failed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 4 orphan file(s) not reachable from SKILL.md: references/compliance-checklist-template.md, references/eu-ai-act-gpai.md, references/iso-42001.md, references/us-ai-compliance.md.
❌ arize-dataset (2/3 checks passed, 1 failed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 2 orphan file(s) not reachable from SKILL.md: references/ax-profiles.md, references/ax-setup.md.
❌ arize-evaluator (1/3 checks passed, 2 failed)
    ✗ [spec-compliance] 1 of 1 skill(s) have spec violations.
        ✗ spec-compliance: Spec checks failed.
            ✗ File length (799 lines) exceeds limit (500).
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 2 orphan file(s) not reachable from SKILL.md: references/ax-profiles.md, references/ax-setup.md.
❌ arize-experiment (2/3 checks passed, 1 failed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 2 orphan file(s) not reachable from SKILL.md: references/ax-profiles.md, references/ax-setup.md.
❌ arize-instrumentation (1/3 checks passed, 2 failed)
    ✗ [spec-compliance] 1 of 1 skill(s) have spec violations.
        ✗ spec-compliance: Spec checks failed.
            ✗ Compatibility length (509) exceeds limit (500).
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 4 orphan file(s) not reachable from SKILL.md: references/ax-profiles.md, references/integration-routing.md, references/manual-spans.md, references/tracing-assistant-mcp.md.
❌ arize-link (2/3 checks passed, 1 failed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 1 orphan file(s) not reachable from SKILL.md: references/EXAMPLES.md.
❌ arize-prompt-optimization (2/3 checks passed, 1 failed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 2 orphan file(s) not reachable from SKILL.md: references/ax-profiles.md, references/ax-setup.md.
❌ arize-prompts (2/3 checks passed, 1 failed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 3 orphan file(s) not reachable from SKILL.md: references/ax-profiles.md, references/ax-setup.md, references/cli-prompts.md.
❌ arize-trace (2/3 checks passed, 1 failed)
    ✓ [spec-compliance] All 1 skill(s) are spec-compliant.
        ✓ spec-compliance: All spec checks passed.
    ✓ [valid-refs] All file references across 1 skill(s) are valid.
        ✓ valid-refs: All file references resolve to existing files within the skill directory.
    ✗ [orphan-files] 1 of 1 skill(s) have orphan files.
        ✗ orphan-files: Found 2 orphan file(s) not reachable from SKILL.md: references/ax-profiles.md, references/ax-setup.md.

12 skill(s) linted, 1 passed, 11 failed

Install smoke test output

Plugin installed but no plugin.json was found in any recognized location under /tmp/external-plugin-quality-SSYCZu/copilot-home/.copilot/installed-plugins/external-plugin-intake/arize-skills

Canonical external.json payload

{
  "name": "arize-skills",
  "description": "Add Arize AX observability to LLM applications — auto-instrumentation, trace export, dataset management, experiment workflows, prompt optimization, and deep linking via the ax CLI.",
  "version": "1.1.0",
  "author": {
    "name": "Arize AI",
    "url": "https://arize.com"
  },
  "repository": "https://github.com/Arize-ai/arize-skills",
  "homepage": "https://arize.com/docs/ax",
  "license": "MIT",
  "keywords": [
    "arize",
    "observability",
    "tracing",
    "opentelemetry",
    "llm",
    "evals",
    "datasets",
    "experiments",
    "instrumentation"
  ],
  "source": {
    "source": "github",
    "repo": "Arize-ai/arize-skills",
    "ref": "v1.1.0",
    "sha": "45aef8d714ab489fd753b968c0f4dbd8cc9eaefd"
  }
}

View workflow run