feat: enhance AI detection and add marketplace publishing docs #11
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Add comprehensive GitHub Marketplace publishing instructions - Document manual marketplace publishing requirement due to 2FA - Add marketplace eligibility requirements checklist - Note workflow files issue that may prevent marketplace publishing - Change action icon from 'robot' to 'battery-charging'
- Fix formatting issue where indicator list items were concatenated without newlines - Rebuild dist/ with the fix
- Add PRECISION INDICATORS category for surgical formatting fixes - Include patterns for single-character fixes and targeted corrections - Add detection for newline fixes and formatting consistency changes - Update analysis guidelines to better recognize AI-generated minor fixes - Add precision-changes and formatting-fix indicator extraction This should improve detection of AI-generated formatting fixes like adding newlines to list items, which are typical of AI assistant precision.
dcramer
changed the title
dcramer
changed the title
- Add specific examples of verbose naming patterns in evaluation prompts - Include "userDisplayNameString" type patterns as AI indicators - Add verbose-naming indicator extraction - Fix test failure where utils.ts wasn't being detected as AI-generated The enhanced detection now properly identifies overly descriptive variable names and verbose function names as strong AI indicators, resolving the failing test case.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Changes
PUBLISHING.md: Added detailed marketplace publishing process including:
action.yml: Changed branding icon from 'robot' to 'battery-charging'
src/index.ts: Fixed formatting issue where human fingerprint indicators were concatenated without newlines in PR comments
src/llm-evaluator.ts: Enhanced AI detection with new PRECISION INDICATORS category:
Notes
The documentation now clearly explains that creating a release (via CLI or web) does not automatically publish to the GitHub Marketplace - this requires a manual step through the GitHub web interface due to 2FA requirements.
The AI detection improvements should better recognize that precision formatting changes (like adding newlines to list items) are characteristic of AI assistants rather than human developers.
Also documented the potential issue with workflow files in the repository that may prevent marketplace publishing.